2024-02-17T12:40:38.448 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T12:40:38.448 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199 --owner scheduled_yuriw@teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/orig.config.yaml 2024-02-17T12:40:38.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:40:38.586 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7563199' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 6822c7b54e949006be7a0802650d01723d834d1d valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 6822c7b54e949006be7a0802650d01723d834d1d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6822c7b54e949006be7a0802650d01723d834d1d owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2794 sha1: 6822c7b54e949006be7a0802650d01723d834d1d sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6822c7b54e949006be7a0802650d01723d834d1d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUay0Fl6ckYKzkq7St8dBQgq70YS6bOUPrVl0axY9dlSf846o+iwqaGnFJD3lbjPt4mxa/ZlOgGceAhV/gSmdg= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuhoUvgQ0QEgojHhkoCq2JwlRavsmEO0z4/tkX0qVF0pu884VU725wmEEfJjqLbcVNw0OW8H8+nq4CJblNcmok= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-16_20:13:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-17T12:40:38.586 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa; will attempt to use it 2024-02-17T12:40:38.587 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks 2024-02-17T12:40:38.587 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-17T12:40:38.588 INFO:teuthology.task.internal:Checking packages... 2024-02-17T12:40:38.618 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6822c7b54e949006be7a0802650d01723d834d1d' 2024-02-17T12:40:38.618 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-17T12:40:38.618 INFO:teuthology.packaging:ref: None 2024-02-17T12:40:38.618 INFO:teuthology.packaging:tag: None 2024-02-17T12:40:38.619 INFO:teuthology.packaging:branch: main 2024-02-17T12:40:38.619 INFO:teuthology.packaging:sha1: 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:40:38.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-02-17T12:40:38.862 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1543.g0ed764e6 2024-02-17T12:40:38.863 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-17T12:40:38.870 INFO:teuthology.task.internal:no buildpackages task found 2024-02-17T12:40:38.870 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-17T12:40:38.884 INFO:teuthology.task.internal:Saving configuration 2024-02-17T12:40:38.920 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-17T12:40:38.926 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T12:40:38.952 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 12:35:30.693880', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUay0Fl6ckYKzkq7St8dBQgq70YS6bOUPrVl0axY9dlSf846o+iwqaGnFJD3lbjPt4mxa/ZlOgGceAhV/gSmdg='} 2024-02-17T12:40:38.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 12:35:30.692546', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuhoUvgQ0QEgojHhkoCq2JwlRavsmEO0z4/tkX0qVF0pu884VU725wmEEfJjqLbcVNw0OW8H8+nq4CJblNcmok='} 2024-02-17T12:40:38.980 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-17T12:40:38.986 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-02-17T12:40:38.987 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-02-17T12:40:38.987 INFO:teuthology.run_tasks:Running task console_log... 2024-02-17T12:40:39.059 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa4740ca4c0>, signals=[15]) 2024-02-17T12:40:39.060 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-17T12:40:39.066 INFO:teuthology.task.internal:Opening connections... 2024-02-17T12:40:39.066 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:40:39.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:40:39.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T12:40:39.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:40:39.254 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-17T12:40:39.261 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-02-17T12:40:39.278 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-02-17T12:40:39.279 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-02-17T12:40:39.333 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T12:40:39.334 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:40:39.335 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-17T12:40:39.358 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-02-17T12:40:39.375 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-02-17T12:40:39.375 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-02-17T12:40:39.432 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:40:39.433 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T12:40:39.434 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:40:39.434 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-02-17T12:40:39.458 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-17T12:40:39.467 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-17T12:40:39.472 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-17T12:40:39.472 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-02-17T12:40:39.475 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-02-17T12:40:39.491 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-17T12:40:39.497 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-17T12:40:39.498 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-02-17T12:40:39.529 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-02-17T12:40:39.640 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-17T12:40:39.690 INFO:teuthology.run_tasks:Running task kernel... 2024-02-17T12:40:39.705 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-17T12:40:39.705 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-17T12:40:39.706 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T12:40:39.706 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T12:40:39.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:40:39.722 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-02-17T12:40:39.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:40:39.723 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-02-17T12:40:39.778 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-361.el9.x86_64 2024-02-17T12:40:39.779 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.14.0-361.el9.x86_64 2024-02-17T12:40:39.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-02-17T12:40:39.781 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-361.el9.x86_64 2024-02-17T12:40:39.781 INFO:teuthology.task.kernel:Running kernel on smithi160: 5.14.0-361.el9.x86_64 2024-02-17T12:40:39.781 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2024-02-17T12:40:42.090 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-9 - AppStream 9.5 MB/s | 6.7 MB 00:00 2024-02-17T12:40:42.222 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - AppStream 8.4 MB/s | 6.7 MB 00:00 2024-02-17T12:40:43.457 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-02-17T12:40:43.839 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-02-17T12:40:44.888 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-02-17T12:40:46.256 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-02-17T12:40:46.639 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-02-17T12:40:51.415 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 19 MB 00:04 2024-02-17T12:40:51.830 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.1 MB 00:01 2024-02-17T12:40:53.914 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 15 kB 00:00 2024-02-17T12:40:55.702 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2024-02-17T12:40:56.515 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.1 MB 00:01 2024-02-17T12:40:58.815 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2024-02-17T12:41:00.442 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-17T12:41:00.665 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-02-17T12:41:02.939 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-17T12:41:02.939 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-17T12:41:03.077 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-02-17T12:41:03.082 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-02-17T12:41:03.082 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-02-17T12:41:03.082 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-02-17T12:41:03.082 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-02-17T12:41:03.082 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-17T12:41:03.082 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-02-17T12:41:03.083 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:03.084 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 100 M 2024-02-17T12:41:03.084 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 123 M 2024-02-17T12:41:03.084 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-02-17T12:41:03.450 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 17 MB/s | 6.1 MB 00:00 2024-02-17T12:41:04.050 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 22 MB/s | 21 MB 00:00 2024-02-17T12:41:04.817 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 25 MB/s | 33 MB 00:01 2024-02-17T12:41:05.159 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 19 MB/s | 39 MB 00:02 2024-02-17T12:41:05.162 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-02-17T12:41:05.162 INFO:teuthology.orchestra.run.smithi136.stdout:Total 48 MB/s | 100 MB 00:02 2024-02-17T12:41:05.162 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-02-17T12:41:05.458 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-02-17T12:41:05.550 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-02-17T12:41:05.550 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-02-17T12:41:06.582 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-02-17T12:41:06.583 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-02-17T12:41:07.732 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-17T12:41:07.732 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-17T12:41:07.823 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-02-17T12:41:07.831 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-02-17T12:41:07.832 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-02-17T12:41:07.832 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:07.832 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 100 M 2024-02-17T12:41:07.832 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 123 M 2024-02-17T12:41:07.832 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-02-17T12:41:08.276 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 14 MB/s | 6.1 MB 00:00 2024-02-17T12:41:08.785 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 22 MB/s | 21 MB 00:00 2024-02-17T12:41:08.983 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-02-17T12:41:09.627 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 22 MB/s | 39 MB 00:01 2024-02-17T12:41:09.633 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-17T12:41:09.761 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T12:41:09.927 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 20 MB/s | 33 MB 00:01 2024-02-17T12:41:09.930 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-02-17T12:41:09.930 INFO:teuthology.orchestra.run.smithi160.stdout:Total 47 MB/s | 100 MB 00:02 2024-02-17T12:41:09.930 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-02-17T12:41:10.342 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-02-17T12:41:10.342 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-02-17T12:41:11.370 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-02-17T12:41:11.371 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-02-17T12:41:12.534 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T12:41:12.740 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T12:41:13.801 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-02-17T12:41:14.520 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-17T12:41:14.660 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T12:41:17.445 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T12:41:17.455 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T12:41:17.638 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T12:41:17.644 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:22.392 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T12:41:22.394 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:22.583 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:27.332 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:51.370 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:51.370 INFO:teuthology.orchestra.run.smithi136.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-17T12:41:51.370 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:51.441 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:51.927 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:51.927 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-17T12:41:51.927 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T12:41:51.928 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T12:41:52.362 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:52.363 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-02-17T12:41:52.901 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T12:41:53.025 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T12:41:53.025 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T12:41:53.026 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-17T12:41:53.026 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T12:41:53.026 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T12:41:53.026 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-17T12:41:53.026 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T12:41:53.026 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T12:41:53.133 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T12:41:53.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T12:41:53.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-02-17T12:41:53.168 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-02-17T12:41:53.168 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-02-17T12:41:53.168 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-02-17T12:41:53.168 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 68.el9 2024-02-17T12:41:53.168 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8264254 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-02-17T12:41:53.169 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:53.170 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T12:41:53.170 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T12:41:53.170 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T12:41:53.170 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-02-17T12:41:53.170 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:41:53.170 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T12:41:53.171 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T12:41:53.171 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 5.14.0-421.el9.x86_64 2024-02-17T12:41:53.171 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T12:41:53.816 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-02-17T12:41:55.208 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-17T12:41:55.249 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-02-17T12:41:55.252 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-02-17T12:41:55.268 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.jdxWFMd9y3 2024-02-17T12:41:55.268 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jdxWFMd9y3 2024-02-17T12:41:55.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.jdxWFMd9y3 2024-02-17T12:41:55.475 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.jdxWFMd9y3 is 6KB 2024-02-17T12:41:55.523 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.jdxWFMd9y3 2024-02-17T12:41:55.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T12:41:55.604 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-17T12:41:55.604 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-17T12:41:55.604 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-17T12:41:55.605 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-17T12:41:55.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-17T12:41:55.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-02-17T12:41:56.550 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:56.550 INFO:teuthology.orchestra.run.smithi160.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-17T12:41:56.550 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:56.623 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:56.998 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:56.999 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-17T12:41:56.999 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T12:41:56.999 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:57.427 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-02-17T12:41:57.910 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T12:41:58.045 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T12:41:58.045 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T12:41:58.045 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-17T12:41:58.045 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T12:41:58.045 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T12:41:58.045 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-17T12:41:58.045 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T12:41:58.046 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T12:41:58.154 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T12:41:58.155 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T12:41:58.155 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 68.el9 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8264254 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-02-17T12:41:58.192 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-02-17T12:41:58.193 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:41:58.194 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T12:41:58.195 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T12:41:58.195 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.14.0-421.el9.x86_64 2024-02-17T12:41:58.195 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T12:41:58.800 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-02-17T12:42:00.204 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-17T12:42:00.224 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-02-17T12:42:00.226 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-02-17T12:42:00.246 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.j4vfSiY3H3 2024-02-17T12:42:00.246 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.j4vfSiY3H3 2024-02-17T12:42:00.323 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.j4vfSiY3H3 2024-02-17T12:42:00.476 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.j4vfSiY3H3 is 6KB 2024-02-17T12:42:00.501 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.j4vfSiY3H3 2024-02-17T12:42:00.517 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T12:42:00.585 INFO:teuthology.orchestra.run.smithi160.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-17T12:42:00.585 INFO:teuthology.orchestra.run.smithi160.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-17T12:42:00.585 INFO:teuthology.orchestra.run.smithi160.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-17T12:42:00.585 INFO:teuthology.orchestra.run.smithi160.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-17T12:42:00.586 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-17T12:42:00.726 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-02-17T12:42:25.772 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-17T12:42:25.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:42:25.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:42:30.732 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-17T12:42:30.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:42:30.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:42:44.156 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T12:42:49.276 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-17T12:42:53.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:42:53.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:42:56.220 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T12:42:58.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:42:58.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:01.340 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-17T12:43:08.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:43:08.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:13.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:43:13.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:26.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T12:43:31.772 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-02-17T12:43:41.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:43:41.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:41.981 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-02-17T12:43:42.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:43:42.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-421.el9.x86_64"... 2024-02-17T12:43:42.363 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-02-17T12:43:42.377 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-421.el9.x86_64 2024-02-17T12:43:42.378 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-17T12:43:42.378 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T12:43:42.378 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T12:43:43.378 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-17T12:43:43.379 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-17T12:43:43.478 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-02-17T12:43:43.510 DEBUG:teuthology.parallel:result is None 2024-02-17T12:43:46.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:43:46.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:48.995 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-02-17T12:43:49.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:43:49.473 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-421.el9.x86_64"... 2024-02-17T12:43:49.474 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-02-17T12:43:49.487 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-421.el9.x86_64 2024-02-17T12:43:49.488 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-17T12:43:49.488 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T12:43:49.488 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T12:43:50.488 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-17T12:43:50.489 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-17T12:43:50.557 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-02-17T12:43:50.604 DEBUG:teuthology.parallel:result is None 2024-02-17T12:43:50.605 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-17T12:43:50.612 INFO:teuthology.task.internal:Creating test directory... 2024-02-17T12:43:50.612 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T12:43:50.615 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T12:43:50.631 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-17T12:43:50.637 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-17T12:43:50.646 INFO:teuthology.task.internal:Creating archive directory... 2024-02-17T12:43:50.646 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T12:43:50.674 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T12:43:50.725 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-17T12:43:50.732 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-17T12:43:50.732 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T12:43:50.735 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T12:43:50.764 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:43:50.778 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:43:50.779 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:43:50.791 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:43:50.793 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-17T12:43:50.800 INFO:teuthology.task.internal:Configuring sudo... 2024-02-17T12:43:50.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T12:43:50.823 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T12:43:50.860 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-17T12:43:50.869 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-17T12:43:50.869 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T12:43:50.892 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T12:43:50.915 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T12:43:50.994 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T12:43:51.045 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T12:43:51.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T12:43:51.169 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:43:51.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T12:43:51.236 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T12:43:51.276 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T12:43:51.327 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T12:43:51.408 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T12:43:51.450 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:43:51.450 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T12:43:51.519 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-02-17T12:43:51.521 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-02-17T12:43:51.575 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T12:43:51.597 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T12:43:52.079 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-17T12:43:52.087 INFO:teuthology.task.internal:Starting timer... 2024-02-17T12:43:52.087 INFO:teuthology.run_tasks:Running task pcp... 2024-02-17T12:43:52.107 INFO:teuthology.run_tasks:Running task selinux... 2024-02-17T12:43:52.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-02-17T12:43:52.185 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-02-17T12:43:52.187 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-02-17T12:43:52.253 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-02-17T12:43:52.255 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-17T12:43:52.255 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-02-17T12:43:52.285 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-02-17T12:43:52.285 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-02-17T12:43:52.300 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-02-17T12:43:52.300 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-02-17T12:43:52.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T12:43:52.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:43:52.352 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T12:43:52.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:43:52.380 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-17T12:43:52.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-02-17T12:43:52.428 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-02-17T12:43:52.462 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-17T12:43:52.472 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-17T12:43:52.488 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-17T12:43:52.490 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi136.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-17T12:48:06.306 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-02-17T12:48:06.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:48:06.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:48:06.398 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-02-17T12:48:06.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T12:48:06.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:48:06.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:48:06.569 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-02-17T12:48:06.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-02-17T12:48:06.647 INFO:teuthology.run_tasks:Running task clock... 2024-02-17T12:48:06.664 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-17T12:48:06.664 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T12:48:06.665 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T12:48:06.669 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T12:48:06.669 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T12:48:06.698 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T12:48:06.714 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T12:48:06.717 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T12:48:06.733 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T12:48:06.743 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-02-17T12:48:06.757 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-02-17T12:48:06.763 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-02-17T12:48:06.773 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T12:48:06.776 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-02-17T12:48:06.789 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T12:48:06.793 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T12:48:06.809 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T12:48:06.848 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-02-17T12:48:06.849 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T12:48:06.849 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-02-17T12:48:06.850 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.850 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.850 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.850 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.868 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-02-17T12:48:06.872 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T12:48:06.872 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-02-17T12:48:06.872 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.872 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.872 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.872 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T12:48:06.873 INFO:teuthology.run_tasks:Running task install... 2024-02-17T12:48:06.882 DEBUG:teuthology.task.install:project ceph 2024-02-17T12:48:06.882 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}} 2024-02-17T12:48:06.882 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'} 2024-02-17T12:48:06.883 INFO:teuthology.task.install:Using flavor: default 2024-02-17T12:48:06.888 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-02-17T12:48:06.888 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-17T12:48:06.889 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'tag': None, 'wait_for_package': False} 2024-02-17T12:48:06.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:48:06.891 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'tag': None, 'wait_for_package': False} 2024-02-17T12:48:06.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:48:07.134 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/ 2024-02-17T12:48:07.135 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1515.g6822c7b5 2024-02-17T12:48:07.138 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/ 2024-02-17T12:48:07.138 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1515.g6822c7b5 2024-02-17T12:48:07.333 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-17T12:48:07.333 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:48:07.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-17T12:48:07.337 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-17T12:48:07.337 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:48:07.337 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-17T12:48:07.365 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-17T12:48:07.366 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6822c7b54e949006be7a0802650d01723d834d1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-17T12:48:07.367 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-17T12:48:07.367 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6822c7b54e949006be7a0802650d01723d834d1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-17T12:48:07.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-17T12:48:07.435 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-17T12:48:07.514 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-17T12:48:07.516 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-17T12:48:07.590 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-02-17T12:48:07.591 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-02-17T12:48:07.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-02-17T12:48:07.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-02-17T12:48:07.841 INFO:teuthology.orchestra.run.smithi160.stdout:74 files removed 2024-02-17T12:48:07.855 INFO:teuthology.orchestra.run.smithi136.stdout:74 files removed 2024-02-17T12:48:07.871 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-17T12:48:07.885 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-17T12:48:08.508 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 268 kB/s | 82 kB 00:00 2024-02-17T12:48:08.597 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 201 kB/s | 82 kB 00:00 2024-02-17T12:48:08.914 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 37 kB/s | 10 kB 00:00 2024-02-17T12:48:08.925 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-02-17T12:48:09.306 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-02-17T12:48:09.325 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-02-17T12:48:09.950 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-17T12:48:10.044 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.7 MB 00:00 2024-02-17T12:48:11.434 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-02-17T12:48:11.528 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2024-02-17T12:48:12.783 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.0 MB 00:01 2024-02-17T12:48:13.160 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.0 MB 00:01 2024-02-17T12:48:14.583 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-02-17T12:48:15.169 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-02-17T12:48:18.884 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.1 MB 00:00 2024-02-17T12:48:20.503 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.1 MB 00:01 2024-02-17T12:48:20.527 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-17T12:48:21.845 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 15 kB 00:00 2024-02-17T12:48:22.844 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 20 MB 00:02 2024-02-17T12:48:23.088 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2024-02-17T12:48:27.678 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-17T12:48:27.987 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-02-17T12:48:30.235 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T12:48:30.236 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T12:48:30.269 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-17T12:48:30.270 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-17T12:48:30.271 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-17T12:48:30.272 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-17T12:48:30.274 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T12:48:30.277 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-17T12:48:30.279 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-17T12:48:30.364 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout:==================================================================================================== 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout:==================================================================================================== 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 6.6 k 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.3 M 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 68 M 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 416 M 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 885 k 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.9 M 2024-02-17T12:48:30.388 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 146 k 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.4 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 48 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.5 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 138 k 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 1.8 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 20 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 7.4 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 52 k 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 98 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 287 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 9.8 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 176 M 2024-02-17T12:48:30.389 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 47 M 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 673 M 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 264 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 748 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 217 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 27 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 18 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 31 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 743 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.4 M 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 127 k 2024-02-17T12:48:30.390 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 109 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 44 M 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 52 M 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 162 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 615 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 321 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 771 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 298 k 2024-02-17T12:48:30.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.1 M 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 99 k 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 337 k 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 85 k 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 509 k 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 52 M 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 171 k 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.3 M 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-17T12:48:30.392 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.4 M 2024-02-17T12:48:30.393 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-17T12:48:30.394 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 20 M 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 22 M 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 31 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 2.1 M 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 247 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 4.7 M 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 17 M 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 15 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 25 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-17T12:48:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 163 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 499 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-17T12:48:30.396 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.1 M 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-17T12:48:30.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 45 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 131 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-17T12:48:30.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-17T12:48:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-17T12:48:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-17T12:48:30.401 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-02-17T12:48:30.402 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-17T12:48:30.403 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:48:30.403 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-02-17T12:48:30.403 INFO:teuthology.orchestra.run.smithi160.stdout:==================================================================================================== 2024-02-17T12:48:30.403 INFO:teuthology.orchestra.run.smithi160.stdout:Install 172 Packages 2024-02-17T12:48:30.403 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 26 Packages 2024-02-17T12:48:30.403 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:48:30.404 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 2.1 G 2024-02-17T12:48:30.404 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-02-17T12:48:30.702 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T12:48:30.703 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T12:48:30.738 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-17T12:48:30.739 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-17T12:48:30.740 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-17T12:48:30.741 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-17T12:48:30.743 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T12:48:30.746 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-17T12:48:30.747 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-17T12:48:30.832 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-02-17T12:48:30.868 INFO:teuthology.orchestra.run.smithi136.stdout:==================================================================================================== 2024-02-17T12:48:30.868 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-02-17T12:48:30.868 INFO:teuthology.orchestra.run.smithi136.stdout:==================================================================================================== 2024-02-17T12:48:30.868 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-02-17T12:48:30.868 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 6.6 k 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.3 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 68 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 416 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 885 k 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.9 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 146 k 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.4 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 48 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.5 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 138 k 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 1.8 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 20 M 2024-02-17T12:48:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 7.4 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 52 k 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 98 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 287 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 9.8 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 176 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 47 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 673 M 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 264 k 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 748 k 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 217 k 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 27 k 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 18 k 2024-02-17T12:48:30.870 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 31 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 743 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.4 M 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 127 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 109 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 44 M 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 52 M 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-17T12:48:30.871 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 162 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 615 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 321 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 771 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 298 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.1 M 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 99 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 337 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 85 k 2024-02-17T12:48:30.872 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 509 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 52 M 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 171 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.3 M 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-17T12:48:30.873 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.4 M 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-17T12:48:30.874 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-17T12:48:30.875 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 20 M 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-debuginfo x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 22 M 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 31 k 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 2.1 M 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 247 k 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 4.7 M 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 17 M 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 15 k 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 25 k 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-17T12:48:30.876 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 163 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 499 k 2024-02-17T12:48:30.877 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.1 M 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-17T12:48:30.878 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 45 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 131 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-17T12:48:30.879 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-17T12:48:30.880 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-17T12:48:30.881 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-17T12:48:30.882 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-17T12:48:30.883 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-02-17T12:48:30.884 INFO:teuthology.orchestra.run.smithi136.stdout:==================================================================================================== 2024-02-17T12:48:30.885 INFO:teuthology.orchestra.run.smithi136.stdout:Install 172 Packages 2024-02-17T12:48:30.885 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 26 Packages 2024-02-17T12:48:30.885 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:48:30.886 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 2.1 G 2024-02-17T12:48:30.886 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-02-17T12:48:30.928 INFO:teuthology.orchestra.run.smithi160.stdout:(1/198): ceph-19.0.0-1515.g6822c7b5.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-02-17T12:48:31.463 INFO:teuthology.orchestra.run.smithi136.stdout:(1/198): ceph-19.0.0-1515.g6822c7b5.el9.x86_64. 34 kB/s | 6.6 kB 00:00 2024-02-17T12:48:32.015 INFO:teuthology.orchestra.run.smithi160.stdout:(2/198): ceph-base-19.0.0-1515.g6822c7b5.el9.x8 4.2 MB/s | 5.3 MB 00:01 2024-02-17T12:48:32.521 INFO:teuthology.orchestra.run.smithi160.stdout:(3/198): ceph-common-19.0.0-1515.g6822c7b5.el9. 13 MB/s | 20 MB 00:01 2024-02-17T12:48:35.670 INFO:teuthology.orchestra.run.smithi160.stdout:(4/198): ceph-debuginfo-19.0.0-1515.g6822c7b5.e 7.1 MB/s | 22 MB 00:03 2024-02-17T12:48:35.746 INFO:teuthology.orchestra.run.smithi136.stdout:(2/198): ceph-base-19.0.0-1515.g6822c7b5.el9.x8 1.2 MB/s | 5.3 MB 00:04 2024-02-17T12:48:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:(5/198): ceph-fuse-19.0.0-1515.g6822c7b5.el9.x8 5.0 MB/s | 885 kB 00:00 2024-02-17T12:48:36.687 INFO:teuthology.orchestra.run.smithi160.stdout:(6/198): ceph-fuse-debuginfo-19.0.0-1515.g6822c 7.1 MB/s | 5.9 MB 00:00 2024-02-17T12:48:36.729 INFO:teuthology.orchestra.run.smithi160.stdout:(7/198): ceph-immutable-object-cache-19.0.0-151 3.4 MB/s | 146 kB 00:00 2024-02-17T12:48:36.904 INFO:teuthology.orchestra.run.smithi160.stdout:(8/198): ceph-immutable-object-cache-debuginfo- 8.2 MB/s | 1.4 MB 00:00 2024-02-17T12:48:37.121 INFO:teuthology.orchestra.run.smithi160.stdout:(9/198): ceph-mds-19.0.0-1515.g6822c7b5.el9.x86 9.8 MB/s | 2.1 MB 00:00 2024-02-17T12:48:37.213 INFO:teuthology.orchestra.run.smithi136.stdout:(3/198): ceph-common-19.0.0-1515.g6822c7b5.el9. 3.5 MB/s | 20 MB 00:05 2024-02-17T12:48:41.154 INFO:teuthology.orchestra.run.smithi136.stdout:(4/198): ceph-debuginfo-19.0.0-1515.g6822c7b5.e 5.7 MB/s | 22 MB 00:03 2024-02-17T12:48:41.404 INFO:teuthology.orchestra.run.smithi136.stdout:(5/198): ceph-fuse-19.0.0-1515.g6822c7b5.el9.x8 3.5 MB/s | 885 kB 00:00 2024-02-17T12:48:42.621 INFO:teuthology.orchestra.run.smithi136.stdout:(6/198): ceph-fuse-debuginfo-19.0.0-1515.g6822c 4.9 MB/s | 5.9 MB 00:01 2024-02-17T12:48:42.664 INFO:teuthology.orchestra.run.smithi136.stdout:(7/198): ceph-immutable-object-cache-19.0.0-151 3.4 MB/s | 146 kB 00:00 2024-02-17T12:48:42.854 INFO:teuthology.orchestra.run.smithi136.stdout:(8/198): ceph-immutable-object-cache-debuginfo- 7.5 MB/s | 1.4 MB 00:00 2024-02-17T12:48:42.954 INFO:teuthology.orchestra.run.smithi160.stdout:(10/198): ceph-mds-debuginfo-19.0.0-1515.g6822c 8.2 MB/s | 48 MB 00:05 2024-02-17T12:48:43.196 INFO:teuthology.orchestra.run.smithi136.stdout:(9/198): ceph-mds-19.0.0-1515.g6822c7b5.el9.x86 6.2 MB/s | 2.1 MB 00:00 2024-02-17T12:48:43.246 INFO:teuthology.orchestra.run.smithi160.stdout:(11/198): ceph-mgr-19.0.0-1515.g6822c7b5.el9.x8 5.1 MB/s | 1.5 MB 00:00 2024-02-17T12:48:46.113 INFO:teuthology.orchestra.run.smithi160.stdout:(12/198): ceph-mgr-debuginfo-19.0.0-1515.g6822c 6.9 MB/s | 20 MB 00:02 2024-02-17T12:48:46.913 INFO:teuthology.orchestra.run.smithi160.stdout:(13/198): ceph-mon-19.0.0-1515.g6822c7b5.el9.x8 5.9 MB/s | 4.7 MB 00:00 2024-02-17T12:48:48.221 INFO:teuthology.orchestra.run.smithi160.stdout:(14/198): ceph-base-debuginfo-19.0.0-1515.g6822 3.9 MB/s | 68 MB 00:17 2024-02-17T12:48:52.412 INFO:teuthology.orchestra.run.smithi136.stdout:(10/198): ceph-mds-debuginfo-19.0.0-1515.g6822c 5.2 MB/s | 48 MB 00:09 2024-02-17T12:48:52.670 INFO:teuthology.orchestra.run.smithi136.stdout:(11/198): ceph-mgr-19.0.0-1515.g6822c7b5.el9.x8 5.8 MB/s | 1.5 MB 00:00 2024-02-17T12:48:52.780 INFO:teuthology.orchestra.run.smithi160.stdout:(15/198): ceph-osd-19.0.0-1515.g6822c7b5.el9.x8 3.7 MB/s | 17 MB 00:04 2024-02-17T12:48:55.787 INFO:teuthology.orchestra.run.smithi136.stdout:(12/198): ceph-mgr-debuginfo-19.0.0-1515.g6822c 6.3 MB/s | 20 MB 00:03 2024-02-17T12:48:56.570 INFO:teuthology.orchestra.run.smithi136.stdout:(13/198): ceph-mon-19.0.0-1515.g6822c7b5.el9.x8 6.0 MB/s | 4.7 MB 00:00 2024-02-17T12:48:58.454 INFO:teuthology.orchestra.run.smithi136.stdout:(14/198): ceph-base-debuginfo-19.0.0-1515.g6822 2.5 MB/s | 68 MB 00:27 2024-02-17T12:49:00.663 INFO:teuthology.orchestra.run.smithi160.stdout:(16/198): ceph-mon-debuginfo-19.0.0-1515.g6822c 7.2 MB/s | 98 MB 00:13 2024-02-17T12:49:02.146 INFO:teuthology.orchestra.run.smithi160.stdout:(17/198): ceph-radosgw-19.0.0-1515.g6822c7b5.el 6.6 MB/s | 9.8 MB 00:01 2024-02-17T12:49:02.211 INFO:teuthology.orchestra.run.smithi136.stdout:(15/198): ceph-osd-19.0.0-1515.g6822c7b5.el9.x8 4.5 MB/s | 17 MB 00:03 2024-02-17T12:49:09.144 INFO:teuthology.orchestra.run.smithi136.stdout:(16/198): ceph-mon-debuginfo-19.0.0-1515.g6822c 7.8 MB/s | 98 MB 00:12 2024-02-17T12:49:11.144 INFO:teuthology.orchestra.run.smithi136.stdout:(17/198): ceph-radosgw-19.0.0-1515.g6822c7b5.el 4.9 MB/s | 9.8 MB 00:01 2024-02-17T12:49:34.118 INFO:teuthology.orchestra.run.smithi160.stdout:(18/198): ceph-radosgw-debuginfo-19.0.0-1515.g6 5.5 MB/s | 176 MB 00:31 2024-02-17T12:49:34.235 INFO:teuthology.orchestra.run.smithi160.stdout:(19/198): ceph-selinux-19.0.0-1515.g6822c7b5.el 216 kB/s | 25 kB 00:00 2024-02-17T12:49:40.122 INFO:teuthology.orchestra.run.smithi136.stdout:(18/198): ceph-radosgw-debuginfo-19.0.0-1515.g6 6.1 MB/s | 176 MB 00:28 2024-02-17T12:49:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:(19/198): ceph-selinux-19.0.0-1515.g6822c7b5.el 160 kB/s | 25 kB 00:00 2024-02-17T12:49:46.025 INFO:teuthology.orchestra.run.smithi160.stdout:(20/198): ceph-test-19.0.0-1515.g6822c7b5.el9.x 4.0 MB/s | 47 MB 00:11 2024-02-17T12:49:52.270 INFO:teuthology.orchestra.run.smithi136.stdout:(20/198): ceph-test-19.0.0-1515.g6822c7b5.el9.x 3.9 MB/s | 47 MB 00:11 2024-02-17T12:50:51.626 INFO:teuthology.orchestra.run.smithi160.stdout:(21/198): ceph-osd-debuginfo-19.0.0-1515.g6822c 2.4 MB/s | 287 MB 01:58 2024-02-17T12:50:51.901 INFO:teuthology.orchestra.run.smithi160.stdout:(22/198): cephfs-mirror-19.0.0-1515.g6822c7b5.e 792 kB/s | 217 kB 00:00 2024-02-17T12:50:52.026 INFO:teuthology.orchestra.run.smithi160.stdout:(23/198): cephfs-shell-19.0.0-1515.g6822c7b5.el 217 kB/s | 27 kB 00:00 2024-02-17T12:50:52.134 INFO:teuthology.orchestra.run.smithi160.stdout:(24/198): libcephfs-devel-19.0.0-1515.g6822c7b5 288 kB/s | 31 kB 00:00 2024-02-17T12:50:52.409 INFO:teuthology.orchestra.run.smithi160.stdout:(25/198): libcephfs2-19.0.0-1515.g6822c7b5.el9. 2.6 MB/s | 743 kB 00:00 2024-02-17T12:50:53.451 INFO:teuthology.orchestra.run.smithi160.stdout:(26/198): libcephfs2-debuginfo-19.0.0-1515.g682 5.1 MB/s | 5.4 MB 00:01 2024-02-17T12:50:53.802 INFO:teuthology.orchestra.run.smithi160.stdout:(27/198): libcephsqlite-19.0.0-1515.g6822c7b5.e 467 kB/s | 163 kB 00:00 2024-02-17T12:50:54.152 INFO:teuthology.orchestra.run.smithi160.stdout:(28/198): librados-devel-19.0.0-1515.g6822c7b5. 362 kB/s | 127 kB 00:00 2024-02-17T12:50:54.561 INFO:teuthology.orchestra.run.smithi160.stdout:(29/198): librados-devel-debuginfo-19.0.0-1515. 266 kB/s | 109 kB 00:00 2024-02-17T12:50:56.250 INFO:teuthology.orchestra.run.smithi136.stdout:(21/198): ceph-osd-debuginfo-19.0.0-1515.g6822c 2.5 MB/s | 287 MB 01:54 2024-02-17T12:50:56.692 INFO:teuthology.orchestra.run.smithi136.stdout:(22/198): cephfs-mirror-19.0.0-1515.g6822c7b5.e 492 kB/s | 217 kB 00:00 2024-02-17T12:50:56.808 INFO:teuthology.orchestra.run.smithi136.stdout:(23/198): cephfs-shell-19.0.0-1515.g6822c7b5.el 232 kB/s | 27 kB 00:00 2024-02-17T12:50:56.927 INFO:teuthology.orchestra.run.smithi136.stdout:(24/198): libcephfs-devel-19.0.0-1515.g6822c7b5 267 kB/s | 31 kB 00:00 2024-02-17T12:50:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:(25/198): libcephfs2-19.0.0-1515.g6822c7b5.el9. 2.6 MB/s | 743 kB 00:00 2024-02-17T12:50:58.676 INFO:teuthology.orchestra.run.smithi136.stdout:(26/198): libcephfs2-debuginfo-19.0.0-1515.g682 3.6 MB/s | 5.4 MB 00:01 2024-02-17T12:50:58.776 INFO:teuthology.orchestra.run.smithi136.stdout:(27/198): libcephsqlite-19.0.0-1515.g6822c7b5.e 1.6 MB/s | 163 kB 00:00 2024-02-17T12:50:58.876 INFO:teuthology.orchestra.run.smithi136.stdout:(28/198): librados-devel-19.0.0-1515.g6822c7b5. 1.2 MB/s | 127 kB 00:00 2024-02-17T12:50:58.968 INFO:teuthology.orchestra.run.smithi136.stdout:(29/198): librados-devel-debuginfo-19.0.0-1515. 1.2 MB/s | 109 kB 00:00 2024-02-17T12:51:01.668 INFO:teuthology.orchestra.run.smithi160.stdout:(30/198): librados2-debuginfo-19.0.0-1515.g6822 6.2 MB/s | 44 MB 00:07 2024-02-17T12:51:01.985 INFO:teuthology.orchestra.run.smithi160.stdout:(31/198): libradosstriper1-19.0.0-1515.g6822c7b 1.5 MB/s | 499 kB 00:00 2024-02-17T12:51:10.250 INFO:teuthology.orchestra.run.smithi136.stdout:(30/198): librados2-debuginfo-19.0.0-1515.g6822 3.9 MB/s | 44 MB 00:11 2024-02-17T12:51:10.700 INFO:teuthology.orchestra.run.smithi136.stdout:(31/198): libradosstriper1-19.0.0-1515.g6822c7b 1.1 MB/s | 499 kB 00:00 2024-02-17T12:51:14.126 INFO:teuthology.orchestra.run.smithi160.stdout:(32/198): ceph-test-debuginfo-19.0.0-1515.g6822 7.6 MB/s | 673 MB 01:28 2024-02-17T12:51:14.843 INFO:teuthology.orchestra.run.smithi160.stdout:(33/198): librgw2-19.0.0-1515.g6822c7b5.el9.x86 7.1 MB/s | 5.1 MB 00:00 2024-02-17T12:51:14.885 INFO:teuthology.orchestra.run.smithi160.stdout:(34/198): python3-ceph-argparse-19.0.0-1515.g68 1.1 MB/s | 45 kB 00:00 2024-02-17T12:51:14.935 INFO:teuthology.orchestra.run.smithi160.stdout:(35/198): python3-ceph-common-19.0.0-1515.g6822 2.6 MB/s | 131 kB 00:00 2024-02-17T12:51:14.985 INFO:teuthology.orchestra.run.smithi160.stdout:(36/198): python3-cephfs-19.0.0-1515.g6822c7b5. 3.2 MB/s | 162 kB 00:00 2024-02-17T12:51:15.102 INFO:teuthology.orchestra.run.smithi160.stdout:(37/198): python3-cephfs-debuginfo-19.0.0-1515. 5.1 MB/s | 615 kB 00:00 2024-02-17T12:51:15.169 INFO:teuthology.orchestra.run.smithi160.stdout:(38/198): python3-rados-19.0.0-1515.g6822c7b5.e 4.7 MB/s | 321 kB 00:00 2024-02-17T12:51:15.527 INFO:teuthology.orchestra.run.smithi160.stdout:(39/198): python3-rados-debuginfo-19.0.0-1515.g 2.1 MB/s | 771 kB 00:00 2024-02-17T12:51:15.628 INFO:teuthology.orchestra.run.smithi160.stdout:(40/198): python3-rbd-19.0.0-1515.g6822c7b5.el9 2.9 MB/s | 298 kB 00:00 2024-02-17T12:51:15.853 INFO:teuthology.orchestra.run.smithi160.stdout:(41/198): python3-rbd-debuginfo-19.0.0-1515.g68 5.0 MB/s | 1.1 MB 00:00 2024-02-17T12:51:15.911 INFO:teuthology.orchestra.run.smithi160.stdout:(42/198): python3-rgw-19.0.0-1515.g6822c7b5.el9 1.7 MB/s | 99 kB 00:00 2024-02-17T12:51:16.020 INFO:teuthology.orchestra.run.smithi160.stdout:(43/198): python3-rgw-debuginfo-19.0.0-1515.g68 3.0 MB/s | 337 kB 00:00 2024-02-17T12:51:16.070 INFO:teuthology.orchestra.run.smithi160.stdout:(44/198): rbd-fuse-19.0.0-1515.g6822c7b5.el9.x8 1.7 MB/s | 85 kB 00:00 2024-02-17T12:51:16.171 INFO:teuthology.orchestra.run.smithi160.stdout:(45/198): rbd-fuse-debuginfo-19.0.0-1515.g6822c 5.0 MB/s | 509 kB 00:00 2024-02-17T12:51:16.829 INFO:teuthology.orchestra.run.smithi160.stdout:(46/198): librbd1-debuginfo-19.0.0-1515.g6822c7 3.5 MB/s | 52 MB 00:14 2024-02-17T12:51:16.905 INFO:teuthology.orchestra.run.smithi160.stdout:(47/198): rbd-mirror-19.0.0-1515.g6822c7b5.el9. 4.2 MB/s | 3.1 MB 00:00 2024-02-17T12:51:17.221 INFO:teuthology.orchestra.run.smithi160.stdout:(48/198): rbd-nbd-19.0.0-1515.g6822c7b5.el9.x86 539 kB/s | 171 kB 00:00 2024-02-17T12:51:17.424 INFO:teuthology.orchestra.run.smithi160.stdout:(49/198): rbd-nbd-debuginfo-19.0.0-1515.g6822c7 6.3 MB/s | 1.3 MB 00:00 2024-02-17T12:51:17.614 INFO:teuthology.orchestra.run.smithi160.stdout:(50/198): ceph-grafana-dashboards-19.0.0-1515.g 164 kB/s | 31 kB 00:00 2024-02-17T12:51:17.664 INFO:teuthology.orchestra.run.smithi160.stdout:(51/198): ceph-mgr-cephadm-19.0.0-1515.g6822c7b 2.7 MB/s | 138 kB 00:00 2024-02-17T12:51:17.889 INFO:teuthology.orchestra.run.smithi160.stdout:(52/198): ceph-mgr-dashboard-19.0.0-1515.g6822c 7.9 MB/s | 1.8 MB 00:00 2024-02-17T12:51:19.264 INFO:teuthology.orchestra.run.smithi160.stdout:(53/198): ceph-mgr-diskprediction-local-19.0.0- 5.4 MB/s | 7.4 MB 00:01 2024-02-17T12:51:19.373 INFO:teuthology.orchestra.run.smithi160.stdout:(54/198): ceph-mgr-modules-core-19.0.0-1515.g68 2.2 MB/s | 247 kB 00:00 2024-02-17T12:51:19.423 INFO:teuthology.orchestra.run.smithi160.stdout:(55/198): ceph-mgr-rook-19.0.0-1515.g6822c7b5.e 1.0 MB/s | 52 kB 00:00 2024-02-17T12:51:19.473 INFO:teuthology.orchestra.run.smithi160.stdout:(56/198): ceph-prometheus-alerts-19.0.0-1515.g6 307 kB/s | 15 kB 00:00 2024-02-17T12:51:19.532 INFO:teuthology.orchestra.run.smithi160.stdout:(57/198): ceph-volume-19.0.0-1515.g6822c7b5.el9 4.4 MB/s | 264 kB 00:00 2024-02-17T12:51:19.632 INFO:teuthology.orchestra.run.smithi160.stdout:(58/198): cephadm-19.0.0-1515.g6822c7b5.el9.noa 7.3 MB/s | 748 kB 00:00 2024-02-17T12:51:19.666 INFO:teuthology.orchestra.run.smithi160.stdout:(59/198): cephfs-top-19.0.0-1515.g6822c7b5.el9. 549 kB/s | 18 kB 00:00 2024-02-17T12:51:19.999 INFO:teuthology.orchestra.run.smithi160.stdout:(60/198): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 662 kB 00:00 2024-02-17T12:51:20.141 INFO:teuthology.orchestra.run.smithi160.stdout:(61/198): bison-3.7.4-5.el9.x86_64.rpm 6.3 MB/s | 920 kB 00:00 2024-02-17T12:51:20.200 INFO:teuthology.orchestra.run.smithi160.stdout:(62/198): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-02-17T12:51:20.250 INFO:teuthology.orchestra.run.smithi160.stdout:(63/198): elfutils-libelf-devel-0.190-2.el9.x86 409 kB/s | 20 kB 00:00 2024-02-17T12:51:20.309 INFO:teuthology.orchestra.run.smithi160.stdout:(64/198): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2024-02-17T12:51:20.359 INFO:teuthology.orchestra.run.smithi160.stdout:(65/198): flexiblas-3.0.4-8.el9.x86_64.rpm 632 kB/s | 32 kB 00:00 2024-02-17T12:51:20.551 INFO:teuthology.orchestra.run.smithi160.stdout:(66/198): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-02-17T12:51:20.602 INFO:teuthology.orchestra.run.smithi160.stdout:(67/198): flexiblas-openblas-openmp-3.0.4-8.el9 344 kB/s | 17 kB 00:00 2024-02-17T12:51:20.651 INFO:teuthology.orchestra.run.smithi160.stdout:(68/198): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2024-02-17T12:51:20.711 INFO:teuthology.orchestra.run.smithi160.stdout:(69/198): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-02-17T12:51:20.769 INFO:teuthology.orchestra.run.smithi160.stdout:(70/198): librabbitmq-0.11.0-7.el9.x86_64.rpm 760 kB/s | 44 kB 00:00 2024-02-17T12:51:20.853 INFO:teuthology.orchestra.run.smithi160.stdout:(71/198): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-02-17T12:51:20.919 INFO:teuthology.orchestra.run.smithi160.stdout:(72/198): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2024-02-17T12:51:20.961 INFO:teuthology.orchestra.run.smithi160.stdout:(73/198): libuuid-devel-2.37.4-18.el9.x86_64.rp 586 kB/s | 24 kB 00:00 2024-02-17T12:51:21.003 INFO:teuthology.orchestra.run.smithi160.stdout:(74/198): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-02-17T12:51:21.062 INFO:teuthology.orchestra.run.smithi160.stdout:(75/198): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-02-17T12:51:21.129 INFO:teuthology.orchestra.run.smithi160.stdout:(76/198): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2024-02-17T12:51:21.196 INFO:teuthology.orchestra.run.smithi160.stdout:(77/198): openblas-0.3.21-2.el9.x86_64.rpm 512 kB/s | 34 kB 00:00 2024-02-17T12:51:21.363 INFO:teuthology.orchestra.run.smithi160.stdout:(78/198): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-02-17T12:51:21.555 INFO:teuthology.orchestra.run.smithi160.stdout:(79/198): openssl-devel-3.0.7-25.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-02-17T12:51:21.655 INFO:teuthology.orchestra.run.smithi160.stdout:(80/198): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-02-17T12:51:21.730 INFO:teuthology.orchestra.run.smithi160.stdout:(81/198): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-17T12:51:21.772 INFO:teuthology.orchestra.run.smithi160.stdout:(82/198): postgresql-private-libs-13.11-1.el9.x 3.1 MB/s | 134 kB 00:00 2024-02-17T12:51:21.840 INFO:teuthology.orchestra.run.smithi136.stdout:(32/198): ceph-test-debuginfo-19.0.0-1515.g6822 7.5 MB/s | 673 MB 01:29 2024-02-17T12:51:21.948 INFO:teuthology.orchestra.run.smithi160.stdout:(83/198): postgresql-server-13.11-1.el9.x86_64. 32 MB/s | 5.7 MB 00:00 2024-02-17T12:51:22.015 INFO:teuthology.orchestra.run.smithi160.stdout:(84/198): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-02-17T12:51:22.048 INFO:teuthology.orchestra.run.smithi160.stdout:(85/198): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-02-17T12:51:22.241 INFO:teuthology.orchestra.run.smithi160.stdout:(86/198): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-02-17T12:51:22.282 INFO:teuthology.orchestra.run.smithi160.stdout:(87/198): python3-jinja2-2.11.3-5.el9.noarch.rp 5.3 MB/s | 227 kB 00:00 2024-02-17T12:51:22.324 INFO:teuthology.orchestra.run.smithi160.stdout:(88/198): python3-jsonpatch-1.21-16.el9.noarch. 585 kB/s | 24 kB 00:00 2024-02-17T12:51:22.365 INFO:teuthology.orchestra.run.smithi136.stdout:(33/198): librgw2-19.0.0-1515.g6822c7b5.el9.x86 9.7 MB/s | 5.1 MB 00:00 2024-02-17T12:51:22.374 INFO:teuthology.orchestra.run.smithi160.stdout:(89/198): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2024-02-17T12:51:22.398 INFO:teuthology.orchestra.run.smithi136.stdout:(34/198): python3-ceph-argparse-19.0.0-1515.g68 1.3 MB/s | 45 kB 00:00 2024-02-17T12:51:22.416 INFO:teuthology.orchestra.run.smithi160.stdout:(90/198): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-02-17T12:51:22.448 INFO:teuthology.orchestra.run.smithi136.stdout:(35/198): python3-ceph-common-19.0.0-1515.g6822 2.6 MB/s | 131 kB 00:00 2024-02-17T12:51:22.458 INFO:teuthology.orchestra.run.smithi160.stdout:(91/198): python3-markupsafe-1.1.1-12.el9.x86_6 756 kB/s | 32 kB 00:00 2024-02-17T12:51:22.499 INFO:teuthology.orchestra.run.smithi136.stdout:(36/198): python3-cephfs-19.0.0-1515.g6822c7b5. 3.2 MB/s | 162 kB 00:00 2024-02-17T12:51:22.575 INFO:teuthology.orchestra.run.smithi136.stdout:(37/198): python3-cephfs-debuginfo-19.0.0-1515. 8.0 MB/s | 615 kB 00:00 2024-02-17T12:51:22.608 INFO:teuthology.orchestra.run.smithi160.stdout:(92/198): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-02-17T12:51:22.641 INFO:teuthology.orchestra.run.smithi136.stdout:(38/198): python3-rados-19.0.0-1515.g6822c7b5.e 4.7 MB/s | 321 kB 00:00 2024-02-17T12:51:22.650 INFO:teuthology.orchestra.run.smithi160.stdout:(93/198): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-02-17T12:51:22.692 INFO:teuthology.orchestra.run.smithi160.stdout:(94/198): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2024-02-17T12:51:22.734 INFO:teuthology.orchestra.run.smithi160.stdout:(95/198): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-02-17T12:51:22.741 INFO:teuthology.orchestra.run.smithi136.stdout:(39/198): python3-rados-debuginfo-19.0.0-1515.g 7.5 MB/s | 771 kB 00:00 2024-02-17T12:51:22.768 INFO:teuthology.orchestra.run.smithi160.stdout:(96/198): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-02-17T12:51:22.800 INFO:teuthology.orchestra.run.smithi136.stdout:(40/198): python3-rbd-19.0.0-1515.g6822c7b5.el9 5.0 MB/s | 298 kB 00:00 2024-02-17T12:51:22.810 INFO:teuthology.orchestra.run.smithi160.stdout:(97/198): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-02-17T12:51:22.852 INFO:teuthology.orchestra.run.smithi160.stdout:(98/198): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2024-02-17T12:51:22.936 INFO:teuthology.orchestra.run.smithi160.stdout:(99/198): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-02-17T12:51:22.977 INFO:teuthology.orchestra.run.smithi160.stdout:(100/198): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-02-17T12:51:22.983 INFO:teuthology.orchestra.run.smithi136.stdout:(41/198): python3-rbd-debuginfo-19.0.0-1515.g68 6.1 MB/s | 1.1 MB 00:00 2024-02-17T12:51:23.019 INFO:teuthology.orchestra.run.smithi160.stdout:(101/198): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 43 kB 00:00 2024-02-17T12:51:23.059 INFO:teuthology.orchestra.run.smithi136.stdout:(42/198): python3-rgw-19.0.0-1515.g6822c7b5.el9 1.3 MB/s | 99 kB 00:00 2024-02-17T12:51:23.184 INFO:teuthology.orchestra.run.smithi136.stdout:(43/198): python3-rgw-debuginfo-19.0.0-1515.g68 2.6 MB/s | 337 kB 00:00 2024-02-17T12:51:23.234 INFO:teuthology.orchestra.run.smithi136.stdout:(44/198): rbd-fuse-19.0.0-1515.g6822c7b5.el9.x8 1.7 MB/s | 85 kB 00:00 2024-02-17T12:51:23.318 INFO:teuthology.orchestra.run.smithi136.stdout:(45/198): rbd-fuse-debuginfo-19.0.0-1515.g6822c 6.0 MB/s | 509 kB 00:00 2024-02-17T12:51:23.504 INFO:teuthology.orchestra.run.smithi160.stdout:(102/198): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-02-17T12:51:23.536 INFO:teuthology.orchestra.run.smithi160.stdout:(103/198): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-02-17T12:51:23.579 INFO:teuthology.orchestra.run.smithi160.stdout:(104/198): python3-wcwidth-0.2.5-8.el9.noarch.r 985 kB/s | 41 kB 00:00 2024-02-17T12:51:23.620 INFO:teuthology.orchestra.run.smithi160.stdout:(105/198): qatlib-23.11.0-1.el9.x86_64.rpm 5.1 MB/s | 215 kB 00:00 2024-02-17T12:51:23.626 INFO:teuthology.orchestra.run.smithi136.stdout:(46/198): rbd-mirror-19.0.0-1515.g6822c7b5.el9. 10 MB/s | 3.1 MB 00:00 2024-02-17T12:51:23.654 INFO:teuthology.orchestra.run.smithi160.stdout:(106/198): qatlib-service-23.11.0-1.el9.x86_64. 1.0 MB/s | 34 kB 00:00 2024-02-17T12:51:23.696 INFO:teuthology.orchestra.run.smithi160.stdout:(107/198): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-02-17T12:51:23.746 INFO:teuthology.orchestra.run.smithi160.stdout:(108/198): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-02-17T12:51:23.788 INFO:teuthology.orchestra.run.smithi160.stdout:(109/198): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-02-17T12:51:23.830 INFO:teuthology.orchestra.run.smithi160.stdout:(110/198): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.0 MB/s | 87 kB 00:00 2024-02-17T12:51:23.864 INFO:teuthology.orchestra.run.smithi160.stdout:(111/198): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-02-17T12:51:23.897 INFO:teuthology.orchestra.run.smithi160.stdout:(112/198): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-17T12:51:23.939 INFO:teuthology.orchestra.run.smithi160.stdout:(113/198): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-02-17T12:51:23.990 INFO:teuthology.orchestra.run.smithi160.stdout:(114/198): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-17T12:51:24.048 INFO:teuthology.orchestra.run.smithi160.stdout:(115/198): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-02-17T12:51:24.090 INFO:teuthology.orchestra.run.smithi160.stdout:(116/198): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 194 kB 00:00 2024-02-17T12:51:24.132 INFO:teuthology.orchestra.run.smithi160.stdout:(117/198): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-02-17T12:51:24.191 INFO:teuthology.orchestra.run.smithi160.stdout:(118/198): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-02-17T12:51:24.258 INFO:teuthology.orchestra.run.smithi160.stdout:(119/198): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2024-02-17T12:51:24.291 INFO:teuthology.orchestra.run.smithi160.stdout:(120/198): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-02-17T12:51:24.333 INFO:teuthology.orchestra.run.smithi160.stdout:(121/198): python3-pycparser-2.20-6.el9.noarch. 2.9 MB/s | 124 kB 00:00 2024-02-17T12:51:24.376 INFO:teuthology.orchestra.run.smithi160.stdout:(122/198): python3-requests-2.25.1-8.el9.noarch 2.7 MB/s | 113 kB 00:00 2024-02-17T12:51:24.417 INFO:teuthology.orchestra.run.smithi160.stdout:(123/198): python3-urllib3-1.26.5-5.el9.noarch. 4.4 MB/s | 187 kB 00:00 2024-02-17T12:51:24.926 INFO:teuthology.orchestra.run.smithi160.stdout:(124/198): python3-devel-3.9.17-2.el9.x86_64.rp 483 kB/s | 245 kB 00:00 2024-02-17T12:51:25.051 INFO:teuthology.orchestra.run.smithi160.stdout:(125/198): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-02-17T12:51:25.318 INFO:teuthology.orchestra.run.smithi160.stdout:(126/198): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-02-17T12:51:25.777 INFO:teuthology.orchestra.run.smithi160.stdout:(127/198): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-02-17T12:51:25.868 INFO:teuthology.orchestra.run.smithi160.stdout:(128/198): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-02-17T12:51:25.944 INFO:teuthology.orchestra.run.smithi160.stdout:(129/198): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-02-17T12:51:26.244 INFO:teuthology.orchestra.run.smithi160.stdout:(130/198): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-02-17T12:51:26.319 INFO:teuthology.orchestra.run.smithi160.stdout:(131/198): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-02-17T12:51:26.395 INFO:teuthology.orchestra.run.smithi160.stdout:(132/198): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-02-17T12:51:26.470 INFO:teuthology.orchestra.run.smithi160.stdout:(133/198): libunwind-1.6.2-1.el9.x86_64.rpm 898 kB/s | 67 kB 00:00 2024-02-17T12:51:26.545 INFO:teuthology.orchestra.run.smithi160.stdout:(134/198): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-02-17T12:51:26.629 INFO:teuthology.orchestra.run.smithi160.stdout:(135/198): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-02-17T12:51:26.721 INFO:teuthology.orchestra.run.smithi160.stdout:(136/198): python3-asyncssh-2.13.2-4.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-02-17T12:51:26.796 INFO:teuthology.orchestra.run.smithi160.stdout:(137/198): python3-bcrypt-3.2.2-1.el9.x86_64.rp 580 kB/s | 43 kB 00:00 2024-02-17T12:51:27.243 INFO:teuthology.orchestra.run.smithi136.stdout:(47/198): librbd1-debuginfo-19.0.0-1515.g6822c7 3.1 MB/s | 52 MB 00:16 2024-02-17T12:51:27.351 INFO:teuthology.orchestra.run.smithi136.stdout:(48/198): rbd-nbd-19.0.0-1515.g6822c7b5.el9.x86 1.5 MB/s | 171 kB 00:00 2024-02-17T12:51:27.785 INFO:teuthology.orchestra.run.smithi136.stdout:(49/198): rbd-mirror-debuginfo-19.0.0-1515.g682 12 MB/s | 52 MB 00:04 2024-02-17T12:51:27.835 INFO:teuthology.orchestra.run.smithi136.stdout:(50/198): rbd-nbd-debuginfo-19.0.0-1515.g6822c7 2.6 MB/s | 1.3 MB 00:00 2024-02-17T12:51:27.860 INFO:teuthology.orchestra.run.smithi136.stdout:(51/198): ceph-grafana-dashboards-19.0.0-1515.g 420 kB/s | 31 kB 00:00 2024-02-17T12:51:27.902 INFO:teuthology.orchestra.run.smithi136.stdout:(52/198): ceph-mgr-cephadm-19.0.0-1515.g6822c7b 2.0 MB/s | 138 kB 00:00 2024-02-17T12:51:28.013 INFO:teuthology.orchestra.run.smithi160.stdout:(138/198): ceph-common-debuginfo-19.0.0-1515.g6 2.4 MB/s | 416 MB 02:56 2024-02-17T12:51:28.038 INFO:teuthology.orchestra.run.smithi160.stdout:(139/198): python3-cachetools-4.2.4-1.el9.noarc 26 kB/s | 32 kB 00:01 2024-02-17T12:51:28.053 INFO:teuthology.orchestra.run.smithi136.stdout:(53/198): ceph-mgr-dashboard-19.0.0-1515.g6822c 9.3 MB/s | 1.8 MB 00:00 2024-02-17T12:51:28.113 INFO:teuthology.orchestra.run.smithi160.stdout:(140/198): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-02-17T12:51:28.120 INFO:teuthology.orchestra.run.smithi136.stdout:(54/198): ceph-mgr-modules-core-19.0.0-1515.g68 3.6 MB/s | 247 kB 00:00 2024-02-17T12:51:28.162 INFO:teuthology.orchestra.run.smithi136.stdout:(55/198): ceph-mgr-rook-19.0.0-1515.g6822c7b5.e 1.2 MB/s | 52 kB 00:00 2024-02-17T12:51:28.189 INFO:teuthology.orchestra.run.smithi160.stdout:(141/198): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-02-17T12:51:28.204 INFO:teuthology.orchestra.run.smithi136.stdout:(56/198): ceph-prometheus-alerts-19.0.0-1515.g6 367 kB/s | 15 kB 00:00 2024-02-17T12:51:28.214 INFO:teuthology.orchestra.run.smithi160.stdout:(142/198): python3-certifi-2021.10.8-2.el9.noar 75 kB/s | 15 kB 00:00 2024-02-17T12:51:28.254 INFO:teuthology.orchestra.run.smithi136.stdout:(57/198): ceph-volume-19.0.0-1515.g6822c7b5.el9 5.2 MB/s | 264 kB 00:00 2024-02-17T12:51:28.264 INFO:teuthology.orchestra.run.smithi160.stdout:(143/198): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-02-17T12:51:28.338 INFO:teuthology.orchestra.run.smithi136.stdout:(58/198): cephadm-19.0.0-1515.g6822c7b5.el9.noa 8.8 MB/s | 748 kB 00:00 2024-02-17T12:51:28.339 INFO:teuthology.orchestra.run.smithi160.stdout:(144/198): python3-google-auth-2.27.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-02-17T12:51:28.357 INFO:teuthology.orchestra.run.smithi160.stdout:(145/198): python3-colorama-0.4.4-12.el9.noarch 248 kB/s | 35 kB 00:00 2024-02-17T12:51:28.388 INFO:teuthology.orchestra.run.smithi136.stdout:(59/198): cephfs-top-19.0.0-1515.g6822c7b5.el9. 365 kB/s | 18 kB 00:00 2024-02-17T12:51:28.516 INFO:teuthology.orchestra.run.smithi160.stdout:(146/198): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-02-17T12:51:28.540 INFO:teuthology.orchestra.run.smithi160.stdout:(147/198): python3-grpcio-tools-1.46.7-10.el9.x 786 kB/s | 144 kB 00:00 2024-02-17T12:51:28.590 INFO:teuthology.orchestra.run.smithi160.stdout:(148/198): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-02-17T12:51:28.616 INFO:teuthology.orchestra.run.smithi160.stdout:(149/198): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-02-17T12:51:28.666 INFO:teuthology.orchestra.run.smithi160.stdout:(150/198): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-02-17T12:51:28.691 INFO:teuthology.orchestra.run.smithi160.stdout:(151/198): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-02-17T12:51:28.741 INFO:teuthology.orchestra.run.smithi160.stdout:(152/198): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-02-17T12:51:28.817 INFO:teuthology.orchestra.run.smithi160.stdout:(153/198): python3-logutils-0.3.5-21.el9.noarch 617 kB/s | 46 kB 00:00 2024-02-17T12:51:28.892 INFO:teuthology.orchestra.run.smithi160.stdout:(154/198): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-02-17T12:51:28.943 INFO:teuthology.orchestra.run.smithi160.stdout:(155/198): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-02-17T12:51:28.968 INFO:teuthology.orchestra.run.smithi160.stdout:(156/198): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-02-17T12:51:29.026 INFO:teuthology.orchestra.run.smithi160.stdout:(157/198): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-02-17T12:51:29.051 INFO:teuthology.orchestra.run.smithi160.stdout:(158/198): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-02-17T12:51:29.102 INFO:teuthology.orchestra.run.smithi160.stdout:(159/198): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-02-17T12:51:29.127 INFO:teuthology.orchestra.run.smithi160.stdout:(160/198): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-02-17T12:51:29.178 INFO:teuthology.orchestra.run.smithi160.stdout:(161/198): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-02-17T12:51:29.203 INFO:teuthology.orchestra.run.smithi160.stdout:(162/198): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-02-17T12:51:29.253 INFO:teuthology.orchestra.run.smithi160.stdout:(163/198): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-02-17T12:51:29.279 INFO:teuthology.orchestra.run.smithi160.stdout:(164/198): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-02-17T12:51:29.328 INFO:teuthology.orchestra.run.smithi160.stdout:(165/198): python3-typing-extensions-4.4.0-2.el 679 kB/s | 51 kB 00:00 2024-02-17T12:51:29.354 INFO:teuthology.orchestra.run.smithi160.stdout:(166/198): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-02-17T12:51:29.404 INFO:teuthology.orchestra.run.smithi160.stdout:(167/198): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-02-17T12:51:29.479 INFO:teuthology.orchestra.run.smithi160.stdout:(168/198): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-02-17T12:51:29.554 INFO:teuthology.orchestra.run.smithi160.stdout:(169/198): python3-werkzeug-2.0.3-3.el9.1.noarc 2.1 MB/s | 427 kB 00:00 2024-02-17T12:51:29.580 INFO:teuthology.orchestra.run.smithi160.stdout:(170/198): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-02-17T12:51:29.738 INFO:teuthology.orchestra.run.smithi136.stdout:(60/198): ceph-common-debuginfo-19.0.0-1515.g68 2.4 MB/s | 416 MB 02:53 2024-02-17T12:51:29.796 INFO:teuthology.orchestra.run.smithi136.stdout:(61/198): automake-1.16.2-8.el9.noarch.rpm 470 kB/s | 662 kB 00:01 2024-02-17T12:51:29.838 INFO:teuthology.orchestra.run.smithi160.stdout:(171/198): thrift-0.15.0-2.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-02-17T12:51:29.855 INFO:teuthology.orchestra.run.smithi136.stdout:(62/198): bison-3.7.4-5.el9.x86_64.rpm 7.8 MB/s | 920 kB 00:00 2024-02-17T12:51:29.880 INFO:teuthology.orchestra.run.smithi136.stdout:(63/198): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2024-02-17T12:51:29.905 INFO:teuthology.orchestra.run.smithi136.stdout:(64/198): elfutils-libelf-devel-0.190-2.el9.x86 409 kB/s | 20 kB 00:00 2024-02-17T12:51:29.947 INFO:teuthology.orchestra.run.smithi136.stdout:(65/198): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2024-02-17T12:51:29.956 INFO:teuthology.orchestra.run.smithi160.stdout:(172/198): librados2-19.0.0-1515.g6822c7b5.el9. 9.0 MB/s | 3.4 MB 00:00 2024-02-17T12:51:29.972 INFO:teuthology.orchestra.run.smithi136.stdout:(66/198): flexiblas-3.0.4-8.el9.x86_64.rpm 477 kB/s | 32 kB 00:00 2024-02-17T12:51:29.998 INFO:teuthology.orchestra.run.smithi160.stdout:(173/198): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-02-17T12:51:30.116 INFO:teuthology.orchestra.run.smithi160.stdout:(174/198): NetworkManager-1.45.91-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-02-17T12:51:30.123 INFO:teuthology.orchestra.run.smithi136.stdout:(67/198): ceph-mgr-diskprediction-local-19.0.0- 3.3 MB/s | 7.4 MB 00:02 2024-02-17T12:51:30.148 INFO:teuthology.orchestra.run.smithi136.stdout:(68/198): flexiblas-openblas-openmp-3.0.4-8.el9 98 kB/s | 17 kB 00:00 2024-02-17T12:51:30.213 INFO:teuthology.orchestra.run.smithi160.stdout:(175/198): NetworkManager-libnm-1.45.91-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-02-17T12:51:30.215 INFO:teuthology.orchestra.run.smithi136.stdout:(69/198): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-02-17T12:51:30.234 INFO:teuthology.orchestra.run.smithi136.stdout:(70/198): libaio-devel-0.3.111-13.el9.x86_64.rp 94 kB/s | 10 kB 00:00 2024-02-17T12:51:30.255 INFO:teuthology.orchestra.run.smithi160.stdout:(176/198): NetworkManager-team-1.45.91-1.el9.x8 995 kB/s | 41 kB 00:00 2024-02-17T12:51:30.257 INFO:teuthology.orchestra.run.smithi136.stdout:(71/198): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2024-02-17T12:51:30.283 INFO:teuthology.orchestra.run.smithi136.stdout:(72/198): librabbitmq-0.11.0-7.el9.x86_64.rpm 887 kB/s | 44 kB 00:00 2024-02-17T12:51:30.306 INFO:teuthology.orchestra.run.smithi160.stdout:(177/198): NetworkManager-tui-1.45.91-1.el9.x86 4.8 MB/s | 246 kB 00:00 2024-02-17T12:51:30.316 INFO:teuthology.orchestra.run.smithi136.stdout:(73/198): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-02-17T12:51:30.352 INFO:teuthology.orchestra.run.smithi136.stdout:(74/198): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 578 kB 00:00 2024-02-17T12:51:30.364 INFO:teuthology.orchestra.run.smithi160.stdout:(178/198): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2024-02-17T12:51:30.366 INFO:teuthology.orchestra.run.smithi136.stdout:(75/198): libuuid-devel-2.37.4-18.el9.x86_64.rp 294 kB/s | 24 kB 00:00 2024-02-17T12:51:30.388 INFO:teuthology.orchestra.run.smithi136.stdout:(76/198): libzstd-devel-1.5.1-2.el9.x86_64.rpm 702 kB/s | 46 kB 00:00 2024-02-17T12:51:30.406 INFO:teuthology.orchestra.run.smithi160.stdout:(179/198): elfutils-debuginfod-client-0.190-2.e 848 kB/s | 35 kB 00:00 2024-02-17T12:51:30.417 INFO:teuthology.orchestra.run.smithi136.stdout:(77/198): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-02-17T12:51:30.442 INFO:teuthology.orchestra.run.smithi136.stdout:(78/198): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-02-17T12:51:30.450 INFO:teuthology.orchestra.run.smithi160.stdout:(180/198): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-02-17T12:51:30.459 INFO:teuthology.orchestra.run.smithi136.stdout:(79/198): openblas-0.3.21-2.el9.x86_64.rpm 455 kB/s | 34 kB 00:00 2024-02-17T12:51:30.498 INFO:teuthology.orchestra.run.smithi160.stdout:(181/198): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-02-17T12:51:30.632 INFO:teuthology.orchestra.run.smithi160.stdout:(182/198): iproute-6.7.0-2.el9.x86_64.rpm 5.9 MB/s | 802 kB 00:00 2024-02-17T12:51:30.690 INFO:teuthology.orchestra.run.smithi160.stdout:(183/198): iproute-tc-6.7.0-2.el9.x86_64.rpm 7.3 MB/s | 433 kB 00:00 2024-02-17T12:51:30.701 INFO:teuthology.orchestra.run.smithi136.stdout:(80/198): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-02-17T12:51:30.732 INFO:teuthology.orchestra.run.smithi160.stdout:(184/198): libacl-2.3.1-4.el9.x86_64.rpm 527 kB/s | 22 kB 00:00 2024-02-17T12:51:30.766 INFO:teuthology.orchestra.run.smithi160.stdout:(185/198): libblkid-2.37.4-18.el9.x86_64.rpm 3.1 MB/s | 107 kB 00:00 2024-02-17T12:51:30.784 INFO:teuthology.orchestra.run.smithi136.stdout:(81/198): postgresql-13.11-1.el9.x86_64.rpm 4.7 MB/s | 1.5 MB 00:00 2024-02-17T12:51:30.808 INFO:teuthology.orchestra.run.smithi160.stdout:(186/198): libfdisk-2.37.4-18.el9.x86_64.rpm 3.6 MB/s | 154 kB 00:00 2024-02-17T12:51:30.843 INFO:teuthology.orchestra.run.smithi136.stdout:(82/198): openssl-devel-3.0.7-25.el9.x86_64.rpm 7.8 MB/s | 3.0 MB 00:00 2024-02-17T12:51:30.849 INFO:teuthology.orchestra.run.smithi160.stdout:(187/198): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 135 kB 00:00 2024-02-17T12:51:30.885 INFO:teuthology.orchestra.run.smithi136.stdout:(83/198): postgresql-contrib-13.11-1.el9.x86_64 4.3 MB/s | 811 kB 00:00 2024-02-17T12:51:30.892 INFO:teuthology.orchestra.run.smithi160.stdout:(188/198): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 63 kB 00:00 2024-02-17T12:51:30.910 INFO:teuthology.orchestra.run.smithi136.stdout:(84/198): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2024-02-17T12:51:30.942 INFO:teuthology.orchestra.run.smithi160.stdout:(189/198): libuuid-2.37.4-18.el9.x86_64.rpm 550 kB/s | 28 kB 00:00 2024-02-17T12:51:31.043 INFO:teuthology.orchestra.run.smithi160.stdout:(190/198): openssl-3.0.7-25.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-02-17T12:51:31.102 INFO:teuthology.orchestra.run.smithi136.stdout:(85/198): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-02-17T12:51:31.136 INFO:teuthology.orchestra.run.smithi136.stdout:(86/198): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-02-17T12:51:31.159 INFO:teuthology.orchestra.run.smithi160.stdout:(191/198): openssl-libs-3.0.7-25.el9.x86_64.rpm 18 MB/s | 2.1 MB 00:00 2024-02-17T12:51:31.161 INFO:teuthology.orchestra.run.smithi136.stdout:(87/198): python3-attrs-20.3.0-7.el9.noarch.rpm 312 kB/s | 78 kB 00:00 2024-02-17T12:51:31.293 INFO:teuthology.orchestra.run.smithi160.stdout:(192/198): util-linux-2.37.4-18.el9.x86_64.rpm 16 MB/s | 2.2 MB 00:00 2024-02-17T12:51:31.343 INFO:teuthology.orchestra.run.smithi160.stdout:(193/198): util-linux-core-2.37.4-18.el9.x86_64 8.6 MB/s | 438 kB 00:00 2024-02-17T12:51:31.352 INFO:teuthology.orchestra.run.smithi136.stdout:(88/198): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-02-17T12:51:31.377 INFO:teuthology.orchestra.run.smithi160.stdout:(194/198): util-linux-user-2.37.4-18.el9.x86_64 908 kB/s | 30 kB 00:00 2024-02-17T12:51:31.378 INFO:teuthology.orchestra.run.smithi136.stdout:(89/198): python3-jinja2-2.11.3-5.el9.noarch.rp 1.0 MB/s | 227 kB 00:00 2024-02-17T12:51:31.403 INFO:teuthology.orchestra.run.smithi136.stdout:(90/198): python3-jsonpatch-1.21-16.el9.noarch. 102 kB/s | 24 kB 00:00 2024-02-17T12:51:31.427 INFO:teuthology.orchestra.run.smithi160.stdout:(195/198): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-02-17T12:51:31.428 INFO:teuthology.orchestra.run.smithi136.stdout:(91/198): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2024-02-17T12:51:31.454 INFO:teuthology.orchestra.run.smithi136.stdout:(92/198): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2024-02-17T12:51:31.470 INFO:teuthology.orchestra.run.smithi136.stdout:(93/198): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-02-17T12:51:31.519 INFO:teuthology.orchestra.run.smithi160.stdout:(196/198): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-02-17T12:51:31.619 INFO:teuthology.orchestra.run.smithi160.stdout:(197/198): librbd1-19.0.0-1515.g6822c7b5.el9.x8 1.8 MB/s | 3.1 MB 00:01 2024-02-17T12:51:31.629 INFO:teuthology.orchestra.run.smithi136.stdout:(94/198): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2024-02-17T12:51:31.654 INFO:teuthology.orchestra.run.smithi136.stdout:(95/198): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2024-02-17T12:51:31.679 INFO:teuthology.orchestra.run.smithi136.stdout:(96/198): python3-oauthlib-3.1.1-5.el9.noarch.r 839 kB/s | 174 kB 00:00 2024-02-17T12:51:31.705 INFO:teuthology.orchestra.run.smithi136.stdout:(97/198): python3-packaging-20.9-5.el9.noarch.r 921 kB/s | 69 kB 00:00 2024-02-17T12:51:31.730 INFO:teuthology.orchestra.run.smithi136.stdout:(98/198): python3-prettytable-0.7.2-27.el9.noar 827 kB/s | 41 kB 00:00 2024-02-17T12:51:31.755 INFO:teuthology.orchestra.run.smithi136.stdout:(99/198): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-02-17T12:51:31.780 INFO:teuthology.orchestra.run.smithi136.stdout:(100/198): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 132 kB 00:00 2024-02-17T12:51:31.822 INFO:teuthology.orchestra.run.smithi136.stdout:(101/198): python3-pytz-2021.1-5.el9.noarch.rpm 711 kB/s | 47 kB 00:00 2024-02-17T12:51:31.847 INFO:teuthology.orchestra.run.smithi136.stdout:(102/198): python3-pyasn1-modules-0.4.8-6.el9.n 2.2 MB/s | 211 kB 00:00 2024-02-17T12:51:31.872 INFO:teuthology.orchestra.run.smithi136.stdout:(103/198): python3-requests-oauthlib-1.3.0-12.e 466 kB/s | 43 kB 00:00 2024-02-17T12:51:32.073 INFO:teuthology.orchestra.run.smithi136.stdout:(104/198): python3-toml-0.10.2-6.el9.noarch.rpm 195 kB/s | 39 kB 00:00 2024-02-17T12:51:32.098 INFO:teuthology.orchestra.run.smithi136.stdout:(105/198): python3-wcwidth-0.2.5-8.el9.noarch.r 184 kB/s | 41 kB 00:00 2024-02-17T12:51:32.365 INFO:teuthology.orchestra.run.smithi136.stdout:(106/198): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-02-17T12:51:32.390 INFO:teuthology.orchestra.run.smithi136.stdout:(107/198): qatlib-23.11.0-1.el9.x86_64.rpm 680 kB/s | 215 kB 00:00 2024-02-17T12:51:32.415 INFO:teuthology.orchestra.run.smithi136.stdout:(108/198): qatlib-service-23.11.0-1.el9.x86_64. 107 kB/s | 34 kB 00:00 2024-02-17T12:51:32.440 INFO:teuthology.orchestra.run.smithi136.stdout:(109/198): qatzip-libs-1.1.2-2.el9.x86_64.rpm 583 kB/s | 43 kB 00:00 2024-02-17T12:51:32.466 INFO:teuthology.orchestra.run.smithi136.stdout:(110/198): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-02-17T12:51:32.499 INFO:teuthology.orchestra.run.smithi136.stdout:(111/198): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-02-17T12:51:32.524 INFO:teuthology.orchestra.run.smithi136.stdout:(112/198): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 87 kB 00:00 2024-02-17T12:51:32.550 INFO:teuthology.orchestra.run.smithi136.stdout:(113/198): xmlstarlet-1.6.1-20.el9.x86_64.rpm 754 kB/s | 63 kB 00:00 2024-02-17T12:51:32.575 INFO:teuthology.orchestra.run.smithi136.stdout:(114/198): zlib-devel-1.2.11-40.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2024-02-17T12:51:32.600 INFO:teuthology.orchestra.run.smithi136.stdout:(115/198): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-02-17T12:51:32.625 INFO:teuthology.orchestra.run.smithi136.stdout:(116/198): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-02-17T12:51:32.659 INFO:teuthology.orchestra.run.smithi136.stdout:(117/198): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-02-17T12:51:32.684 INFO:teuthology.orchestra.run.smithi136.stdout:(118/198): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 194 kB 00:00 2024-02-17T12:51:32.710 INFO:teuthology.orchestra.run.smithi136.stdout:(119/198): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2024-02-17T12:51:32.734 INFO:teuthology.orchestra.run.smithi136.stdout:(120/198): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-02-17T12:51:32.760 INFO:teuthology.orchestra.run.smithi136.stdout:(121/198): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-02-17T12:51:32.802 INFO:teuthology.orchestra.run.smithi136.stdout:(122/198): python3-cryptography-36.0.1-4.el9.x8 12 MB/s | 1.1 MB 00:00 2024-02-17T12:51:32.819 INFO:teuthology.orchestra.run.smithi136.stdout:(123/198): python3-pycparser-2.20-6.el9.noarch. 1.4 MB/s | 124 kB 00:00 2024-02-17T12:51:32.844 INFO:teuthology.orchestra.run.smithi136.stdout:(124/198): python3-requests-2.25.1-8.el9.noarch 1.4 MB/s | 113 kB 00:00 2024-02-17T12:51:32.869 INFO:teuthology.orchestra.run.smithi136.stdout:(125/198): python3-urllib3-1.26.5-5.el9.noarch. 2.8 MB/s | 187 kB 00:00 2024-02-17T12:51:32.971 INFO:teuthology.orchestra.run.smithi136.stdout:(126/198): lua-devel-5.4.4-4.el9.x86_64.rpm 179 kB/s | 22 kB 00:00 2024-02-17T12:51:33.120 INFO:teuthology.orchestra.run.smithi136.stdout:(127/198): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-02-17T12:51:33.145 INFO:teuthology.orchestra.run.smithi136.stdout:(128/198): abseil-cpp-20211102.0-3.el9.x86_64.r 3.1 MB/s | 548 kB 00:00 2024-02-17T12:51:33.187 INFO:teuthology.orchestra.run.smithi136.stdout:(129/198): grpc-data-1.46.7-10.el9.noarch.rpm 467 kB/s | 19 kB 00:00 2024-02-17T12:51:33.355 INFO:teuthology.orchestra.run.smithi136.stdout:(130/198): libarrow-9.0.0-10.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-02-17T12:51:33.379 INFO:teuthology.orchestra.run.smithi136.stdout:(131/198): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-02-17T12:51:33.404 INFO:teuthology.orchestra.run.smithi136.stdout:(132/198): libarrow-doc-9.0.0-10.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-02-17T12:51:33.446 INFO:teuthology.orchestra.run.smithi136.stdout:(133/198): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-02-17T12:51:33.463 INFO:teuthology.orchestra.run.smithi136.stdout:(134/198): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-02-17T12:51:33.489 INFO:teuthology.orchestra.run.smithi136.stdout:(135/198): python3-devel-3.9.17-2.el9.x86_64.rp 381 kB/s | 245 kB 00:00 2024-02-17T12:51:33.514 INFO:teuthology.orchestra.run.smithi136.stdout:(136/198): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-02-17T12:51:33.556 INFO:teuthology.orchestra.run.smithi136.stdout:(137/198): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2024-02-17T12:51:33.581 INFO:teuthology.orchestra.run.smithi136.stdout:(138/198): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-02-17T12:51:33.606 INFO:teuthology.orchestra.run.smithi136.stdout:(139/198): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-02-17T12:51:33.631 INFO:teuthology.orchestra.run.smithi136.stdout:(140/198): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-02-17T12:51:33.665 INFO:teuthology.orchestra.run.smithi136.stdout:(141/198): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-02-17T12:51:33.740 INFO:teuthology.orchestra.run.smithi136.stdout:(142/198): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-02-17T12:51:33.766 INFO:teuthology.orchestra.run.smithi136.stdout:(143/198): python3-asyncssh-2.13.2-4.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-02-17T12:51:33.793 INFO:teuthology.orchestra.run.smithi136.stdout:(144/198): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-02-17T12:51:33.816 INFO:teuthology.orchestra.run.smithi136.stdout:(145/198): python3-colorama-0.4.4-12.el9.noarch 468 kB/s | 35 kB 00:00 2024-02-17T12:51:33.875 INFO:teuthology.orchestra.run.smithi136.stdout:(146/198): python3-google-auth-2.27.0-1.el9.noa 1.8 MB/s | 203 kB 00:00 2024-02-17T12:51:33.900 INFO:teuthology.orchestra.run.smithi136.stdout:(147/198): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-02-17T12:51:33.925 INFO:teuthology.orchestra.run.smithi136.stdout:(148/198): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-02-17T12:51:33.950 INFO:teuthology.orchestra.run.smithi136.stdout:(149/198): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-02-17T12:51:33.976 INFO:teuthology.orchestra.run.smithi136.stdout:(150/198): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-02-17T12:51:34.001 INFO:teuthology.orchestra.run.smithi136.stdout:(151/198): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-02-17T12:51:34.026 INFO:teuthology.orchestra.run.smithi136.stdout:(152/198): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-02-17T12:51:34.060 INFO:teuthology.orchestra.run.smithi136.stdout:(153/198): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-02-17T12:51:34.094 INFO:teuthology.orchestra.run.smithi136.stdout:(154/198): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-02-17T12:51:34.119 INFO:teuthology.orchestra.run.smithi136.stdout:(155/198): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-02-17T12:51:34.144 INFO:teuthology.orchestra.run.smithi136.stdout:(156/198): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-02-17T12:51:34.169 INFO:teuthology.orchestra.run.smithi136.stdout:(157/198): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-02-17T12:51:34.194 INFO:teuthology.orchestra.run.smithi136.stdout:(158/198): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-02-17T12:51:34.220 INFO:teuthology.orchestra.run.smithi136.stdout:(159/198): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-02-17T12:51:34.237 INFO:teuthology.orchestra.run.smithi136.stdout:(160/198): python3-pyperclip-1.8.2-2.el9.noarch 673 kB/s | 28 kB 00:00 2024-02-17T12:51:34.254 INFO:teuthology.orchestra.run.smithi136.stdout:(161/198): python3-repoze-lru-0.7-16.el9.noarch 920 kB/s | 31 kB 00:00 2024-02-17T12:51:34.296 INFO:teuthology.orchestra.run.smithi136.stdout:(162/198): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-02-17T12:51:34.313 INFO:teuthology.orchestra.run.smithi136.stdout:(163/198): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-02-17T12:51:34.342 INFO:teuthology.orchestra.run.smithi136.stdout:(164/198): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-02-17T12:51:34.355 INFO:teuthology.orchestra.run.smithi136.stdout:(165/198): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-02-17T12:51:34.372 INFO:teuthology.orchestra.run.smithi136.stdout:(166/198): python3-typing-extensions-4.4.0-2.el 868 kB/s | 51 kB 00:00 2024-02-17T12:51:34.397 INFO:teuthology.orchestra.run.smithi136.stdout:(167/198): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-02-17T12:51:34.422 INFO:teuthology.orchestra.run.smithi136.stdout:(168/198): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-17T12:51:34.447 INFO:teuthology.orchestra.run.smithi136.stdout:(169/198): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-02-17T12:51:34.481 INFO:teuthology.orchestra.run.smithi136.stdout:(170/198): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-02-17T12:51:34.506 INFO:teuthology.orchestra.run.smithi136.stdout:(171/198): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-02-17T12:51:34.557 INFO:teuthology.orchestra.run.smithi136.stdout:(172/198): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-02-17T12:51:34.599 INFO:teuthology.orchestra.run.smithi136.stdout:(173/198): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-02-17T12:51:34.715 INFO:teuthology.orchestra.run.smithi136.stdout:(174/198): NetworkManager-1.45.91-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-02-17T12:51:34.858 INFO:teuthology.orchestra.run.smithi136.stdout:(175/198): NetworkManager-libnm-1.45.91-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-02-17T12:51:34.908 INFO:teuthology.orchestra.run.smithi136.stdout:(176/198): librados2-19.0.0-1515.g6822c7b5.el9. 7.9 MB/s | 3.4 MB 00:00 2024-02-17T12:51:34.933 INFO:teuthology.orchestra.run.smithi136.stdout:(177/198): NetworkManager-team-1.45.91-1.el9.x8 550 kB/s | 41 kB 00:00 2024-02-17T12:51:34.958 INFO:teuthology.orchestra.run.smithi136.stdout:(178/198): NetworkManager-tui-1.45.91-1.el9.x86 4.8 MB/s | 246 kB 00:00 2024-02-17T12:51:34.983 INFO:teuthology.orchestra.run.smithi136.stdout:(179/198): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-02-17T12:51:35.009 INFO:teuthology.orchestra.run.smithi136.stdout:(180/198): elfutils-debuginfod-client-0.190-2.e 706 kB/s | 35 kB 00:00 2024-02-17T12:51:35.034 INFO:teuthology.orchestra.run.smithi136.stdout:(181/198): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-02-17T12:51:35.059 INFO:teuthology.orchestra.run.smithi136.stdout:(182/198): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-02-17T12:51:35.101 INFO:teuthology.orchestra.run.smithi136.stdout:(183/198): iproute-6.7.0-2.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-02-17T12:51:35.151 INFO:teuthology.orchestra.run.smithi136.stdout:(184/198): iproute-tc-6.7.0-2.el9.x86_64.rpm 4.6 MB/s | 433 kB 00:00 2024-02-17T12:51:35.177 INFO:teuthology.orchestra.run.smithi136.stdout:(185/198): libacl-2.3.1-4.el9.x86_64.rpm 293 kB/s | 22 kB 00:00 2024-02-17T12:51:35.202 INFO:teuthology.orchestra.run.smithi136.stdout:(186/198): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-17T12:51:35.227 INFO:teuthology.orchestra.run.smithi136.stdout:(187/198): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-17T12:51:35.253 INFO:teuthology.orchestra.run.smithi136.stdout:(188/198): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-17T12:51:35.278 INFO:teuthology.orchestra.run.smithi136.stdout:(189/198): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-17T12:51:35.303 INFO:teuthology.orchestra.run.smithi136.stdout:(190/198): libuuid-2.37.4-18.el9.x86_64.rpm 552 kB/s | 28 kB 00:00 2024-02-17T12:51:35.362 INFO:teuthology.orchestra.run.smithi136.stdout:(191/198): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-02-17T12:51:35.445 INFO:teuthology.orchestra.run.smithi136.stdout:(192/198): openssl-libs-3.0.7-25.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2024-02-17T12:51:35.512 INFO:teuthology.orchestra.run.smithi136.stdout:(193/198): util-linux-2.37.4-18.el9.x86_64.rpm 15 MB/s | 2.2 MB 00:00 2024-02-17T12:51:35.546 INFO:teuthology.orchestra.run.smithi136.stdout:(194/198): util-linux-core-2.37.4-18.el9.x86_64 4.4 MB/s | 438 kB 00:00 2024-02-17T12:51:35.571 INFO:teuthology.orchestra.run.smithi136.stdout:(195/198): util-linux-user-2.37.4-18.el9.x86_64 521 kB/s | 30 kB 00:00 2024-02-17T12:51:35.596 INFO:teuthology.orchestra.run.smithi136.stdout:(196/198): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-02-17T12:51:35.647 INFO:teuthology.orchestra.run.smithi136.stdout:(197/198): librbd1-19.0.0-1515.g6822c7b5.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-02-17T12:51:35.688 INFO:teuthology.orchestra.run.smithi136.stdout:(198/198): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.1 MB/s | 1.1 MB 00:00 2024-02-17T12:51:35.692 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-02-17T12:51:35.692 INFO:teuthology.orchestra.run.smithi136.stdout:Total 12 MB/s | 2.1 GB 03:04 2024-02-17T12:51:35.742 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-02-17T12:51:36.049 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-02-17T12:51:36.049 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-02-17T12:51:40.877 INFO:teuthology.orchestra.run.smithi160.stdout:(198/198): rbd-mirror-debuginfo-19.0.0-1515.g68 2.1 MB/s | 52 MB 00:24 2024-02-17T12:51:40.884 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-02-17T12:51:40.884 INFO:teuthology.orchestra.run.smithi160.stdout:Total 12 MB/s | 2.1 GB 03:10 2024-02-17T12:51:40.927 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-02-17T12:51:41.235 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-02-17T12:51:41.235 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-02-17T12:51:49.531 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-02-17T12:51:49.532 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-02-17T12:51:54.711 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-02-17T12:51:54.711 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-02-17T12:52:08.598 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-02-17T12:52:11.098 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/224 2024-02-17T12:52:11.135 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_6 2/224 2024-02-17T12:52:11.188 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/224 2024-02-17T12:52:11.217 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/224 2024-02-17T12:52:11.240 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/224 2024-02-17T12:52:11.288 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 5/224 2024-02-17T12:52:11.326 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/224 2024-02-17T12:52:11.380 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/224 2024-02-17T12:52:11.413 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 8/224 2024-02-17T12:52:11.438 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 9/224 2024-02-17T12:52:11.491 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/224 2024-02-17T12:52:11.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 11/224 2024-02-17T12:52:11.873 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/224 2024-02-17T12:52:11.994 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/224 2024-02-17T12:52:12.024 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/224 2024-02-17T12:52:12.115 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/224 2024-02-17T12:52:12.154 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 14/224 2024-02-17T12:52:12.311 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 15/224 2024-02-17T12:52:12.365 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/224 2024-02-17T12:52:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/224 2024-02-17T12:52:12.483 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/224 2024-02-17T12:52:12.506 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 18/224 2024-02-17T12:52:12.579 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 18/224 2024-02-17T12:52:12.627 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/224 2024-02-17T12:52:12.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-02-17T12:52:12.664 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-02-17T12:52:12.864 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/224 2024-02-17T12:52:12.889 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/224 2024-02-17T12:52:12.920 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/224 2024-02-17T12:52:13.076 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/224 2024-02-17T12:52:13.233 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 24/224 2024-02-17T12:52:13.291 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 24/224 2024-02-17T12:52:13.394 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 25/224 2024-02-17T12:52:13.460 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 25/224 2024-02-17T12:52:13.713 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 25/224 2024-02-17T12:52:13.718 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-02-17T12:52:13.844 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/224 2024-02-17T12:52:13.935 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/224 2024-02-17T12:52:13.969 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/224 2024-02-17T12:52:14.041 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/224 2024-02-17T12:52:14.096 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/224 2024-02-17T12:52:14.127 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/224 2024-02-17T12:52:14.162 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/224 2024-02-17T12:52:14.202 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/224 2024-02-17T12:52:14.257 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/224 2024-02-17T12:52:14.293 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/224 2024-02-17T12:52:14.337 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/224 2024-02-17T12:52:14.369 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/224 2024-02-17T12:52:14.398 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/224 2024-02-17T12:52:14.468 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/224 2024-02-17T12:52:14.502 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 40/224 2024-02-17T12:52:14.546 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 41/224 2024-02-17T12:52:14.574 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 42/224 2024-02-17T12:52:14.645 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/224 2024-02-17T12:52:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/224 2024-02-17T12:52:14.771 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/224 2024-02-17T12:52:14.947 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/224 2024-02-17T12:52:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/224 2024-02-17T12:52:15.671 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/224 2024-02-17T12:52:15.747 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/224 2024-02-17T12:52:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/224 2024-02-17T12:52:15.991 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-02-17T12:52:15.999 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-02-17T12:52:16.029 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/224 2024-02-17T12:52:16.068 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 53/224 2024-02-17T12:52:16.112 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/224 2024-02-17T12:52:16.211 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 55/224 2024-02-17T12:52:16.230 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/224 2024-02-17T12:52:16.261 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_6 2/224 2024-02-17T12:52:16.293 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 56/224 2024-02-17T12:52:16.295 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/224 2024-02-17T12:52:16.341 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/224 2024-02-17T12:52:16.369 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/224 2024-02-17T12:52:16.437 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 5/224 2024-02-17T12:52:16.475 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/224 2024-02-17T12:52:16.539 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/224 2024-02-17T12:52:16.559 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 57/224 2024-02-17T12:52:16.579 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 8/224 2024-02-17T12:52:16.604 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 9/224 2024-02-17T12:52:16.657 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/224 2024-02-17T12:52:16.761 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 58/224 2024-02-17T12:52:16.845 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 59/224 2024-02-17T12:52:16.889 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 60/224 2024-02-17T12:52:16.992 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 11/224 2024-02-17T12:52:17.031 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 61/224 2024-02-17T12:52:17.063 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/224 2024-02-17T12:52:17.076 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 62/224 2024-02-17T12:52:17.130 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 63/224 2024-02-17T12:52:17.168 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/224 2024-02-17T12:52:17.196 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/224 2024-02-17T12:52:17.197 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/224 2024-02-17T12:52:17.227 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 65/224 2024-02-17T12:52:17.255 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 66/224 2024-02-17T12:52:17.288 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/224 2024-02-17T12:52:17.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 67/224 2024-02-17T12:52:17.321 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 14/224 2024-02-17T12:52:17.329 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 68/224 2024-02-17T12:52:17.373 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 69/224 2024-02-17T12:52:17.415 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 70/224 2024-02-17T12:52:17.486 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 15/224 2024-02-17T12:52:17.542 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/224 2024-02-17T12:52:17.547 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 71/224 2024-02-17T12:52:17.568 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/224 2024-02-17T12:52:17.587 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 72/224 2024-02-17T12:52:17.618 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 73/224 2024-02-17T12:52:17.660 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 74/224 2024-02-17T12:52:17.662 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/224 2024-02-17T12:52:17.685 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 18/224 2024-02-17T12:52:17.750 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 18/224 2024-02-17T12:52:17.755 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 75/224 2024-02-17T12:52:17.781 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/224 2024-02-17T12:52:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 76/224 2024-02-17T12:52:17.811 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-02-17T12:52:17.827 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/224 2024-02-17T12:52:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/224 2024-02-17T12:52:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 78/224 2024-02-17T12:52:17.884 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 79/224 2024-02-17T12:52:17.975 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/224 2024-02-17T12:52:17.978 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/224 2024-02-17T12:52:18.010 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/224 2024-02-17T12:52:18.049 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/224 2024-02-17T12:52:18.102 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 81/224 2024-02-17T12:52:18.209 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/224 2024-02-17T12:52:18.219 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/224 2024-02-17T12:52:18.251 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 83/224 2024-02-17T12:52:18.299 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 84/224 2024-02-17T12:52:18.351 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 24/224 2024-02-17T12:52:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 85/224 2024-02-17T12:52:18.394 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 24/224 2024-02-17T12:52:18.487 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 25/224 2024-02-17T12:52:18.545 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 86/224 2024-02-17T12:52:18.556 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 25/224 2024-02-17T12:52:18.589 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 87/224 2024-02-17T12:52:18.723 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 88/224 2024-02-17T12:52:18.762 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 89/224 2024-02-17T12:52:18.777 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 25/224 2024-02-17T12:52:18.796 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 90/224 2024-02-17T12:52:18.827 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 91/224 2024-02-17T12:52:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-16.el9.x86_64 92/224 2024-02-17T12:52:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-15.el9.x86_64 93/224 2024-02-17T12:52:18.887 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/224 2024-02-17T12:52:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 94/224 2024-02-17T12:52:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/224 2024-02-17T12:52:18.986 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 96/224 2024-02-17T12:52:18.988 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/224 2024-02-17T12:52:19.018 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/224 2024-02-17T12:52:19.020 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/224 2024-02-17T12:52:19.048 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 98/224 2024-02-17T12:52:19.079 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/224 2024-02-17T12:52:19.124 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 99/224 2024-02-17T12:52:19.132 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/224 2024-02-17T12:52:19.158 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 100/224 2024-02-17T12:52:19.164 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/224 2024-02-17T12:52:19.189 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 101/224 2024-02-17T12:52:19.199 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/224 2024-02-17T12:52:19.223 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/224 2024-02-17T12:52:19.239 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/224 2024-02-17T12:52:19.257 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/224 2024-02-17T12:52:19.303 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/224 2024-02-17T12:52:19.338 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/224 2024-02-17T12:52:19.344 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/224 2024-02-17T12:52:19.382 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/224 2024-02-17T12:52:19.415 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/224 2024-02-17T12:52:19.427 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/224 2024-02-17T12:52:19.442 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/224 2024-02-17T12:52:19.483 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 106/224 2024-02-17T12:52:19.511 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/224 2024-02-17T12:52:19.520 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 107/224 2024-02-17T12:52:19.547 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 40/224 2024-02-17T12:52:19.567 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 108/224 2024-02-17T12:52:19.591 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 41/224 2024-02-17T12:52:19.620 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 42/224 2024-02-17T12:52:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/224 2024-02-17T12:52:19.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/224 2024-02-17T12:52:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 110/224 2024-02-17T12:52:19.734 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/224 2024-02-17T12:52:19.807 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/224 2024-02-17T12:52:19.939 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/224 2024-02-17T12:52:19.986 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/224 2024-02-17T12:52:20.430 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 111/224 2024-02-17T12:52:20.477 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 112/224 2024-02-17T12:52:20.503 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/224 2024-02-17T12:52:20.511 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 113/224 2024-02-17T12:52:20.560 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 114/224 2024-02-17T12:52:20.581 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/224 2024-02-17T12:52:20.648 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 115/224 2024-02-17T12:52:20.664 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/224 2024-02-17T12:52:20.679 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 116/224 2024-02-17T12:52:20.710 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-02-17T12:52:20.718 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/224 2024-02-17T12:52:20.756 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/224 2024-02-17T12:52:20.794 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 53/224 2024-02-17T12:52:20.819 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/224 2024-02-17T12:52:20.857 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.21-2.el9.x86_64 117/224 2024-02-17T12:52:20.885 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 118/224 2024-02-17T12:52:20.919 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 55/224 2024-02-17T12:52:20.955 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 119/224 2024-02-17T12:52:20.978 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 56/224 2024-02-17T12:52:21.206 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 57/224 2024-02-17T12:52:21.372 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 58/224 2024-02-17T12:52:21.454 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 59/224 2024-02-17T12:52:21.498 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 60/224 2024-02-17T12:52:21.587 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 120/224 2024-02-17T12:52:21.630 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 61/224 2024-02-17T12:52:21.676 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 62/224 2024-02-17T12:52:21.689 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 121/224 2024-02-17T12:52:21.730 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 63/224 2024-02-17T12:52:21.803 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/224 2024-02-17T12:52:21.835 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 65/224 2024-02-17T12:52:21.871 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 66/224 2024-02-17T12:52:21.917 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 67/224 2024-02-17T12:52:21.954 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 68/224 2024-02-17T12:52:21.998 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 69/224 2024-02-17T12:52:22.040 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 70/224 2024-02-17T12:52:22.182 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 71/224 2024-02-17T12:52:22.229 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 72/224 2024-02-17T12:52:22.251 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 73/224 2024-02-17T12:52:22.292 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 74/224 2024-02-17T12:52:22.384 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 75/224 2024-02-17T12:52:22.417 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 76/224 2024-02-17T12:52:22.457 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/224 2024-02-17T12:52:22.483 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 78/224 2024-02-17T12:52:22.507 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 79/224 2024-02-17T12:52:22.600 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/224 2024-02-17T12:52:22.724 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 81/224 2024-02-17T12:52:22.822 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/224 2024-02-17T12:52:22.865 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 83/224 2024-02-17T12:52:22.896 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 122/224 2024-02-17T12:52:22.913 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 84/224 2024-02-17T12:52:22.968 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 85/224 2024-02-17T12:52:22.974 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 123/224 2024-02-17T12:52:23.001 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 124/224 2024-02-17T12:52:23.153 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 86/224 2024-02-17T12:52:23.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 87/224 2024-02-17T12:52:23.310 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 125/224 2024-02-17T12:52:23.321 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 88/224 2024-02-17T12:52:23.347 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 126/224 2024-02-17T12:52:23.359 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 89/224 2024-02-17T12:52:23.391 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 90/224 2024-02-17T12:52:23.424 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 91/224 2024-02-17T12:52:23.437 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 126/224 2024-02-17T12:52:23.458 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.6-16.el9.x86_64 92/224 2024-02-17T12:52:23.460 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 127/224 2024-02-17T12:52:23.489 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-15.el9.x86_64 93/224 2024-02-17T12:52:23.497 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 128/224 2024-02-17T12:52:23.517 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 94/224 2024-02-17T12:52:23.551 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/224 2024-02-17T12:52:23.590 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 96/224 2024-02-17T12:52:23.622 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/224 2024-02-17T12:52:23.651 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 98/224 2024-02-17T12:52:23.728 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 99/224 2024-02-17T12:52:23.762 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 100/224 2024-02-17T12:52:23.806 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 101/224 2024-02-17T12:52:23.844 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/224 2024-02-17T12:52:23.880 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/224 2024-02-17T12:52:23.959 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 129/224 2024-02-17T12:52:23.960 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/224 2024-02-17T12:52:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 130/224 2024-02-17T12:52:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 130/224 2024-02-17T12:52:24.041 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 105/224 2024-02-17T12:52:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/224 2024-02-17T12:52:24.086 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 106/224 2024-02-17T12:52:24.117 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 107/224 2024-02-17T12:52:24.164 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 108/224 2024-02-17T12:52:24.260 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/224 2024-02-17T12:52:24.309 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 110/224 2024-02-17T12:52:25.026 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 111/224 2024-02-17T12:52:25.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 112/224 2024-02-17T12:52:25.107 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 113/224 2024-02-17T12:52:25.156 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 114/224 2024-02-17T12:52:25.252 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 115/224 2024-02-17T12:52:25.283 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 116/224 2024-02-17T12:52:25.463 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.21-2.el9.x86_64 117/224 2024-02-17T12:52:25.490 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 118/224 2024-02-17T12:52:25.568 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 119/224 2024-02-17T12:52:26.196 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 120/224 2024-02-17T12:52:26.208 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/224 2024-02-17T12:52:26.249 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/224 2024-02-17T12:52:26.303 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 121/224 2024-02-17T12:52:26.802 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/224 2024-02-17T12:52:26.836 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/224 2024-02-17T12:52:26.926 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/224 2024-02-17T12:52:26.926 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-17T12:52:26.926 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-17T12:52:26.926 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:26.971 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 134/224 2024-02-17T12:52:27.516 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 122/224 2024-02-17T12:52:27.584 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 123/224 2024-02-17T12:52:27.611 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 124/224 2024-02-17T12:52:27.917 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 125/224 2024-02-17T12:52:27.949 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 126/224 2024-02-17T12:52:28.040 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 126/224 2024-02-17T12:52:28.071 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 127/224 2024-02-17T12:52:28.099 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 128/224 2024-02-17T12:52:28.553 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 129/224 2024-02-17T12:52:28.586 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 130/224 2024-02-17T12:52:28.657 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 130/224 2024-02-17T12:52:28.687 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/224 2024-02-17T12:52:30.943 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/224 2024-02-17T12:52:30.975 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/224 2024-02-17T12:52:31.539 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/224 2024-02-17T12:52:31.579 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/224 2024-02-17T12:52:31.668 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/224 2024-02-17T12:52:31.669 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-17T12:52:31.669 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-17T12:52:31.669 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:31.713 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 134/224 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 134/224 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-02-17T12:52:39.829 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:40.003 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 135/224 2024-02-17T12:52:40.018 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 135/224 2024-02-17T12:52:40.018 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:40.018 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-17T12:52:40.018 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:41.490 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/224 2024-02-17T12:52:41.514 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/224 2024-02-17T12:52:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-17T12:52:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T12:52:41.515 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T12:52:41.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:41.724 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/224 2024-02-17T12:52:41.746 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/224 2024-02-17T12:52:41.746 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:41.746 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-17T12:52:41.746 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T12:52:41.746 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T12:52:41.746 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:42.183 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 138/224 2024-02-17T12:52:42.205 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 138/224 2024-02-17T12:52:42.205 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:42.205 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-17T12:52:42.206 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T12:52:42.206 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T12:52:42.206 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:42.301 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 139/224 2024-02-17T12:52:42.754 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 140/224 2024-02-17T12:52:42.783 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 140/224 2024-02-17T12:52:42.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 141/224 2024-02-17T12:52:42.875 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 142/224 2024-02-17T12:52:42.898 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 143/224 2024-02-17T12:52:43.125 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 143/224 2024-02-17T12:52:43.166 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 144/224 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 134/224 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-02-17T12:52:43.816 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:43.975 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 135/224 2024-02-17T12:52:43.990 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 135/224 2024-02-17T12:52:43.990 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:43.991 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-17T12:52:43.991 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:44.130 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 144/224 2024-02-17T12:52:44.175 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 145/224 2024-02-17T12:52:44.274 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 145/224 2024-02-17T12:52:44.431 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 146/224 2024-02-17T12:52:44.462 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 147/224 2024-02-17T12:52:44.485 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 147/224 2024-02-17T12:52:44.485 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:44.485 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-17T12:52:44.485 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T12:52:44.485 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T12:52:44.485 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:44.538 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 148/224 2024-02-17T12:52:44.548 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 148/224 2024-02-17T12:52:44.598 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 149/224 2024-02-17T12:52:45.454 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/224 2024-02-17T12:52:45.478 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/224 2024-02-17T12:52:45.482 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 151/224 2024-02-17T12:52:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/224 2024-02-17T12:52:45.504 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:45.504 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-17T12:52:45.504 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T12:52:45.504 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T12:52:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:45.505 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 151/224 2024-02-17T12:52:45.505 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:45.505 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-17T12:52:45.505 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:52:45.505 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:52:45.505 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:45.550 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 152/224 2024-02-17T12:52:45.571 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1515.g6822c 152/224 2024-02-17T12:52:45.571 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:45.571 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-17T12:52:45.571 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:45.617 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/224 2024-02-17T12:52:45.639 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/224 2024-02-17T12:52:45.639 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:45.639 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-17T12:52:45.639 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:52:45.639 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:52:45.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:45.712 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/224 2024-02-17T12:52:45.734 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/224 2024-02-17T12:52:45.735 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:45.735 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-17T12:52:45.735 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T12:52:45.735 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T12:52:45.735 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:45.951 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 154/224 2024-02-17T12:52:45.973 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 154/224 2024-02-17T12:52:45.973 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:45.973 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-17T12:52:45.973 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T12:52:45.973 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T12:52:45.974 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:52:46.180 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 138/224 2024-02-17T12:52:46.202 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 138/224 2024-02-17T12:52:46.202 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:46.202 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-17T12:52:46.202 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T12:52:46.202 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T12:52:46.202 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:46.298 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 139/224 2024-02-17T12:52:46.666 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 140/224 2024-02-17T12:52:46.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 140/224 2024-02-17T12:52:46.711 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 141/224 2024-02-17T12:52:46.771 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 142/224 2024-02-17T12:52:46.794 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 143/224 2024-02-17T12:52:47.023 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 143/224 2024-02-17T12:52:47.053 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 144/224 2024-02-17T12:52:48.024 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 144/224 2024-02-17T12:52:48.054 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 145/224 2024-02-17T12:52:48.155 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 145/224 2024-02-17T12:52:48.315 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 146/224 2024-02-17T12:52:48.339 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 147/224 2024-02-17T12:52:48.361 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 147/224 2024-02-17T12:52:48.361 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:48.362 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-17T12:52:48.362 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T12:52:48.362 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T12:52:48.362 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:48.407 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 148/224 2024-02-17T12:52:48.417 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 148/224 2024-02-17T12:52:48.457 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 149/224 2024-02-17T12:52:49.326 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/224 2024-02-17T12:52:49.358 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 151/224 2024-02-17T12:52:49.381 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 151/224 2024-02-17T12:52:49.381 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:49.381 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-17T12:52:49.381 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:52:49.381 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:52:49.381 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:49.426 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 152/224 2024-02-17T12:52:49.448 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1515.g6822c 152/224 2024-02-17T12:52:49.448 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:49.448 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-17T12:52:49.448 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:49.501 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/224 2024-02-17T12:52:49.524 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/224 2024-02-17T12:52:49.524 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:49.524 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-17T12:52:49.524 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:52:49.524 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:52:49.524 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:49.827 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 154/224 2024-02-17T12:52:49.850 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 154/224 2024-02-17T12:52:49.850 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T12:52:49.850 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-17T12:52:49.850 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T12:52:49.850 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T12:52:49.850 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:52:50.380 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 155/224 2024-02-17T12:52:50.421 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 156/224 2024-02-17T12:52:50.451 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 157/224 2024-02-17T12:52:50.479 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 158/224 2024-02-17T12:52:50.661 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 159/224 2024-02-17T12:52:50.770 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 160/224 2024-02-17T12:52:50.819 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 161/224 2024-02-17T12:52:50.876 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 162/224 2024-02-17T12:52:50.953 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 163/224 2024-02-17T12:52:51.022 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 164/224 2024-02-17T12:52:51.063 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 165/224 2024-02-17T12:52:51.107 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 166/224 2024-02-17T12:52:51.138 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 167/224 2024-02-17T12:52:51.167 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 168/224 2024-02-17T12:52:51.243 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 169/224 2024-02-17T12:52:51.301 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 170/224 2024-02-17T12:52:51.341 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 171/224 2024-02-17T12:52:51.960 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-02-17T12:52:51.998 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 172/224 2024-02-17T12:52:52.016 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-02-17T12:52:54.298 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 155/224 2024-02-17T12:52:54.339 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 156/224 2024-02-17T12:52:54.370 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 157/224 2024-02-17T12:52:54.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 158/224 2024-02-17T12:52:54.579 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 159/224 2024-02-17T12:52:54.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 160/224 2024-02-17T12:52:54.728 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 161/224 2024-02-17T12:52:54.773 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 162/224 2024-02-17T12:52:54.836 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 163/224 2024-02-17T12:52:54.904 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 164/224 2024-02-17T12:52:54.938 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 165/224 2024-02-17T12:52:54.974 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 166/224 2024-02-17T12:52:55.004 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 167/224 2024-02-17T12:52:55.033 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 168/224 2024-02-17T12:52:55.110 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 169/224 2024-02-17T12:52:55.164 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 170/224 2024-02-17T12:52:55.190 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 171/224 2024-02-17T12:52:55.809 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-02-17T12:52:55.848 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 172/224 2024-02-17T12:52:55.868 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 172/224 2024-02-17T12:52:59.117 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 173/224 2024-02-17T12:53:02.930 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 173/224 2024-02-17T12:53:38.809 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 174/224 2024-02-17T12:53:39.424 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1515.g6822c7b5.el 175/224 2024-02-17T12:53:39.591 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 176/224 2024-02-17T12:53:42.669 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 174/224 2024-02-17T12:53:43.595 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1515.g6822c7b5.el 175/224 2024-02-17T12:53:43.935 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 176/224 2024-02-17T12:53:43.983 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 177/224 2024-02-17T12:53:46.285 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 178/224 2024-02-17T12:53:48.565 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 177/224 2024-02-17T12:53:50.677 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 178/224 2024-02-17T12:53:55.870 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 179/224 2024-02-17T12:54:00.549 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 179/224 2024-02-17T12:54:23.544 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 180/224 2024-02-17T12:54:28.393 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 180/224 2024-02-17T12:54:40.583 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 181/224 2024-02-17T12:54:45.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 181/224 2024-02-17T12:55:47.955 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1515.g6822c7b5.e 182/224 2024-02-17T12:55:48.519 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 183/224 2024-02-17T12:55:48.563 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1515.g6822c7b5.el9 184/224 2024-02-17T12:55:52.578 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1515.g6822c7b5.e 182/224 2024-02-17T12:55:53.191 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 183/224 2024-02-17T12:55:53.230 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1515.g6822c7b5.el9 184/224 2024-02-17T12:55:53.280 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1515.g6822c7b5 185/224 2024-02-17T12:55:57.925 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1515.g6822c7b5 185/224 2024-02-17T12:55:58.890 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados2-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 186/224 2024-02-17T12:55:59.254 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librbd1-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 187/224 2024-02-17T12:55:59.651 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1515.g6822c7b5 188/224 2024-02-17T12:56:00.024 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1515.g6822c7b5. 189/224 2024-02-17T12:56:00.336 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1515.g6822c7b5.el 190/224 2024-02-17T12:56:00.708 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1515.g6822c7b5.el 191/224 2024-02-17T12:56:03.619 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados2-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 186/224 2024-02-17T12:56:04.012 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librbd1-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 187/224 2024-02-17T12:56:04.367 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1515.g6822c7b5 188/224 2024-02-17T12:56:04.795 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1515.g6822c7b5. 189/224 2024-02-17T12:56:05.102 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1515.g6822c7b5.el 190/224 2024-02-17T12:56:05.316 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1515.g6822c7b5.el 191/224 2024-02-17T12:56:06.486 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 192/224 2024-02-17T12:56:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1515.g6822c7b5.el9 193/224 2024-02-17T12:56:07.444 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 194/224 2024-02-17T12:56:07.768 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 195/224 2024-02-17T12:56:08.401 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 196/224 2024-02-17T12:56:09.048 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 197/224 2024-02-17T12:56:09.081 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 198/224 2024-02-17T12:56:09.114 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/224 2024-02-17T12:56:09.156 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 200/224 2024-02-17T12:56:09.182 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 201/224 2024-02-17T12:56:09.183 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-02-17T12:56:09.275 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-02-17T12:56:09.304 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 203/224 2024-02-17T12:56:09.333 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 204/224 2024-02-17T12:56:09.333 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 205/224 2024-02-17T12:56:09.426 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 205/224 2024-02-17T12:56:09.466 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 206/224 2024-02-17T12:56:09.503 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 207/224 2024-02-17T12:56:09.528 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 208/224 2024-02-17T12:56:09.556 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 209/224 2024-02-17T12:56:09.588 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 210/224 2024-02-17T12:56:09.649 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 211/224 2024-02-17T12:56:09.695 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 212/224 2024-02-17T12:56:09.735 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 213/224 2024-02-17T12:56:09.760 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 214/224 2024-02-17T12:56:09.785 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 215/224 2024-02-17T12:56:09.836 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 216/224 2024-02-17T12:56:09.861 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 217/224 2024-02-17T12:56:09.869 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-02-17T12:56:09.869 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-02-17T12:56:10.064 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-02-17T12:56:10.064 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-02-17T12:56:10.130 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-02-17T12:56:10.163 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 220/224 2024-02-17T12:56:10.189 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 221/224 2024-02-17T12:56:10.214 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 222/224 2024-02-17T12:56:10.247 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 223/224 2024-02-17T12:56:10.315 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-02-17T12:56:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 192/224 2024-02-17T12:56:11.297 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1515.g6822c7b5.el9 193/224 2024-02-17T12:56:12.295 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 194/224 2024-02-17T12:56:12.592 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 195/224 2024-02-17T12:56:12.864 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 196/224 2024-02-17T12:56:12.961 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 197/224 2024-02-17T12:56:12.996 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 198/224 2024-02-17T12:56:13.020 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/224 2024-02-17T12:56:13.054 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 200/224 2024-02-17T12:56:13.081 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 201/224 2024-02-17T12:56:13.081 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-02-17T12:56:13.174 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 202/224 2024-02-17T12:56:13.202 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 203/224 2024-02-17T12:56:13.240 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 204/224 2024-02-17T12:56:13.241 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 205/224 2024-02-17T12:56:13.333 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 205/224 2024-02-17T12:56:13.365 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 206/224 2024-02-17T12:56:13.393 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 207/224 2024-02-17T12:56:13.418 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 208/224 2024-02-17T12:56:13.446 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 209/224 2024-02-17T12:56:13.486 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 210/224 2024-02-17T12:56:13.530 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 211/224 2024-02-17T12:56:13.567 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 212/224 2024-02-17T12:56:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 213/224 2024-02-17T12:56:13.624 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 214/224 2024-02-17T12:56:13.650 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 215/224 2024-02-17T12:56:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 216/224 2024-02-17T12:56:13.709 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 217/224 2024-02-17T12:56:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-02-17T12:56:13.716 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-02-17T12:56:13.903 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 218/224 2024-02-17T12:56:13.903 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-02-17T12:56:13.977 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 219/224 2024-02-17T12:56:14.002 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 220/224 2024-02-17T12:56:14.028 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 221/224 2024-02-17T12:56:14.053 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 222/224 2024-02-17T12:56:14.085 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 223/224 2024-02-17T12:56:14.161 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 1/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 3/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 4/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1515.g6822c7b5.el 5/224 2024-02-17T12:56:19.766 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_6 6/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 7/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 8/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 9/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 12/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 14/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 15/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 16/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 18/224 2024-02-17T12:56:19.767 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 19/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1515.g6822c7b5.e 20/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 21/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 22/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 23/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 24/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 25/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 26/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 27/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1515.g6822c7b5.el9 28/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 29/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 30/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1515.g6822c7b5 31/224 2024-02-17T12:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 32/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 33/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 34/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 35/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 36/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 37/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 38/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1515.g6822c7b5 39/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 40/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1515.g6822c7b5. 41/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 42/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1515.g6822c7b5.el 43/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 44/224 2024-02-17T12:56:19.769 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1515.g6822c7b5.el 45/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 46/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 47/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 48/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1515.g6822c7b5.el9 49/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 50/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 51/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 52/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 53/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 54/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 55/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 56/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 57/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 58/224 2024-02-17T12:56:19.770 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 59/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 60/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 61/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/224 2024-02-17T12:56:19.771 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 75/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 81/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/224 2024-02-17T12:56:19.772 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 86/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 89/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 97/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 98/224 2024-02-17T12:56:19.773 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 99/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 100/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 101/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 102/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 104/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 107/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 108/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 109/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 110/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/224 2024-02-17T12:56:19.774 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 112/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 113/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 114/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 115/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-16.el9.x86_64 116/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 117/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 118/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 119/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 120/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 121/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 122/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 123/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 124/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 125/224 2024-02-17T12:56:19.775 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 126/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/224 2024-02-17T12:56:19.776 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 146/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/224 2024-02-17T12:56:19.777 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/224 2024-02-17T12:56:19.778 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 173/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 175/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 177/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 178/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 179/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 181/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 183/224 2024-02-17T12:56:19.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 185/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 195/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 196/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 197/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 198/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 199/224 2024-02-17T12:56:19.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 200/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 201/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 202/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 203/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 204/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 205/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 206/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 207/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 208/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 209/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 210/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 211/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 212/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 213/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 214/224 2024-02-17T12:56:19.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 215/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 216/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 217/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 218/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 219/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 220/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 221/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 222/224 2024-02-17T12:56:19.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 223/224 2024-02-17T12:56:22.756 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 224/224 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: acl-2.3.1-4.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-17T12:56:22.757 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.758 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.759 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.761 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-16.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-17T12:56:22.762 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-17T12:56:22.763 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-17T12:56:22.764 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.11-1.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.765 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-17T12:56:22.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-17T12:56:22.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-17T12:56:22.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-17T12:56:22.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-17T12:56:22.770 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-3.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-17T12:56:22.771 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-17T12:56:22.772 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-17T12:56:22.772 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:22.772 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 224/224 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 1/224 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2/224 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 3/224 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 4/224 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1515.g6822c7b5.el 5/224 2024-02-17T12:56:23.404 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_6 6/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 7/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 8/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 9/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 12/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 14/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 15/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 16/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 18/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 19/224 2024-02-17T12:56:23.405 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1515.g6822c7b5.e 20/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 21/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 22/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 23/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 24/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 25/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 26/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 27/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1515.g6822c7b5.el9 28/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 29/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 30/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1515.g6822c7b5 31/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-debuginfo-2:19.0.0-1515.g6822c7b5.el9. 32/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 33/224 2024-02-17T12:56:23.406 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 34/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 35/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 36/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 37/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 38/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1515.g6822c7b5 39/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 40/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1515.g6822c7b5. 41/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 42/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1515.g6822c7b5.el 43/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 44/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1515.g6822c7b5.el 45/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 46/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x 47/224 2024-02-17T12:56:23.407 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 48/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1515.g6822c7b5.el9 49/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 50/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x8 51/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 52/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 53/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 54/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 55/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 56/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 57/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 58/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 59/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 60/224 2024-02-17T12:56:23.408 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 61/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/224 2024-02-17T12:56:23.409 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 75/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 81/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 86/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 89/224 2024-02-17T12:56:23.410 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 97/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 98/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 99/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 100/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 101/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 102/224 2024-02-17T12:56:23.411 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 104/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 107/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 108/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 109/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 110/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 112/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 113/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 114/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 115/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.6-16.el9.x86_64 116/224 2024-02-17T12:56:23.412 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 117/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 118/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 119/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 120/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 121/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 122/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 123/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 124/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 125/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 126/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/224 2024-02-17T12:56:23.413 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/224 2024-02-17T12:56:23.414 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 146/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/224 2024-02-17T12:56:23.415 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/224 2024-02-17T12:56:23.416 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 173/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 175/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 177/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 178/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 179/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 181/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 183/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 185/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/224 2024-02-17T12:56:23.417 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 195/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 196/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 197/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 198/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 199/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 200/224 2024-02-17T12:56:23.418 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 201/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 202/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 203/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 204/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 205/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 206/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 207/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 208/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 209/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 210/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 211/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 212/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 213/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 214/224 2024-02-17T12:56:23.419 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 215/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 216/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 217/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 218/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 219/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 220/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 221/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 222/224 2024-02-17T12:56:23.420 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 223/224 2024-02-17T12:56:23.482 DEBUG:teuthology.parallel:result is None 2024-02-17T12:56:26.636 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 224/224 2024-02-17T12:56:26.636 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:26.636 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-02-17T12:56:26.636 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:26.636 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:26.636 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: acl-2.3.1-4.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.637 INFO:teuthology.orchestra.run.smithi160.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-02-17T12:56:26.638 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.639 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.640 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-17T12:56:26.641 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.6-16.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.642 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-17T12:56:26.643 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.11-1.el9.x86_64 2024-02-17T12:56:26.644 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.645 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-17T12:56:26.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-17T12:56:26.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-17T12:56:26.648 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-17T12:56:26.649 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.650 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-debuginfo-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-3.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-17T12:56:26.651 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-17T12:56:26.652 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:26.652 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-02-17T12:56:27.301 DEBUG:teuthology.parallel:result is None 2024-02-17T12:56:27.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:56:27.451 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-17T12:56:27.476 INFO:teuthology.orchestra.run.smithi136.stdout:19.0.0-1515.g6822c7b5.el9 2024-02-17T12:56:27.477 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1515.g6822c7b5.el9 2024-02-17T12:56:27.477 INFO:teuthology.task.install:The correct ceph version 19.0.0-1515.g6822c7b5 is installed. 2024-02-17T12:56:27.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:56:27.618 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-17T12:56:27.639 INFO:teuthology.orchestra.run.smithi160.stdout:19.0.0-1515.g6822c7b5.el9 2024-02-17T12:56:27.639 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1515.g6822c7b5.el9 2024-02-17T12:56:27.640 INFO:teuthology.task.install:The correct ceph version 19.0.0-1515.g6822c7b5 is installed. 2024-02-17T12:56:27.641 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-17T12:56:27.642 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:27.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T12:56:27.677 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:27.677 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T12:56:27.708 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-17T12:56:27.708 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:27.709 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T12:56:27.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T12:56:27.819 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:27.819 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T12:56:27.846 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T12:56:27.915 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-17T12:56:27.915 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:27.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T12:56:27.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T12:56:28.016 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:28.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T12:56:28.044 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T12:56:28.110 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-17T12:56:28.111 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:28.111 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T12:56:28.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T12:56:28.206 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:28.206 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T12:56:28.233 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T12:56:28.300 INFO:teuthology.run_tasks:Running task ceph... 2024-02-17T12:56:28.385 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-17T12:56:28.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-02-17T12:56:28.388 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2024-02-17T12:56:28.414 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-17T12:56:28.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T12:56:28.456 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T12:56:28.482 INFO:tasks.ceph:Creating extra log directories... 2024-02-17T12:56:28.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T12:56:28.523 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T12:56:28.557 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-17T12:56:28.557 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-17T12:56:28.557 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-17T12:56:28.557 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:28.557 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T12:56:28.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T12:56:28.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-17T12:56:28.746 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:28.746 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T12:56:28.761 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T12:56:28.879 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-17T12:56:28.911 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-17T12:56:28.911 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-17T12:56:28.911 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7563199', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2794, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUay0Fl6ckYKzkq7St8dBQgq70YS6bOUPrVl0axY9dlSf846o+iwqaGnFJD3lbjPt4mxa/ZlOgGceAhV/gSmdg=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuhoUvgQ0QEgojHhkoCq2JwlRavsmEO0z4/tkX0qVF0pu884VU725wmEEfJjqLbcVNw0OW8H8+nq4CJblNcmok='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-16_20:13:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-17T12:56:28.912 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T12:56:28.914 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T12:56:28.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T12:56:28.969 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T12:56:29.028 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:29.028 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T12:56:29.049 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T12:56:29.049 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-02-17 12:56:10.651333345 +0000 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-02-17 12:47:42.752587973 +0000 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-02-17 12:47:42.752587973 +0000 2024-02-17T12:56:29.103 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-02-17 12:47:42.752587973 +0000 2024-02-17T12:56:29.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T12:56:29.169 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-02-17T12:56:29.169 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-02-17T12:56:29.169 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000207698 s, 2.5 MB/s 2024-02-17T12:56:29.170 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T12:56:29.226 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-02-17T12:56:29.281 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T12:56:29.281 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:29.281 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-17T12:56:29.281 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:29.281 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:29.281 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-02-17 12:56:10.652333322 +0000 2024-02-17T12:56:29.282 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-02-17 12:47:43.101580055 +0000 2024-02-17T12:56:29.282 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-02-17 12:47:43.101580055 +0000 2024-02-17T12:56:29.282 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-02-17 12:47:43.101580055 +0000 2024-02-17T12:56:29.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T12:56:29.347 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-02-17T12:56:29.347 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-02-17T12:56:29.347 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000205861 s, 2.5 MB/s 2024-02-17T12:56:29.348 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T12:56:29.404 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-02-17 12:56:10.652333322 +0000 2024-02-17T12:56:29.459 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-02-17 12:47:43.443572300 +0000 2024-02-17T12:56:29.460 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-02-17 12:47:43.443572300 +0000 2024-02-17T12:56:29.460 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-02-17 12:47:43.443572300 +0000 2024-02-17T12:56:29.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T12:56:29.525 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-02-17T12:56:29.525 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-02-17T12:56:29.525 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000203391 s, 2.5 MB/s 2024-02-17T12:56:29.526 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T12:56:29.582 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-02-17 12:56:10.652333322 +0000 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-02-17 12:47:43.808564024 +0000 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-02-17 12:47:43.808564024 +0000 2024-02-17T12:56:29.638 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-02-17 12:47:43.808564024 +0000 2024-02-17T12:56:29.639 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T12:56:29.704 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-02-17T12:56:29.704 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-02-17T12:56:29.704 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000241851 s, 2.1 MB/s 2024-02-17T12:56:29.705 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T12:56:29.761 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:29.761 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:29.761 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T12:56:29.778 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T12:56:29.779 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-02-17 12:56:14.527303860 +0000 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-02-17 12:47:42.755792845 +0000 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-02-17 12:47:42.755792845 +0000 2024-02-17T12:56:29.835 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-02-17 12:47:42.755792845 +0000 2024-02-17T12:56:29.836 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T12:56:29.903 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-02-17T12:56:29.903 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-02-17T12:56:29.903 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000207248 s, 2.5 MB/s 2024-02-17T12:56:29.904 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T12:56:29.962 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-02-17 12:56:14.527303860 +0000 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-02-17 12:47:43.109787636 +0000 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-02-17 12:47:43.109787636 +0000 2024-02-17T12:56:30.019 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-02-17 12:47:43.109787636 +0000 2024-02-17T12:56:30.020 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T12:56:30.086 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-02-17T12:56:30.087 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-02-17T12:56:30.087 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000210967 s, 2.4 MB/s 2024-02-17T12:56:30.088 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T12:56:30.145 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-02-17 12:56:14.527303860 +0000 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-02-17 12:47:43.465782398 +0000 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-02-17 12:47:43.465782398 +0000 2024-02-17T12:56:30.201 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-02-17 12:47:43.465782398 +0000 2024-02-17T12:56:30.202 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T12:56:30.267 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-02-17T12:56:30.267 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-02-17T12:56:30.268 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000178074 s, 2.9 MB/s 2024-02-17T12:56:30.269 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T12:56:30.325 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-02-17T12:56:30.380 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T12:56:30.380 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:56:30.380 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-17T12:56:30.381 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:56:30.381 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T12:56:30.381 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-02-17 12:56:14.528303846 +0000 2024-02-17T12:56:30.381 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-02-17 12:47:43.813777278 +0000 2024-02-17T12:56:30.381 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-02-17 12:47:43.813777278 +0000 2024-02-17T12:56:30.381 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-02-17 12:47:43.813777278 +0000 2024-02-17T12:56:30.381 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T12:56:30.446 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-02-17T12:56:30.446 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-02-17T12:56:30.446 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000242325 s, 2.1 MB/s 2024-02-17T12:56:30.447 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T12:56:30.502 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:30.503 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T12:56:30.503 INFO:tasks.ceph:Generating config... 2024-02-17T12:56:30.504 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-17T12:56:30.504 INFO:tasks.ceph:[client] debug client = 20 2024-02-17T12:56:30.504 INFO:tasks.ceph:[client] debug ms = 1 2024-02-17T12:56:30.504 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-17T12:56:30.504 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-17T12:56:30.504 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-02-17T12:56:30.504 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-02-17T12:56:30.505 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-17T12:56:30.505 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-17T12:56:30.506 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-17T12:56:30.506 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-17T12:56:30.506 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-17T12:56:30.506 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-02-17T12:56:30.507 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-17T12:56:30.507 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-17T12:56:30.507 INFO:tasks.ceph:Setting up mon.a... 2024-02-17T12:56:30.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-17T12:56:30.565 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.keyring 2024-02-17T12:56:30.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-17T12:56:30.615 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T12:56:30.643 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.136'), ('mon.b', '172.21.15.160'), ('mon.c', '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]')] 2024-02-17T12:56:30.643 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.136,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-17T12:56:30.644 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:30.644 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T12:56:30.697 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.136 --add b 172.21.15.160 --addv c '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:30.782 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:30.782 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: generated fsid b14cc0e2-9a6d-442e-8d67-bc5380021b88 2024-02-17T12:56:30.782 INFO:teuthology.orchestra.run.smithi136.stdout:setting min_mon_release = quincy 2024-02-17T12:56:30.782 INFO:teuthology.orchestra.run.smithi136.stdout:epoch 0 2024-02-17T12:56:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:fsid b14cc0e2-9a6d-442e-8d67-bc5380021b88 2024-02-17T12:56:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:last_changed 2024-02-17T12:56:30.792072+0000 2024-02-17T12:56:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:created 2024-02-17T12:56:30.792072+0000 2024-02-17T12:56:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:min_mon_release 17 (quincy) 2024-02-17T12:56:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:election_strategy: 1 2024-02-17T12:56:30.783 INFO:teuthology.orchestra.run.smithi136.stdout:0: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.a 2024-02-17T12:56:30.784 INFO:teuthology.orchestra.run.smithi136.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-02-17T12:56:30.784 INFO:teuthology.orchestra.run.smithi136.stdout:2: [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] mon.c 2024-02-17T12:56:30.784 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-17T12:56:30.786 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T12:56:30.801 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b14cc0e2-9a6d-442e-8d67-bc5380021b88... 2024-02-17T12:56:30.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T12:56:30.844 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T12:56:30.891 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-02-17T12:56:30.892 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-02-17T12:56:30.893 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-02-17T12:56:30.894 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.136,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: mds beacon grace = 60 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: mds heartbeat grace = 60 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd heartbeat grace = 60 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = b14cc0e2-9a6d-442e-8d67-bc5380021b88 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-02-17T12:56:30.895 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug trim objects = true 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.896 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T12:56:30.897 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: osd fast shutdown = False 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-02-17T12:56:30.898 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T12:56:30.899 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd crush smoke test = False 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:56:30.900 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-02-17T12:56:30.901 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.e] 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.f] 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: mds valgrind exit = True 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-02-17T12:56:30.902 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.903 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T12:56:30.904 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T12:56:30.905 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.136,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mds beacon grace = 60 2024-02-17T12:56:30.906 INFO:teuthology.orchestra.run.smithi160.stdout: mds heartbeat grace = 60 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd heartbeat grace = 60 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = b14cc0e2-9a6d-442e-8d67-bc5380021b88 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2024-02-17T12:56:30.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2024-02-17T12:56:30.908 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2024-02-17T12:56:30.909 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: osd fast shutdown = False 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2024-02-17T12:56:30.910 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.911 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd crush smoke test = False 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2024-02-17T12:56:30.912 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.e] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-02-17T12:56:30.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.f] 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds balancer = 20 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: mds valgrind exit = True 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2024-02-17T12:56:30.914 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2024-02-17T12:56:30.916 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-17T12:56:30.916 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-17T12:56:31.012 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-17T12:56:31.012 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:31.013 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-17T12:56:31.027 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:31.027 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-17T12:56:31.082 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:56:31.082 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:31.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T12:56:31.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T12:56:31.161 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:56:31.161 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:31.216 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T12:56:31.216 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:31.216 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T12:56:31.216 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T12:56:31.256 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:56:31.256 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:31.311 INFO:tasks.ceph:Setting up mon nodes... 2024-02-17T12:56:31.311 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-17T12:56:31.311 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T12:56:31.365 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T12:56:31.368 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T12:56:31.428 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T12:56:31.431 INFO:tasks.ceph:Setting up mds nodes... 2024-02-17T12:56:31.431 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T12:56:31.486 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T12:56:31.488 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-17T12:56:31.514 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-17T12:56:31.609 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-17T12:56:31.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-17T12:56:31.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-02-17T12:56:31.733 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-02-17T12:56:31.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-02-17T12:56:31.762 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T12:56:31.818 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T12:56:31.820 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-17T12:56:31.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-17T12:56:31.942 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-17T12:56:31.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-17T12:56:31.971 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-02-17T12:56:32.066 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-02-17T12:56:32.069 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-02-17T12:56:32.095 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-17T12:56:32.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-17T12:56:32.138 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-17T12:56:32.153 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-17T12:56:32.153 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T12:56:32.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-17T12:56:32.220 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:32.220 INFO:tasks.ceph:role: osd.0 2024-02-17T12:56:32.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:56:32.221 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T12:56:32.294 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:32.294 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:32.294 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:32.294 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:32.294 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:32.294 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:32.295 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:32.295 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:32.295 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:32.295 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:32.811 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-02-17T12:56:32.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-02-17T12:56:32.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-17T12:56:32.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-17T12:56:32.951 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-17T12:56:33.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:33.018 INFO:tasks.ceph:role: osd.1 2024-02-17T12:56:33.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:56:33.018 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:33.093 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:33.589 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-02-17T12:56:33.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-02-17T12:56:33.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-17T12:56:33.689 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-17T12:56:33.724 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-17T12:56:33.791 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:33.791 INFO:tasks.ceph:role: osd.2 2024-02-17T12:56:33.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:56:33.791 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:33.867 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:33.868 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:33.868 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:34.394 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-02-17T12:56:34.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-02-17T12:56:34.396 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-17T12:56:34.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-17T12:56:34.535 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-17T12:56:34.602 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:34.602 INFO:tasks.ceph:role: osd.3 2024-02-17T12:56:34.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:56:34.602 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T12:56:34.677 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:34.677 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:34.677 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:34.677 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:34.677 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:34.678 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:34.678 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:34.678 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:34.678 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:34.678 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:35.208 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-02-17T12:56:35.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-02-17T12:56:35.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-17T12:56:35.321 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-17T12:56:35.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:35.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:35.485+0000 7fc7ad468640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-17T12:56:35.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:35.486+0000 7fc7ad468640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-17T12:56:35.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:35.486+0000 7fc7ad468640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T12:56:35.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:35.486+0000 7fc7ad468640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T12:56:35.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:35.486+0000 7fc7ad468640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T12:56:35.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:35.490+0000 7fc7ad468640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-17T12:56:38.344 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-17T12:56:38.375 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:38.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:38.477+0000 7f4c67820640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-17T12:56:38.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:38.477+0000 7f4c67820640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-17T12:56:38.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:38.477+0000 7f4c67820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T12:56:38.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:38.477+0000 7f4c67820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T12:56:38.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:38.477+0000 7f4c67820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T12:56:38.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:38.478+0000 7f4c67820640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-17T12:56:41.316 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-17T12:56:41.345 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:41.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:41.442+0000 7fc0c640f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-17T12:56:41.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:41.443+0000 7fc0c640f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-17T12:56:41.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:41.443+0000 7fc0c640f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T12:56:41.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:41.443+0000 7fc0c640f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T12:56:41.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:41.443+0000 7fc0c640f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T12:56:41.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:41.443+0000 7fc0c640f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-17T12:56:44.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-17T12:56:44.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:44.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:44.417+0000 7f7a1b2d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-17T12:56:44.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:44.417+0000 7f7a1b2d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-17T12:56:44.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:44.417+0000 7f7a1b2d9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T12:56:44.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:44.417+0000 7f7a1b2d9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T12:56:44.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:44.417+0000 7f7a1b2d9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T12:56:44.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:56:44.418+0000 7f7a1b2d9640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-17T12:56:47.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-17T12:56:47.295 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-17T12:56:47.327 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:47.327 INFO:tasks.ceph:role: osd.4 2024-02-17T12:56:47.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T12:56:47.327 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:47.405 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:47.922 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-02-17T12:56:47.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-02-17T12:56:47.924 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-17T12:56:48.059 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-17T12:56:48.101 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-17T12:56:48.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:48.170 INFO:tasks.ceph:role: osd.5 2024-02-17T12:56:48.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T12:56:48.171 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:48.693 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-02-17T12:56:48.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-02-17T12:56:48.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-17T12:56:48.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-17T12:56:48.817 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-17T12:56:48.884 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:48.885 INFO:tasks.ceph:role: osd.6 2024-02-17T12:56:48.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T12:56:48.885 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T12:56:48.958 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:48.959 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:49.452 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-02-17T12:56:49.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-02-17T12:56:49.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-17T12:56:49.602 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-17T12:56:49.633 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-17T12:56:49.701 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:56:49.701 INFO:tasks.ceph:role: osd.7 2024-02-17T12:56:49.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T12:56:49.701 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:56:49.776 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:56:50.291 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-02-17T12:56:50.293 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-02-17T12:56:50.293 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-17T12:56:50.439 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-17T12:56:50.473 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:50.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:50.581+0000 7fabdf411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-17T12:56:50.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:50.582+0000 7fabdf411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-17T12:56:50.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:50.582+0000 7fabdf411640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T12:56:50.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:50.582+0000 7fabdf411640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T12:56:50.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:50.582+0000 7fabdf411640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T12:56:50.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:50.582+0000 7fabdf411640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-17T12:56:53.419 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T12:56:53.449 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:53.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:53.547+0000 7f5ad0013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-17T12:56:53.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:53.547+0000 7f5ad0013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-17T12:56:53.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:53.547+0000 7f5ad0013640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T12:56:53.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:53.547+0000 7f5ad0013640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T12:56:53.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:53.547+0000 7f5ad0013640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T12:56:53.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:53.548+0000 7f5ad0013640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-17T12:56:56.381 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T12:56:56.411 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:56.502 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:56.511+0000 7f79ffaf9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-17T12:56:56.502 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:56.511+0000 7f79ffaf9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-17T12:56:56.502 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:56.511+0000 7f79ffaf9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T12:56:56.502 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:56.511+0000 7f79ffaf9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T12:56:56.502 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:56.511+0000 7f79ffaf9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T12:56:56.502 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:56.512+0000 7f79ffaf9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-17T12:56:58.913 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:56:58.917 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:56:59.350 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T12:56:59.378 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:56:59.465 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:59.475+0000 7f3c10a22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-17T12:56:59.466 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:59.475+0000 7f3c10a22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-17T12:56:59.466 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:59.475+0000 7f3c10a22640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T12:56:59.466 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:59.475+0000 7f3c10a22640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T12:56:59.466 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:59.475+0000 7f3c10a22640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T12:56:59.466 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:56:59.475+0000 7f3c10a22640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-17T12:57:02.325 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T12:57:02.357 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-17T12:57:02.357 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-17T12:57:02.389 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-17T12:57:02.459 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.459 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-17T12:57:02.529 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-02-17T12:57:02.598 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-17T12:57:02.667 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-17T12:57:02.735 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-17T12:57:02.804 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:02.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-17T12:57:02.872 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:02.872 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-17T12:57:02.904 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:02.904 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-17T12:57:02.975 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:02.975 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-17T12:57:03.045 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:03.045 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-02-17T12:57:03.114 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:03.115 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-17T12:57:03.183 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:03.183 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-17T12:57:03.252 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:03.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-17T12:57:03.320 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:03.321 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-17T12:57:03.388 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:03.388 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-17T12:57:03.405 INFO:tasks.ceph:Adding keys to all mons... 2024-02-17T12:57:03.405 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T12:57:03.448 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T12:57:03.473 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2024-02-17T12:57:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBlooVnFhAAtyIwi8toMNYQZUpVd21QOQ== 2024-02-17T12:57:03.473 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-02-17T12:57:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBl0DeUHRAAUujq/uqXpK5g3bGXFkSA+w== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBlZHzsJBAAGrobe1f8jM986QzmP6fEsg== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.e] 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBlI4VQLBAAubBqau1J/Ohk1bdM7U8z5A== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQADrdBlSgwFHRAAnDTprcnJoWrpkLEER0FYdg== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAGrdBlK0GDHBAAtLoJLhM9VqecDrOdH3O7bw== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAJrdBlNktzGhAAW+ZL8KXhrMMu4giBArAl8w== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAMrdBlLELsGBAAryScKeed8ij/ns9o3tYefg== 2024-02-17T12:57:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBlXEUxGhAAnP01LEf3eFz264AnQZrwAQ== 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBl22ZnMRAAQjYx8HuAvAW70CWexl87Cg== 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD/rNBlSu7ROBAAXUgqgTAU5QS3JlRB4AQNsA== 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.f] 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAArdBl1duZBBAA4VLUDeQtHFqfCSqKe11P5g== 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQASrdBlUzC+IhAAdpEuQmwiYdva73ilHw6KdA== 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2024-02-17T12:57:03.475 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAVrdBl6zOyIBAAbWu56LGo4bb4XMe6AdqfFA== 2024-02-17T12:57:03.476 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2024-02-17T12:57:03.476 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAYrdBlN/WEHhAAgRat81kryqehMDpkYSFIfg== 2024-02-17T12:57:03.476 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2024-02-17T12:57:03.477 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAbrdBl5LFfHBAAMTZIGhJrmKjh1UG0QOZojg== 2024-02-17T12:57:03.477 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-02-17T12:57:03.477 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAArdBlloLgCBAAzlUofzwrKOp3RGSNToMk9w== 2024-02-17T12:57:03.478 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2024-02-17T12:57:03.478 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBlooVnFhAAtyIwi8toMNYQZUpVd21QOQ== 2024-02-17T12:57:03.478 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBl0DeUHRAAUujq/uqXpK5g3bGXFkSA+w== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBlZHzsJBAAGrobe1f8jM986QzmP6fEsg== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.e] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBlI4VQLBAAubBqau1J/Ohk1bdM7U8z5A== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQADrdBlSgwFHRAAnDTprcnJoWrpkLEER0FYdg== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAGrdBlK0GDHBAAtLoJLhM9VqecDrOdH3O7bw== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAJrdBlNktzGhAAW+ZL8KXhrMMu4giBArAl8w== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAMrdBlLELsGBAAryScKeed8ij/ns9o3tYefg== 2024-02-17T12:57:03.479 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBlXEUxGhAAnP01LEf3eFz264AnQZrwAQ== 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBl22ZnMRAAQjYx8HuAvAW70CWexl87Cg== 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD/rNBlSu7ROBAAXUgqgTAU5QS3JlRB4AQNsA== 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.f] 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAArdBl1duZBBAA4VLUDeQtHFqfCSqKe11P5g== 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQASrdBlUzC+IhAAdpEuQmwiYdva73ilHw6KdA== 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAVrdBl6zOyIBAAbWu56LGo4bb4XMe6AdqfFA== 2024-02-17T12:57:03.480 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2024-02-17T12:57:03.481 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAYrdBlN/WEHhAAgRat81kryqehMDpkYSFIfg== 2024-02-17T12:57:03.481 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2024-02-17T12:57:03.481 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAbrdBl5LFfHBAAMTZIGhJrmKjh1UG0QOZojg== 2024-02-17T12:57:03.481 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2024-02-17T12:57:03.481 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAArdBlloLgCBAAzlUofzwrKOp3RGSNToMk9w== 2024-02-17T12:57:03.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:57:03.521 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:57:03.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:03.577 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:03.632 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:03.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:03.689 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:03.691 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:03.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.800 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.856 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.908 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.911 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:03.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:57:03.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:57:04.018 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:04.021 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:04.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:04.079 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:04.135 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:04.137 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:57:04.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.195 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.249 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.303 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:57:04.413 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T12:57:04.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T12:57:04.471 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-17T12:57:04.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-17T12:57:04.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T12:57:04.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-17T12:57:04.621 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-17T12:57:04.648 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T12:57:04.746 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-17T12:57:04.773 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-17T12:57:04.841 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T12:57:04.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-17T12:57:04.966 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:57:04.968 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:57:05.023 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-17T12:57:05.024 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-17T12:57:05.024 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-17T12:57:05.024 DEBUG:teuthology.orchestra.run.smithi136:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-02-17T12:57:05.026 INFO:tasks.ceph.mon.a:Started 2024-02-17T12:57:05.026 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-17T12:57:05.027 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-17T12:57:05.027 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-02-17T12:57:05.066 INFO:tasks.ceph.mon.b:Started 2024-02-17T12:57:05.066 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-17T12:57:05.067 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-17T12:57:05.067 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-02-17T12:57:05.069 INFO:tasks.ceph.mon.c:Started 2024-02-17T12:57:05.069 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-17T12:57:05.069 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-17T12:57:05.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-02-17T12:57:05.071 INFO:tasks.ceph.mgr.y:Started 2024-02-17T12:57:05.071 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-17T12:57:05.072 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-02-17T12:57:05.073 INFO:tasks.ceph.mgr.x:Started 2024-02-17T12:57:05.074 INFO:tasks.ceph:Setting crush tunables to default 2024-02-17T12:57:05.074 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd crush tunables default 2024-02-17T12:57:05.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.185+0000 7f97de565640 1 Processor -- start 2024-02-17T12:57:05.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.185+0000 7f97de565640 1 -- start start 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97de565640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 0x7f97d8163410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97de565640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b31f0 con 0x7f97d8151e70 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97de565640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b34d0 con 0x7f97d80c76d0 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97de565640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97d80b1590 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97d80c9120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97d80b0e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 msgr2=0x7f97d8163410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:05.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.186+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 0x7f97d8163410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:05.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.387+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97d80c9120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:05.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.387+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 msgr2=0x7f97d8163410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:05.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.387+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97d80b0e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:05.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.387+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 0x7f97d8163410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:05.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.788+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97d80c9120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:05.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.788+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 msgr2=0x7f97d8163410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:05.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.788+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97d80b0e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:05.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:05.788+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 0x7f97d8163410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:06.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:06.589+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97d80c9120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:06.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:06.589+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97d80b0e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:06.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:06.589+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 msgr2=0x7f97d8163410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:06.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:06.589+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 0x7f97d8163410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:08.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 msgr2=0x7f97d8163410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:08.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97d80b1590 0x7f97d8163410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:08.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97d80b0e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:08.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97d80c9120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:08.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 0x7f97c4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:08.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 0x7f97c40086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:08.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97c40036d0 2024-02-17T12:57:08.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d5ffb640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c4008da0 con 0x7f97c4006230 2024-02-17T12:57:08.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d7fff640 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 msgr2=0x7f97c4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2024-02-17T12:57:08.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 0x7f97c4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:08.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d77fe640 1 -- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 msgr2=0x7f97c40086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3300/0 2024-02-17T12:57:08.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.186+0000 7f97d77fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 0x7f97c40086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:08.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.387+0000 7f97d7fff640 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 msgr2=0x7f97c4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2024-02-17T12:57:08.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.387+0000 7f97d7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 0x7f97c4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:08.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.387+0000 7f97d77fe640 1 -- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 msgr2=0x7f97c40086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3300/0 2024-02-17T12:57:08.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.387+0000 7f97d77fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 0x7f97c40086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:08.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.788+0000 7f97d7fff640 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 msgr2=0x7f97c4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2024-02-17T12:57:08.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.788+0000 7f97d7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 0x7f97c4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:08.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.788+0000 7f97d77fe640 1 -- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 msgr2=0x7f97c40086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3300/0 2024-02-17T12:57:08.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:08.788+0000 7f97d77fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 0x7f97c40086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:09.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:09.589+0000 7f97d7fff640 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 msgr2=0x7f97c4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.136:3300/0 2024-02-17T12:57:09.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:09.589+0000 7f97d7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 0x7f97c4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:09.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:09.589+0000 7f97d77fe640 1 -- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 msgr2=0x7f97c40086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3300/0 2024-02-17T12:57:09.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:09.589+0000 7f97d77fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 0x7f97c40086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:11.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 -- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 msgr2=0x7f97c40086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:11.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c4006230 0x7f97c40086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:11.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 -- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 msgr2=0x7f97c4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:11.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c40036d0 0x7f97c4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:11.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97dcb02640 1 -- reap_dead start 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 0x7f97c40066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97c400b000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80c8b10 con 0x7f97d8151e70 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b31f0 con 0x7f97d80c76d0 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d5ffb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97c4003b40 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97c400e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:11.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.185+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:11.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.386+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97c400b000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:11.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.386+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97c400e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:11.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.386+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:11.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.386+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.787+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97c400b000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.787+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97c400e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.787+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:11.787+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:12.059 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:00:06.930 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T12:57:12.367 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:00:07.239 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T12:57:12.409 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:00:07.211 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T12:57:12.409 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:00:07.211 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T12:57:12.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:12.588+0000 7f97d7fff640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97c400b000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.136:6789/0 2024-02-17T12:57:12.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:12.588+0000 7f97d77fe640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97c400e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.160:6789/0 2024-02-17T12:57:12.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:12.588+0000 7f97dcb02640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.160:3301/0 2024-02-17T12:57:12.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:12.588+0000 7f97dcb02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:12.730 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:00:07.532 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T12:57:12.731 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:00:07.533 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T12:57:14.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 -- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:14.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4003b40 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:14.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 -- >> v1:172.21.15.160:6789/0 conn(0x7f97d80c76d0 legacy=0x7f97c400e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:14.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 -- >> v1:172.21.15.136:6789/0 conn(0x7f97d8151e70 legacy=0x7f97c400b000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:14.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:14.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:14.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97c4007d80 2024-02-17T12:57:14.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.185+0000 7f97d5ffb640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c4008da0 con 0x7f97c40087a0 2024-02-17T12:57:14.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.286+0000 7f97d7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:14.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.286+0000 7f97d7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:37336/0 (socket says 172.21.15.136:37336) 2024-02-17T12:57:14.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.286+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 learned_addr learned my addr 172.21.15.136:0/2544417978 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:14.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.323+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:14.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.323+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:14.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.323+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:14.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.323+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.741+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.744+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.744+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.744+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.744+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:14.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.839+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:14.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.841+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:14.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.841+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:14.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.841+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:14.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:14.841+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:15.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.042+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:15.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.042+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:15.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.042+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:15.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.042+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:15.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.042+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:15.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.180+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:15.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.228+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:15.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.228+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:15.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.228+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:15.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.228+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:15.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.443+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:15.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.444+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:15.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.444+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:15.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.444+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:15.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:15.445+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:16.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.029+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:16.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.031+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:16.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.031+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:16.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.031+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:16.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.031+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:16.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.246+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:16.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.246+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:16.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.246+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:16.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.246+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:16.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:16.246+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 msgr2=0x7f97c4006c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c40087a0 0x7f97c4006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 msgr2=0x7f97c4008160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007d80 0x7f97c4008160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 reap_dead start 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b34d0 con 0x7f97c4006c20 2024-02-17T12:57:17.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97c4007410 2024-02-17T12:57:17.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4008da0 con 0x7f97c4008160 2024-02-17T12:57:17.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:17.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.187+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:17.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.189+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:17.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.390+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:17.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.390+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:17.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.391+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:17.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.793+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:17.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.793+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:17.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:17.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:17.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:17.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.794+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:17.795+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:18.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.595+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:18.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.597+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:18.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.597+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:18.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.597+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:18.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.597+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:18.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.607+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:18.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.608+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:18.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.608+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:18.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.608+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:18.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:18.608+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c4015ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4007410 0x7f97c4015ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v1:172.21.15.136:6789/0 conn(0x7f97c4006c20 legacy=0x7f97c400b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80c8b10 con 0x7f97c400c740 2024-02-17T12:57:20.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97c4010280 2024-02-17T12:57:20.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.188+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:20.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.190+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:20.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.190+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:20.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.190+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:20.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.190+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:20.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.391+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:20.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.393+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:20.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.393+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:20.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.393+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:20.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.393+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:20.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.794+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:20.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.796+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:20.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.796+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:20.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.796+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:20.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:20.796+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:21.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:21.606+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:21.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:21.607+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:21.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:21.607+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:21.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:21.607+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:21.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:21.607+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:23.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c4012720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:23.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4010280 0x7f97c4012720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v1:172.21.15.160:6789/0 conn(0x7f97c400c740 legacy=0x7f97c400eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 reap_dead start 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80c8830 con 0x7f97c4010280 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c4008da0 con 0x7f97c4007410 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.187+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4006c20 con 0x7f97c4008160 2024-02-17T12:57:23.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.188+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.188+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.189+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.189+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.189+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.189+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.189+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:23.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:23.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.190+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:57:23.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.390+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.391+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.391+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:23.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.392+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:57:23.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.793+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.793+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.794+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.794+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.794+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.794+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.794+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:23.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:23.795+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:57:24.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.596+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:24.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.596+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:24.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.596+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:24.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:57:24.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:24.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:24.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T12:57:24.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d77fe640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:24.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:24.597+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:57:26.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 msgr2=0x7f97c400afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c4008160 0x7f97c400afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 msgr2=0x7f97c40066e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.160:3300/0 conn(0x7f97c4007410 0x7f97c40066e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 msgr2=0x7f97c400b730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 --2- 172.21.15.136:0/2544417978 >> v2:172.21.15.136:3300/0 conn(0x7f97c4010280 0x7f97c400b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80b31f0 con 0x7f97c400c080 2024-02-17T12:57:26.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:26.188+0000 7f97d5ffb640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c4012d80 con 0x7f97c400bc70 2024-02-17T12:57:27.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.908+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629454290 0 0) 0x7f97d80b31f0 con 0x7f97c400c080 2024-02-17T12:57:27.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.908+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c0003520 con 0x7f97c400c080 2024-02-17T12:57:27.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.931+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050367053 0 0) 0x7f97c4012d80 con 0x7f97c400bc70 2024-02-17T12:57:27.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.931+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d80b31f0 con 0x7f97c400bc70 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.956+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972145786 0 0) 0x7f97c0003520 con 0x7f97c400c080 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.956+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 >> v1:172.21.15.160:6789/0 conn(0x7f97c400bc70 legacy=0x7f97c4012670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.956+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4012f10 con 0x7f97c400c080 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.956+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3338030640 0 0) 0x7f97c80096d0 con 0x7f97c400c080 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.956+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 >> v1:172.21.15.136:6789/0 conn(0x7f97c400c080 legacy=0x7f97c400fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.956+0000 7f97dcb02640 1 -- 172.21.15.136:0/2544417978 reap_dead start 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d6ffd640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0003b30 0x7f97c0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d6ffd640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c00047c0 0x7f97c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d6ffd640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c0005380 0x7f97c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:27.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c000c1e0 con 0x7f97c0005380 2024-02-17T12:57:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c000c350 con 0x7f97c0003b30 2024-02-17T12:57:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c000c510 con 0x7f97c00047c0 2024-02-17T12:57:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.957+0000 7f97d77fe640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c00047c0 0x7f97c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:27.958+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0003b30 0x7f97c0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:27.991 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.001+0000 7f97dcb02640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c0005380 0x7f97c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.007+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c00047c0 msgr2=0x7f97c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:27.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.007+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c00047c0 0x7f97c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.007+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c0005380 msgr2=0x7f97c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.007+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c0005380 0x7f97c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.007+0000 7f97d7fff640 1 -- 172.21.15.136:0/2544417978 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c0003520 con 0x7f97c0003b30 2024-02-17T12:57:28.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.012+0000 7f97d7fff640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0003b30 0x7f97c0003f10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f97c40060e0 tx=0x7f97c00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19a12412de34d27 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:28.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.071+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc032420 con 0x7f97c0003b30 2024-02-17T12:57:28.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.071+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc011040 con 0x7f97c0003b30 2024-02-17T12:57:28.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.071+0000 7f97d6ffd640 1 -- 172.21.15.136:0/2544417978 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc032800 con 0x7f97c0003b30 2024-02-17T12:57:28.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 -- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0003b30 msgr2=0x7f97c0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:28.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0003b30 0x7f97c0003f10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f97c40060e0 tx=0x7f97c00057f0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 -- 172.21.15.136:0/2544417978 shutdown_connections 2024-02-17T12:57:28.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c0005380 0x7f97c000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c00047c0 0x7f97c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 --2- 172.21.15.136:0/2544417978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0003b30 0x7f97c0003f10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 -- 172.21.15.136:0/2544417978 >> 172.21.15.136:0/2544417978 conn(0x7f97d8070790 msgr2=0x7f97d8070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:28.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 -- 172.21.15.136:0/2544417978 shutdown_connections 2024-02-17T12:57:28.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.072+0000 7f97de565640 1 -- 172.21.15.136:0/2544417978 wait complete. 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.073+0000 7f97de565640 1 Processor -- start 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 -- start start 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 0x7f97d8154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c00047c0 0x7f97d80c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0005380 0x7f97d8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d815c000 con 0x7f97c00047c0 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d8152570 con 0x7f97c0005380 2024-02-17T12:57:28.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.074+0000 7f97de565640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c57e0 con 0x7f97c0003b30 2024-02-17T12:57:28.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.075+0000 7f97d7fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 0x7f97d8154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:28.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.075+0000 7f97d7fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 0x7f97d8154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:32944/0 (socket says 172.21.15.136:32944) 2024-02-17T12:57:28.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.075+0000 7f97d7fff640 1 -- 172.21.15.136:0/1618915823 learned_addr learned my addr 172.21.15.136:0/1618915823 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:28.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.076+0000 7f97dcb02640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0005380 0x7f97d8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:28.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.088+0000 7f97d7fff640 1 -- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0005380 msgr2=0x7f97d8152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:28.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.088+0000 7f97d7fff640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0005380 0x7f97d8152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.088+0000 7f97d7fff640 1 -- 172.21.15.136:0/1618915823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c00047c0 msgr2=0x7f97d80c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:28.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.088+0000 7f97d7fff640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c00047c0 0x7f97d80c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.088+0000 7f97d7fff640 1 -- 172.21.15.136:0/1618915823 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80c5ac0 con 0x7f97c0003b30 2024-02-17T12:57:28.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.092+0000 7f97d7fff640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 0x7f97d8154790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f97cc02f020 tx=0x7f97cc005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:28.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.150+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc03e040 con 0x7f97c0003b30 2024-02-17T12:57:28.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.150+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc003980 con 0x7f97c0003b30 2024-02-17T12:57:28.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.150+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc032ea0 con 0x7f97c0003b30 2024-02-17T12:57:28.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.150+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d8152810 con 0x7f97c0003b30 2024-02-17T12:57:28.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.150+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d8154cd0 con 0x7f97c0003b30 2024-02-17T12:57:28.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.151+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d8067e00 con 0x7f97c0003b30 2024-02-17T12:57:28.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.171+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f97cc03a830 con 0x7f97c0003b30 2024-02-17T12:57:28.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.171+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f97cc0457f0 con 0x7f97c0003b30 2024-02-17T12:57:28.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.342+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f97cc009b60 con 0x7f97c0003b30 2024-02-17T12:57:28.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.406+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f97d8067e00 con 0x7f97c0003b30 2024-02-17T12:57:28.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.651+0000 7f97d4ff9640 1 -- 172.21.15.136:0/1618915823 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f97cc0037b0 con 0x7f97c0003b30 2024-02-17T12:57:28.642 INFO:teuthology.orchestra.run.smithi136.stderr:adjusted tunables profile to default 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 msgr2=0x7f97d8154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 0x7f97d8154790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f97cc02f020 tx=0x7f97cc005040 comp rx=0 tx=0).stop 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 shutdown_connections 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97c0005380 0x7f97d8152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97c00047c0 0x7f97d80c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 --2- 172.21.15.136:0/1618915823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97c0003b30 0x7f97d8154790 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 >> 172.21.15.136:0/1618915823 conn(0x7f97d8070790 msgr2=0x7f97d814d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 shutdown_connections 2024-02-17T12:57:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:28.652+0000 7f97de565640 1 -- 172.21.15.136:0/1618915823 wait complete. 2024-02-17T12:57:28.653 INFO:tasks.ceph:check_enable_crimson: False 2024-02-17T12:57:28.653 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-17T12:57:28.654 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:28.654 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-17T12:57:28.680 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:28.681 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-17T12:57:28.747 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:28.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-17T12:57:28.814 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:57:28.814 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-17T12:57:28.881 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:28.881 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-17T12:57:28.909 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:28.909 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-17T12:57:28.976 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:28.976 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-17T12:57:29.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:57:29.017 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:57:29.043 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-02-17T12:57:29.043 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-17T12:57:29.110 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 8f774ae8-2987-46e0-9b10-c2c14d5442c9 0 2024-02-17T12:57:29.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.275+0000 7f5f6bbe9640 1 Processor -- start 2024-02-17T12:57:29.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.276+0000 7f5f6bbe9640 1 -- start start 2024-02-17T12:57:29.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.276+0000 7f5f6bbe9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5f6406aac0 0x7f5f6415d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.276+0000 7f5f6bbe9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c7d60 con 0x7f5f640c6e10 2024-02-17T12:57:29.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.276+0000 7f5f6bbe9640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c7fe0 con 0x7f5f64153f30 2024-02-17T12:57:29.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.276+0000 7f5f6bbe9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6406c800 con 0x7f5f6406aac0 2024-02-17T12:57:29.268 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.277+0000 7f5f69985640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5f64153f30 0x7f5f6406bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56794/0 (socket says 172.21.15.160:56794) 2024-02-17T12:57:29.268 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.277+0000 7f5f69985640 1 -- 172.21.15.160:0/1030792136 learned_addr learned my addr 172.21.15.160:0/1030792136 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-02-17T12:57:29.268 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.277+0000 7f5f69184640 1 --2- 172.21.15.160:0/1030792136 >> v2:172.21.15.136:3300/0 conn(0x7f5f6406aac0 0x7f5f6415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.280+0000 7f5f68983640 1 -- 172.21.15.160:0/1030792136 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812577070 0 0) 0x7f5f640c7fe0 con 0x7f5f64153f30 2024-02-17T12:57:29.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.280+0000 7f5f68983640 1 -- 172.21.15.160:0/1030792136 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f50003520 con 0x7f5f64153f30 2024-02-17T12:57:29.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.281+0000 7f5f69184640 1 -- 172.21.15.160:0/1030792136 >> v1:172.21.15.160:6789/0 conn(0x7f5f64153f30 legacy=0x7f5f6406bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.281+0000 7f5f69184640 1 -- 172.21.15.160:0/1030792136 >> v1:172.21.15.136:6789/0 conn(0x7f5f640c6e10 legacy=0x7f5f641645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.281+0000 7f5f69184640 1 -- 172.21.15.160:0/1030792136 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640c82c0 con 0x7f5f6406aac0 2024-02-17T12:57:29.276 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.286+0000 7f5f69184640 1 --2- 172.21.15.160:0/1030792136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6406aac0 0x7f5f6415d210 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5f600097a0 tx=0x7f5f6002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0adcb95e176ca6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:29.280 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.290+0000 7f5f68983640 1 -- 172.21.15.160:0/1030792136 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6002f810 con 0x7f5f6406aac0 2024-02-17T12:57:29.280 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.290+0000 7f5f68983640 1 -- 172.21.15.160:0/1030792136 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6002f970 con 0x7f5f6406aac0 2024-02-17T12:57:29.280 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.290+0000 7f5f68983640 1 -- 172.21.15.160:0/1030792136 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6002fd00 con 0x7f5f6406aac0 2024-02-17T12:57:29.281 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/1030792136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6406aac0 msgr2=0x7f5f6415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.281 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 --2- 172.21.15.160:0/1030792136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6406aac0 0x7f5f6415d210 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5f600097a0 tx=0x7f5f6002b9f0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.281 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/1030792136 shutdown_connections 2024-02-17T12:57:29.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 --2- 172.21.15.160:0/1030792136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6406aac0 0x7f5f6415d210 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/1030792136 >> 172.21.15.160:0/1030792136 conn(0x7f5f6406d9b0 msgr2=0x7f5f6406dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:29.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/1030792136 shutdown_connections 2024-02-17T12:57:29.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.291+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/1030792136 wait complete. 2024-02-17T12:57:29.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.292+0000 7f5f6bbe9640 1 Processor -- start 2024-02-17T12:57:29.282 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.292+0000 7f5f6bbe9640 1 -- start start 2024-02-17T12:57:29.283 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f6bbe9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f6406aac0 0x7f5f64145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f6bbe9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 0x7f5f64146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f6bbe9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f64153f30 0x7f5f641f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f6bbe9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641568a0 con 0x7f5f640c6e10 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f6bbe9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641f3d40 con 0x7f5f6406aac0 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f6bbe9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641562e0 con 0x7f5f64153f30 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f69985640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f6406aac0 0x7f5f64145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.293+0000 7f5f69184640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 0x7f5f64146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.285 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.294+0000 7f5f6a186640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f64153f30 0x7f5f641f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.285 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.294+0000 7f5f69184640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 0x7f5f64146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.160:44066/0 (socket says 172.21.15.160:44066) 2024-02-17T12:57:29.285 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.294+0000 7f5f69184640 1 -- 172.21.15.160:0/2610303575 learned_addr learned my addr 172.21.15.160:0/2610303575 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:29.287 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.297+0000 7f5f69184640 1 -- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f64153f30 msgr2=0x7f5f641f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.288 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.297+0000 7f5f69184640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f64153f30 0x7f5f641f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.288 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.297+0000 7f5f69184640 1 -- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f6406aac0 msgr2=0x7f5f64145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.288 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.297+0000 7f5f69184640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f6406aac0 0x7f5f64145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.288 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.297+0000 7f5f69184640 1 -- 172.21.15.160:0/2610303575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f60009400 con 0x7f5f640c6e10 2024-02-17T12:57:29.288 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.297+0000 7f5f69985640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f6406aac0 0x7f5f64145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:57:29.290 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.299+0000 7f5f69184640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 0x7f5f64146220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f6002c000 tx=0x7f5f60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:29.293 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.303+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6003c040 con 0x7f5f640c6e10 2024-02-17T12:57:29.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.303+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f600378f0 con 0x7f5f640c6e10 2024-02-17T12:57:29.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.303+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60037ca0 con 0x7f5f640c6e10 2024-02-17T12:57:29.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.303+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f641565c0 con 0x7f5f640c6e10 2024-02-17T12:57:29.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.303+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6414acd0 con 0x7f5f640c6e10 2024-02-17T12:57:29.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.304+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f64159500 con 0x7f5f640c6e10 2024-02-17T12:57:29.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.321+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5f6004c440 con 0x7f5f640c6e10 2024-02-17T12:57:29.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.321+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5f60042850 con 0x7f5f640c6e10 2024-02-17T12:57:29.426 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.435+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5f60047070 con 0x7f5f640c6e10 2024-02-17T12:57:29.498 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.508+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f774ae8-2987-46e0-9b10-c2c14d5442c9", "id": 0} v 0) v1 -- 0x7f5f640c61d0 con 0x7f5f640c6e10 2024-02-17T12:57:29.588 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.598+0000 7f5f5a7fc640 1 -- 172.21.15.160:0/2610303575 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f774ae8-2987-46e0-9b10-c2c14d5442c9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f60042b30 con 0x7f5f640c6e10 2024-02-17T12:57:29.589 INFO:teuthology.orchestra.run.smithi160.stdout:0 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 msgr2=0x7f5f64146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 0x7f5f64146220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f6002c000 tx=0x7f5f60004730 comp rx=0 tx=0).stop 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 shutdown_connections 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f64153f30 0x7f5f641f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f640c6e10 0x7f5f64146220 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 --2- 172.21.15.160:0/2610303575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f6406aac0 0x7f5f64145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 >> 172.21.15.160:0/2610303575 conn(0x7f5f6406d9b0 msgr2=0x7f5f640c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 shutdown_connections 2024-02-17T12:57:29.590 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.599+0000 7f5f6bbe9640 1 -- 172.21.15.160:0/2610303575 wait complete. 2024-02-17T12:57:29.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new c3dbadd8-3f4d-43c1-a5fa-47b120dbd796 1 2024-02-17T12:57:29.677 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:29.687+0000 7f9371a13040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T12:57:29.728 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:29.708+0000 7efc1a241040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.713+0000 7fae21525640 1 Processor -- start 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.713+0000 7fae21525640 1 -- start start 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.714+0000 7fae21525640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c159f80 0x7fae1c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.714+0000 7fae21525640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c154310 con 0x7fae1c153f30 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.714+0000 7fae21525640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c15d2c0 con 0x7fae1c0c44e0 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.714+0000 7fae21525640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c15a8f0 con 0x7fae1c159f80 2024-02-17T12:57:29.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.715+0000 7fae1a7fc640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fae1c0c44e0 0x7fae1c0ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:36832/0 (socket says 172.21.15.160:36832) 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.715+0000 7fae1a7fc640 1 -- 172.21.15.160:0/128269462 learned_addr learned my addr 172.21.15.160:0/128269462 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.715+0000 7fae1b7fe640 1 --2- 172.21.15.160:0/128269462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c159f80 0x7fae1c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.717+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203394257 0 0) 0x7fae1c15d2c0 con 0x7fae1c0c44e0 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.717+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae04003520 con 0x7fae1c0c44e0 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.718+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191541715 0 0) 0x7fae1c154310 con 0x7fae1c153f30 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.718+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae1c15d2c0 con 0x7fae1c153f30 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.718+0000 7fae1b7fe640 1 -- 172.21.15.160:0/128269462 >> v1:172.21.15.160:6789/0 conn(0x7fae1c0c44e0 legacy=0x7fae1c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.718+0000 7fae1b7fe640 1 -- 172.21.15.160:0/128269462 >> v1:172.21.15.136:6789/0 conn(0x7fae1c153f30 legacy=0x7fae1c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.718+0000 7fae1b7fe640 1 -- 172.21.15.160:0/128269462 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c15d560 con 0x7fae1c159f80 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.720+0000 7fae1b7fe640 1 --2- 172.21.15.160:0/128269462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c159f80 0x7fae1c15a3b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae14009dc0 tx=0x7fae1402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0b6da5a06b696b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.724+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1402cc40 con 0x7fae1c159f80 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.727+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1402cda0 con 0x7fae1c159f80 2024-02-17T12:57:29.734 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.727+0000 7fae19ffb640 1 -- 172.21.15.160:0/128269462 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14034640 con 0x7fae1c159f80 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.727+0000 7fae21525640 1 -- 172.21.15.160:0/128269462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c159f80 msgr2=0x7fae1c15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.727+0000 7fae21525640 1 --2- 172.21.15.160:0/128269462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c159f80 0x7fae1c15a3b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae14009dc0 tx=0x7fae1402be90 comp rx=0 tx=0).stop 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.728+0000 7fae21525640 1 -- 172.21.15.160:0/128269462 shutdown_connections 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.728+0000 7fae21525640 1 --2- 172.21.15.160:0/128269462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c159f80 0x7fae1c15a3b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.728+0000 7fae21525640 1 -- 172.21.15.160:0/128269462 >> 172.21.15.160:0/128269462 conn(0x7fae1c0721f0 msgr2=0x7fae1c072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.728+0000 7fae21525640 1 -- 172.21.15.160:0/128269462 shutdown_connections 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.728+0000 7fae21525640 1 -- 172.21.15.160:0/128269462 wait complete. 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.730+0000 7fae21525640 1 Processor -- start 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.730+0000 7fae21525640 1 -- start start 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae21525640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c0c44e0 0x7fae1c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae21525640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1c153f30 0x7fae1c0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae21525640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c159f80 0x7fae1c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:29.735 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae21525640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c155ca0 con 0x7fae1c159f80 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae21525640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c157e70 con 0x7fae1c153f30 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae21525640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c158150 con 0x7fae1c0c44e0 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae1b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c159f80 0x7fae1c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae1affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c0c44e0 0x7fae1c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.731+0000 7fae1a7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1c153f30 0x7fae1c0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.732+0000 7fae1affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c0c44e0 0x7fae1c1577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50000/0 (socket says 172.21.15.160:50000) 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.732+0000 7fae1affd640 1 -- 172.21.15.160:0/3125327217 learned_addr learned my addr 172.21.15.160:0/3125327217 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.735+0000 7fae1b7fe640 1 -- 172.21.15.160:0/3125327217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c0c44e0 msgr2=0x7fae1c1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.735+0000 7fae1b7fe640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c0c44e0 0x7fae1c1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.735+0000 7fae1b7fe640 1 -- 172.21.15.160:0/3125327217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1c153f30 msgr2=0x7fae1c0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.735+0000 7fae1b7fe640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1c153f30 0x7fae1c0ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.735+0000 7fae1b7fe640 1 -- 172.21.15.160:0/3125327217 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009a70 con 0x7fae1c159f80 2024-02-17T12:57:29.736 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.738+0000 7fae1b7fe640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c159f80 0x7fae1c156620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae14033000 tx=0x7fae14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:29.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.740+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14004880 con 0x7fae1c159f80 2024-02-17T12:57:29.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.740+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c158430 con 0x7fae1c159f80 2024-02-17T12:57:29.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.740+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c156100 con 0x7fae1c159f80 2024-02-17T12:57:29.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.741+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c158950 con 0x7fae1c159f80 2024-02-17T12:57:29.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.742+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14009450 con 0x7fae1c159f80 2024-02-17T12:57:29.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.742+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14051680 con 0x7fae1c159f80 2024-02-17T12:57:29.737 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:29.743+0000 7f9371a13040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T12:57:29.760 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:29.770+0000 7efc1a241040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T12:57:29.842 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.851+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fae140518e0 con 0x7fae1c159f80 2024-02-17T12:57:29.842 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.851+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fae14047d20 con 0x7fae1c159f80 2024-02-17T12:57:29.846 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.855+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fae1c158950 con 0x7fae1c159f80 2024-02-17T12:57:29.920 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.930+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3dbadd8-3f4d-43c1-a5fa-47b120dbd796", "id": 1} v 0) v1 -- 0x7fae1c155f60 con 0x7fae1c159f80 2024-02-17T12:57:29.964 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.973+0000 7fae037fe640 1 -- 172.21.15.160:0/3125327217 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3dbadd8-3f4d-43c1-a5fa-47b120dbd796", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae1c155f60 con 0x7fae1c159f80 2024-02-17T12:57:29.964 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c159f80 msgr2=0x7fae1c156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c159f80 0x7fae1c156620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae14033000 tx=0x7fae14004a40 comp rx=0 tx=0).stop 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 shutdown_connections 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae1c159f80 0x7fae1c156620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1c153f30 0x7fae1c0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 --2- 172.21.15.160:0/3125327217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae1c0c44e0 0x7fae1c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:29.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 >> 172.21.15.160:0/3125327217 conn(0x7fae1c0721f0 msgr2=0x7fae1c0c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:29.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 shutdown_connections 2024-02-17T12:57:29.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:29.974+0000 7fae21525640 1 -- 172.21.15.160:0/3125327217 wait complete. 2024-02-17T12:57:29.976 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 7ea6cb6c-a52f-45c2-ae7a-532098a3a115 2 2024-02-17T12:57:30.077 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.086+0000 7f5b5c076640 1 Processor -- start 2024-02-17T12:57:30.077 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.087+0000 7f5b5c076640 1 -- start start 2024-02-17T12:57:30.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.088+0000 7f5b5c076640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b54150ae0 0x7f5b540c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.088+0000 7f5b5c076640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b54072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.088+0000 7f5b5c076640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5b5406f8e0 0x7f5b5406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.088+0000 7f5b5c076640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54072da0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.088+0000 7f5b5c076640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5406f450 con 0x7f5b54150ae0 2024-02-17T12:57:30.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.088+0000 7f5b5c076640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54070270 con 0x7f5b54071dd0 2024-02-17T12:57:30.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.089+0000 7f5b59e12640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b54150ae0 0x7f5b540c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.080 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.089+0000 7f5b59611640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b54072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.080 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.089+0000 7f5b5a613640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5b5406f8e0 0x7f5b5406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.080 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.089+0000 7f5b59e12640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b54150ae0 0x7f5b540c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:34818/0 (socket says 172.21.15.160:34818) 2024-02-17T12:57:30.080 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.089+0000 7f5b59e12640 1 -- 172.21.15.160:0/3266616940 learned_addr learned my addr 172.21.15.160:0/3266616940 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:30.081 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.091+0000 7f5b5a613640 1 -- 172.21.15.160:0/3266616940 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 msgr2=0x7f5b54072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:30.081 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.091+0000 7f5b5a613640 1 --2- 172.21.15.160:0/3266616940 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b54072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.082 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.091+0000 7f5b5a613640 1 -- 172.21.15.160:0/3266616940 >> v2:172.21.15.160:3300/0 conn(0x7f5b54150ae0 msgr2=0x7f5b540c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:30.082 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.091+0000 7f5b5a613640 1 --2- 172.21.15.160:0/3266616940 >> v2:172.21.15.160:3300/0 conn(0x7f5b54150ae0 0x7f5b540c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.082 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.091+0000 7f5b5a613640 1 -- 172.21.15.160:0/3266616940 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54159de0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.083 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.093+0000 7f5b5a613640 1 --2- 172.21.15.160:0/3266616940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b5406fd30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b5406d910 tx=0x7f5b4c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2783dbd1659a6ae4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:30.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b58e10640 1 -- 172.21.15.160:0/3266616940 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c02cc60 con 0x7f5b5406f8e0 2024-02-17T12:57:30.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b58e10640 1 -- 172.21.15.160:0/3266616940 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c02cdc0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b58e10640 1 -- 172.21.15.160:0/3266616940 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c034660 con 0x7f5b5406f8e0 2024-02-17T12:57:30.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 -- 172.21.15.160:0/3266616940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 msgr2=0x7f5b5406fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 --2- 172.21.15.160:0/3266616940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b5406fd30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b5406d910 tx=0x7f5b4c02beb0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 -- 172.21.15.160:0/3266616940 shutdown_connections 2024-02-17T12:57:30.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 --2- 172.21.15.160:0/3266616940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b5406fd30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 --2- 172.21.15.160:0/3266616940 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b54072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 --2- 172.21.15.160:0/3266616940 >> v2:172.21.15.160:3300/0 conn(0x7f5b54150ae0 0x7f5b540c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 -- 172.21.15.160:0/3266616940 >> 172.21.15.160:0/3266616940 conn(0x7f5b5406bbd0 msgr2=0x7f5b5406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:30.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.097+0000 7f5b5c076640 1 -- 172.21.15.160:0/3266616940 shutdown_connections 2024-02-17T12:57:30.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.098+0000 7f5b5c076640 1 -- 172.21.15.160:0/3266616940 wait complete. 2024-02-17T12:57:30.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 Processor -- start 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 -- start start 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b54156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b541eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b54150ae0 0x7f5b540c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b541406f0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540c6fd0 con 0x7f5b54150ae0 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.099+0000 7f5b5c076640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54158730 con 0x7f5b54071dd0 2024-02-17T12:57:30.094 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.100+0000 7f5b59e12640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b54156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.095 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.100+0000 7f5b5a613640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b54150ae0 0x7f5b540c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.095 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.100+0000 7f5b59611640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b541eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.095 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.100+0000 7f5b59e12640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b54156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.160:53038/0 (socket says 172.21.15.160:53038) 2024-02-17T12:57:30.095 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.100+0000 7f5b59e12640 1 -- 172.21.15.160:0/4134427607 learned_addr learned my addr 172.21.15.160:0/4134427607 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:30.096 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.104+0000 7f5b59e12640 1 -- 172.21.15.160:0/4134427607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 msgr2=0x7f5b541eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.096 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.104+0000 7f5b59e12640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b541eeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.096 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.104+0000 7f5b59e12640 1 -- 172.21.15.160:0/4134427607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b54150ae0 msgr2=0x7f5b540c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.096 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.104+0000 7f5b59e12640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b54150ae0 0x7f5b540c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.096 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.104+0000 7f5b59e12640 1 -- 172.21.15.160:0/4134427607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c009a70 con 0x7f5b5406f8e0 2024-02-17T12:57:30.097 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.106+0000 7f5b59e12640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b54156cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000e840 tx=0x7f5b5000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:30.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.113+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000c8e0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.113+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5000ca40 con 0x7f5b5406f8e0 2024-02-17T12:57:30.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.113+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000cdf0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.113+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b541ef440 con 0x7f5b5406f8e0 2024-02-17T12:57:30.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.113+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b54158c90 con 0x7f5b5406f8e0 2024-02-17T12:57:30.104 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.114+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5404efc0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.106 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.116+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5b50005990 con 0x7f5b5406f8e0 2024-02-17T12:57:30.106 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.116+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5b500067d0 con 0x7f5b5406f8e0 2024-02-17T12:57:30.204 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.214+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5b50021060 con 0x7f5b5406f8e0 2024-02-17T12:57:30.274 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.284+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ea6cb6c-a52f-45c2-ae7a-532098a3a115", "id": 2} v 0) v1 -- 0x7f5b54072960 con 0x7f5b5406f8e0 2024-02-17T12:57:30.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.315+0000 7f5b4a7fc640 1 -- 172.21.15.160:0/4134427607 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ea6cb6c-a52f-45c2-ae7a-532098a3a115", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b50017070 con 0x7f5b5406f8e0 2024-02-17T12:57:30.305 INFO:teuthology.orchestra.run.smithi160.stdout:2 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 msgr2=0x7f5b54156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b54156cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000e840 tx=0x7f5b5000ed00 comp rx=0 tx=0).stop 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 shutdown_connections 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b54150ae0 0x7f5b540c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b54071dd0 0x7f5b541eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 --2- 172.21.15.160:0/4134427607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b5406f8e0 0x7f5b54156cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 >> 172.21.15.160:0/4134427607 conn(0x7f5b5406bbd0 msgr2=0x7f5b540ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 shutdown_connections 2024-02-17T12:57:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.316+0000 7f5b5c076640 1 -- 172.21.15.160:0/4134427607 wait complete. 2024-02-17T12:57:30.316 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.325+0000 7f9371a13040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T12:57:30.317 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 92e03913-22f0-4e92-9327-711ad4e7b29e 3 2024-02-17T12:57:30.347 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.357+0000 7efc1a241040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T12:57:30.372 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.382+0000 7f9371a13040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T12:57:30.403 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.413+0000 7efc1a241040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T12:57:30.416 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.426+0000 7f9371a13040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T12:57:30.418 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.428+0000 7f97e4b56640 1 Processor -- start 2024-02-17T12:57:30.418 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.428+0000 7f97e4b56640 1 -- start start 2024-02-17T12:57:30.419 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97e4b56640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e00c5d20 0x7f97e00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.419 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97e4b56640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e00c6da0 con 0x7f97e00c6100 2024-02-17T12:57:30.419 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97e4b56640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e00c7640 con 0x7f97e006aac0 2024-02-17T12:57:30.419 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97e4b56640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e006afb0 con 0x7f97e00c5d20 2024-02-17T12:57:30.420 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97ded9d640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f97e006aac0 0x7f97e0157c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:36846/0 (socket says 172.21.15.160:36846) 2024-02-17T12:57:30.420 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97ded9d640 1 -- 172.21.15.160:0/2091542231 learned_addr learned my addr 172.21.15.160:0/2091542231 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-02-17T12:57:30.420 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.429+0000 7f97de59c640 1 --2- 172.21.15.160:0/2091542231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e00c5d20 0x7f97e00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875502589 0 0) 0x7f97e00c7640 con 0x7f97e006aac0 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c8003520 con 0x7f97e006aac0 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959556563 0 0) 0x7f97e00c6da0 con 0x7f97e00c6100 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e00c7640 con 0x7f97e00c6100 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97de59c640 1 -- 172.21.15.160:0/2091542231 >> v1:172.21.15.160:6789/0 conn(0x7f97e006aac0 legacy=0x7f97e0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97de59c640 1 -- 172.21.15.160:0/2091542231 >> v1:172.21.15.136:6789/0 conn(0x7f97e00c6100 legacy=0x7f97e01518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.423 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.432+0000 7f97de59c640 1 -- 172.21.15.160:0/2091542231 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e006b290 con 0x7f97e00c5d20 2024-02-17T12:57:30.424 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.434+0000 7f97de59c640 1 --2- 172.21.15.160:0/2091542231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e00c5d20 0x7f97e00c85b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97d00097d0 tx=0x7f97d002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834024ca43605290 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:30.427 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.437+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0031890 con 0x7f97e00c5d20 2024-02-17T12:57:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.440+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d00319f0 con 0x7f97e00c5d20 2024-02-17T12:57:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.440+0000 7f97dd59a640 1 -- 172.21.15.160:0/2091542231 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0031d60 con 0x7f97e00c5d20 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.440+0000 7f97e4b56640 1 -- 172.21.15.160:0/2091542231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e00c5d20 msgr2=0x7f97e00c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.440+0000 7f97e4b56640 1 --2- 172.21.15.160:0/2091542231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e00c5d20 0x7f97e00c85b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97d00097d0 tx=0x7f97d002b930 comp rx=0 tx=0).stop 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.441+0000 7f97e4b56640 1 -- 172.21.15.160:0/2091542231 shutdown_connections 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.441+0000 7f97e4b56640 1 --2- 172.21.15.160:0/2091542231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e00c5d20 0x7f97e00c85b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.441+0000 7f97e4b56640 1 -- 172.21.15.160:0/2091542231 >> 172.21.15.160:0/2091542231 conn(0x7f97e0071a20 msgr2=0x7f97e0071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.441+0000 7f97e4b56640 1 -- 172.21.15.160:0/2091542231 shutdown_connections 2024-02-17T12:57:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.441+0000 7f97e4b56640 1 -- 172.21.15.160:0/2091542231 wait complete. 2024-02-17T12:57:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.442+0000 7f97e4b56640 1 Processor -- start 2024-02-17T12:57:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.442+0000 7f97e4b56640 1 -- start start 2024-02-17T12:57:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97e4b56640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e006aac0 0x7f97e01e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97e4b56640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e00c5d20 0x7f97e00c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97e4b56640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e00c6100 0x7f97e01e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97e4b56640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00c3cc0 con 0x7f97e00c6100 2024-02-17T12:57:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97e4b56640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00c48f0 con 0x7f97e00c5d20 2024-02-17T12:57:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97e4b56640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01e2d60 con 0x7f97e006aac0 2024-02-17T12:57:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.443+0000 7f97de59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e006aac0 0x7f97e01e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.444+0000 7f97ddd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e00c5d20 0x7f97e00c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.444+0000 7f97de59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e006aac0 0x7f97e01e34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50034/0 (socket says 172.21.15.160:50034) 2024-02-17T12:57:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.444+0000 7f97de59c640 1 -- 172.21.15.160:0/583079166 learned_addr learned my addr 172.21.15.160:0/583079166 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:30.435 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.445+0000 7f97ded9d640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e00c6100 0x7f97e01e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.437 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.447+0000 7f97ddd9b640 1 -- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e006aac0 msgr2=0x7f97e01e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.447+0000 7f97ddd9b640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e006aac0 0x7f97e01e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.447+0000 7f97ddd9b640 1 -- 172.21.15.160:0/583079166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e00c6100 msgr2=0x7f97e01e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.447+0000 7f97ddd9b640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e00c6100 0x7f97e01e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.447+0000 7f97ddd9b640 1 -- 172.21.15.160:0/583079166 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0009400 con 0x7f97e00c5d20 2024-02-17T12:57:30.440 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.450+0000 7f97ddd9b640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e00c5d20 0x7f97e00c5250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c3c0 tx=0x7f97d400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:30.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.453+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d40052d0 con 0x7f97e00c5d20 2024-02-17T12:57:30.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.453+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4005450 con 0x7f97e00c5d20 2024-02-17T12:57:30.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.453+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e00c8c70 con 0x7f97e00c5d20 2024-02-17T12:57:30.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.453+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4003830 con 0x7f97e00c5d20 2024-02-17T12:57:30.447 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.454+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e00c34e0 con 0x7f97e00c5d20 2024-02-17T12:57:30.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.455+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e0150fa0 con 0x7f97e00c5d20 2024-02-17T12:57:30.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.461+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f97d4003990 con 0x7f97e00c5d20 2024-02-17T12:57:30.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.461+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f97d401c8d0 con 0x7f97e00c5d20 2024-02-17T12:57:30.454 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.464+0000 7efc1a241040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T12:57:30.474 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.483+0000 7f9371a13040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T12:57:30.507 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.517+0000 7efc1a241040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T12:57:30.516 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.526+0000 7f9371a13040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T12:57:30.550 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.560+0000 7efc1a241040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T12:57:30.618 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.627+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f97d4017070 con 0x7f97e00c5d20 2024-02-17T12:57:30.630 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.640+0000 7f9371a13040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-17T12:57:30.667 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.677+0000 7efc1a241040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-17T12:57:30.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.698+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92e03913-22f0-4e92-9327-711ad4e7b29e", "id": 3} v 0) v1 -- 0x7f97e006fb90 con 0x7f97e00c5d20 2024-02-17T12:57:30.699 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.709+0000 7f9371a13040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T12:57:30.737 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.747+0000 7efc1a241040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T12:57:30.748 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.757+0000 7f9371a13040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T12:57:30.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.805+0000 7f97ceffd640 1 -- 172.21.15.160:0/583079166 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92e03913-22f0-4e92-9327-711ad4e7b29e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97d4003c40 con 0x7f97e00c5d20 2024-02-17T12:57:30.795 INFO:teuthology.orchestra.run.smithi160.stdout:3 2024-02-17T12:57:30.796 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e00c5d20 msgr2=0x7f97e00c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e00c5d20 0x7f97e00c5250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c3c0 tx=0x7f97d400c880 comp rx=0 tx=0).stop 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 shutdown_connections 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e00c6100 0x7f97e01e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e00c5d20 0x7f97e00c5250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 --2- 172.21.15.160:0/583079166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e006aac0 0x7f97e01e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 >> 172.21.15.160:0/583079166 conn(0x7f97e0071a20 msgr2=0x7f97e014aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 shutdown_connections 2024-02-17T12:57:30.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.806+0000 7f97e4b56640 1 -- 172.21.15.160:0/583079166 wait complete. 2024-02-17T12:57:30.803 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.813+0000 7efc1a241040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T12:57:30.806 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.815+0000 7f9371a13040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T12:57:30.807 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 602635ff-e07f-4b21-91d9-7cb4deb4393b 4 2024-02-17T12:57:30.852 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:30.862+0000 7f9371a13040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T12:57:30.859 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.869+0000 7efc1a241040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T12:57:30.928 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:30.938+0000 7efc1a241040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T12:57:30.954 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.964+0000 7fa1fc6eb640 1 Processor -- start 2024-02-17T12:57:30.954 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.964+0000 7fa1fc6eb640 1 -- start start 2024-02-17T12:57:30.955 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fc6eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.955 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fc6eb640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f40c8340 con 0x7fa1f40c4420 2024-02-17T12:57:30.955 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fc6eb640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f40c94d0 con 0x7fa1f40c9750 2024-02-17T12:57:30.955 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fc6eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40c9c00 con 0x7fa1f4151e20 2024-02-17T12:57:30.956 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fa487640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.956 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fac88640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa1f40c9750 0x7fa1f4070720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:36850/0 (socket says 172.21.15.160:36850) 2024-02-17T12:57:30.956 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1fac88640 1 -- 172.21.15.160:0/753414378 learned_addr learned my addr 172.21.15.160:0/753414378 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-02-17T12:57:30.956 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.965+0000 7fa1f9c86640 1 --1- 172.21.15.160:0/753414378 >> v1:172.21.15.136:6789/0 conn(0x7fa1f40c4420 0x7fa1f40c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.160:36368/0 (socket says 172.21.15.160:36368) 2024-02-17T12:57:30.958 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.968+0000 7fa1f9485640 1 -- 172.21.15.160:0/753414378 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856032431 0 0) 0x7fa1f40c94d0 con 0x7fa1f40c9750 2024-02-17T12:57:30.959 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.968+0000 7fa1f9485640 1 -- 172.21.15.160:0/753414378 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e0003520 con 0x7fa1f40c9750 2024-02-17T12:57:30.959 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.968+0000 7fa1fa487640 1 -- 172.21.15.160:0/753414378 >> v1:172.21.15.160:6789/0 conn(0x7fa1f40c9750 legacy=0x7fa1f4070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.959 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.968+0000 7fa1fa487640 1 -- 172.21.15.160:0/753414378 >> v1:172.21.15.136:6789/0 conn(0x7fa1f40c4420 legacy=0x7fa1f40c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.959 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.968+0000 7fa1f9485640 1 -- 172.21.15.160:0/753414378 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491890796 0 0) 0x7fa1f40c8340 con 0x7fa1f40c4420 2024-02-17T12:57:30.959 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.968+0000 7fa1fa487640 1 -- 172.21.15.160:0/753414378 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40ca5b0 con 0x7fa1f4151e20 2024-02-17T12:57:30.960 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.970+0000 7fa1fa487640 1 --2- 172.21.15.160:0/753414378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f40c8760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009dc0 tx=0x7fa1f002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8dcba8ce350dee server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:30.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1f9485640 1 -- 172.21.15.160:0/753414378 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002ccd0 con 0x7fa1f4151e20 2024-02-17T12:57:30.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1f9485640 1 -- 172.21.15.160:0/753414378 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f002ce30 con 0x7fa1f4151e20 2024-02-17T12:57:30.965 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1f9485640 1 -- 172.21.15.160:0/753414378 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0034660 con 0x7fa1f4151e20 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/753414378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 msgr2=0x7fa1f40c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1fc6eb640 1 --2- 172.21.15.160:0/753414378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f40c8760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009dc0 tx=0x7fa1f002bf20 comp rx=0 tx=0).stop 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/753414378 shutdown_connections 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1fc6eb640 1 --2- 172.21.15.160:0/753414378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f40c8760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.975+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/753414378 >> 172.21.15.160:0/753414378 conn(0x7fa1f406fe80 msgr2=0x7fa1f406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.976+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/753414378 shutdown_connections 2024-02-17T12:57:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.976+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/753414378 wait complete. 2024-02-17T12:57:30.967 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.977+0000 7fa1fc6eb640 1 Processor -- start 2024-02-17T12:57:30.967 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.977+0000 7fa1fc6eb640 1 -- start start 2024-02-17T12:57:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fc6eb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 0x7fa1f414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fc6eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40c9750 0x7fa1f4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fc6eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f41498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fc6eb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4149350 con 0x7fa1f40c4420 2024-02-17T12:57:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fc6eb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41554a0 con 0x7fa1f40c9750 2024-02-17T12:57:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fc6eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4147d10 con 0x7fa1f4151e20 2024-02-17T12:57:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fa487640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 0x7fa1f414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1fac88640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f41498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.978+0000 7fa1f9c86640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40c9750 0x7fa1f4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.979+0000 7fa1fa487640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 0x7fa1f414a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.160:53062/0 (socket says 172.21.15.160:53062) 2024-02-17T12:57:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.979+0000 7fa1fa487640 1 -- 172.21.15.160:0/3223331564 learned_addr learned my addr 172.21.15.160:0/3223331564 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:30.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.982+0000 7fa1fa487640 1 -- 172.21.15.160:0/3223331564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 msgr2=0x7fa1f41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.982+0000 7fa1fa487640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f41498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.982+0000 7fa1fa487640 1 -- 172.21.15.160:0/3223331564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40c9750 msgr2=0x7fa1f4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:30.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.982+0000 7fa1fa487640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40c9750 0x7fa1f4154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:30.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.982+0000 7fa1fa487640 1 -- 172.21.15.160:0/3223331564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0009a70 con 0x7fa1f40c4420 2024-02-17T12:57:30.976 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.985+0000 7fa1fa487640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 0x7fa1f414a3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0037040 tx=0x7fa1f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.989+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0003b90 con 0x7fa1f40c4420 2024-02-17T12:57:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.989+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0003cf0 con 0x7fa1f40c4420 2024-02-17T12:57:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.989+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f40c6f80 con 0x7fa1f40c4420 2024-02-17T12:57:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.989+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0004270 con 0x7fa1f40c4420 2024-02-17T12:57:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.990+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f40c7540 con 0x7fa1f40c4420 2024-02-17T12:57:30.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.990+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4067e00 con 0x7fa1f40c4420 2024-02-17T12:57:30.983 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.993+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa1f003b040 con 0x7fa1f40c4420 2024-02-17T12:57:30.983 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:30.993+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa1f0051c10 con 0x7fa1f40c4420 2024-02-17T12:57:31.083 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.093+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa1f0039070 con 0x7fa1f40c4420 2024-02-17T12:57:31.154 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.164+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "602635ff-e07f-4b21-91d9-7cb4deb4393b", "id": 4} v 0) v1 -- 0x7fa1f414d600 con 0x7fa1f40c4420 2024-02-17T12:57:31.187 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.197+0000 7fa1eaffd640 1 -- 172.21.15.160:0/3223331564 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "602635ff-e07f-4b21-91d9-7cb4deb4393b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa1f0051dd0 con 0x7fa1f40c4420 2024-02-17T12:57:31.187 INFO:teuthology.orchestra.run.smithi160.stdout:4 2024-02-17T12:57:31.188 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 msgr2=0x7fa1f414a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.188 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 0x7fa1f414a3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0037040 tx=0x7fa1f0004a40 comp rx=0 tx=0).stop 2024-02-17T12:57:31.188 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 shutdown_connections 2024-02-17T12:57:31.189 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f4151e20 0x7fa1f41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.189 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40c9750 0x7fa1f4154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.189 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 --2- 172.21.15.160:0/3223331564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1f40c4420 0x7fa1f414a3e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.189 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 >> 172.21.15.160:0/3223331564 conn(0x7fa1f406fe80 msgr2=0x7fa1f40c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:31.189 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 shutdown_connections 2024-02-17T12:57:31.189 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.198+0000 7fa1fc6eb640 1 -- 172.21.15.160:0/3223331564 wait complete. 2024-02-17T12:57:31.200 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new efce6b38-3669-432d-ae70-f38d5454e2c3 5 2024-02-17T12:57:31.254 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.264+0000 7f9371a13040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T12:57:31.321 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:31.331+0000 7efc1a241040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T12:57:31.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.351+0000 7fbddc288640 1 Processor -- start 2024-02-17T12:57:31.341 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.351+0000 7fbddc288640 1 -- start start 2024-02-17T12:57:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbddc288640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbdd40ca560 0x7fbdd415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbddc288640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbdd415a770 0x7fbdd406c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbddc288640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40afc80 con 0x7fbdd40af8a0 2024-02-17T12:57:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbddc288640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd415d8f0 con 0x7fbdd40ca560 2024-02-17T12:57:31.342 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbddc288640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd415e150 con 0x7fbdd415a770 2024-02-17T12:57:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbdda825640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbdd415a770 0x7fbdd406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.352+0000 7fbdd9823640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbdd40ca560 0x7fbdd415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.353+0000 7fbdd9823640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbdd40ca560 0x7fbdd415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.160:53068/0 (socket says 172.21.15.160:53068) 2024-02-17T12:57:31.343 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.353+0000 7fbdd9823640 1 -- 172.21.15.160:0/3163928294 learned_addr learned my addr 172.21.15.160:0/3163928294 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:31.345 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.355+0000 7fbdd9823640 1 -- 172.21.15.160:0/3163928294 >> v2:172.21.15.160:3300/0 conn(0x7fbdd415a770 msgr2=0x7fbdd406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.355+0000 7fbdd9823640 1 --2- 172.21.15.160:0/3163928294 >> v2:172.21.15.160:3300/0 conn(0x7fbdd415a770 0x7fbdd406c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.355+0000 7fbdd9823640 1 -- 172.21.15.160:0/3163928294 >> v1:172.21.15.136:6789/0 conn(0x7fbdd40af8a0 legacy=0x7fbdd40c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:31.346 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.355+0000 7fbdd9823640 1 -- 172.21.15.160:0/3163928294 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd415db90 con 0x7fbdd40ca560 2024-02-17T12:57:31.350 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.360+0000 7fbdd9823640 1 --2- 172.21.15.160:0/3163928294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd40ca560 0x7fbdd415d260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4070250 tx=0x7fbdd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4fb5d9d71b8df9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.364+0000 7fbdd9022640 1 -- 172.21.15.160:0/3163928294 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0030860 con 0x7fbdd40ca560 2024-02-17T12:57:31.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.364+0000 7fbdd9022640 1 -- 172.21.15.160:0/3163928294 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd00309c0 con 0x7fbdd40ca560 2024-02-17T12:57:31.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.364+0000 7fbdd9022640 1 -- 172.21.15.160:0/3163928294 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0030d50 con 0x7fbdd40ca560 2024-02-17T12:57:31.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 -- 172.21.15.160:0/3163928294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd40ca560 msgr2=0x7fbdd415d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 --2- 172.21.15.160:0/3163928294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd40ca560 0x7fbdd415d260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4070250 tx=0x7fbdd002b9a0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 -- 172.21.15.160:0/3163928294 shutdown_connections 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 --2- 172.21.15.160:0/3163928294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd40ca560 0x7fbdd415d260 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 --2- 172.21.15.160:0/3163928294 >> v2:172.21.15.160:3300/0 conn(0x7fbdd415a770 0x7fbdd406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 -- 172.21.15.160:0/3163928294 >> 172.21.15.160:0/3163928294 conn(0x7fbdd4070790 msgr2=0x7fbdd4070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 -- 172.21.15.160:0/3163928294 shutdown_connections 2024-02-17T12:57:31.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.365+0000 7fbddc288640 1 -- 172.21.15.160:0/3163928294 wait complete. 2024-02-17T12:57:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.366+0000 7fbddc288640 1 Processor -- start 2024-02-17T12:57:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.366+0000 7fbddc288640 1 -- start start 2024-02-17T12:57:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbddc288640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdd40af8a0 0x7fbdd41f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbddc288640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdd415a770 0x7fbdd41e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbddc288640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 0x7fbdd41e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbddc288640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40ae650 con 0x7fbdd41f31a0 2024-02-17T12:57:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbddc288640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41502d0 con 0x7fbdd40af8a0 2024-02-17T12:57:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbddc288640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41f3900 con 0x7fbdd415a770 2024-02-17T12:57:31.358 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbdda024640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdd40af8a0 0x7fbdd41f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.367+0000 7fbdda825640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 0x7fbdd41e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.368+0000 7fbdd9823640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdd415a770 0x7fbdd41e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.368+0000 7fbdda825640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 0x7fbdd41e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.160:53084/0 (socket says 172.21.15.160:53084) 2024-02-17T12:57:31.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.368+0000 7fbdda024640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdd40af8a0 0x7fbdd41f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:34862/0 (socket says 172.21.15.160:34862) 2024-02-17T12:57:31.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.368+0000 7fbdda825640 1 -- 172.21.15.160:0/1456408963 learned_addr learned my addr 172.21.15.160:0/1456408963 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:31.361 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.371+0000 7fbdda825640 1 -- 172.21.15.160:0/1456408963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdd415a770 msgr2=0x7fbdd41e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.361 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.371+0000 7fbdda825640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdd415a770 0x7fbdd41e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.362 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.371+0000 7fbdda825640 1 -- 172.21.15.160:0/1456408963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdd40af8a0 msgr2=0x7fbdd41f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.362 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.371+0000 7fbdda825640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdd40af8a0 0x7fbdd41f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.362 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.371+0000 7fbdda825640 1 -- 172.21.15.160:0/1456408963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00094d0 con 0x7fbdd41f31a0 2024-02-17T12:57:31.364 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.374+0000 7fbdda825640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 0x7fbdd41e5710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d30 tx=0x7fbdcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:31.368 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.377+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc009ba0 con 0x7fbdd41f31a0 2024-02-17T12:57:31.368 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.377+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00f040 con 0x7fbdd41f31a0 2024-02-17T12:57:31.368 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.377+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0146c0 con 0x7fbdd41f31a0 2024-02-17T12:57:31.368 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.377+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd41e4d40 con 0x7fbdd41f31a0 2024-02-17T12:57:31.368 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.377+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd41f3620 con 0x7fbdd41f31a0 2024-02-17T12:57:31.368 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.378+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd41e4ed0 con 0x7fbdd41f31a0 2024-02-17T12:57:31.370 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.380+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbdcc014bb0 con 0x7fbdd41f31a0 2024-02-17T12:57:31.371 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.380+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbdcc013960 con 0x7fbdd41f31a0 2024-02-17T12:57:31.393 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.403+0000 7f9371a13040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T12:57:31.460 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:31.470+0000 7efc1a241040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T12:57:31.471 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.481+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbdcc018020 con 0x7fbdd41f31a0 2024-02-17T12:57:31.519 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.528+0000 7f9371a13040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T12:57:31.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.552+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "efce6b38-3669-432d-ae70-f38d5454e2c3", "id": 5} v 0) v1 -- 0x7fbdd4067e00 con 0x7fbdd41f31a0 2024-02-17T12:57:31.568 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.577+0000 7f9371a13040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T12:57:31.570 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.580+0000 7fbdcaffd640 1 -- 172.21.15.160:0/1456408963 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efce6b38-3669-432d-ae70-f38d5454e2c3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbdcc013b70 con 0x7fbdd41f31a0 2024-02-17T12:57:31.570 INFO:teuthology.orchestra.run.smithi160.stdout:5 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 msgr2=0x7fbdd41e5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 0x7fbdd41e5710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d30 tx=0x7fbdcc00c490 comp rx=0 tx=0).stop 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 shutdown_connections 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbdd41f31a0 0x7fbdd41e5710 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdd415a770 0x7fbdd41e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 --2- 172.21.15.160:0/1456408963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdd40af8a0 0x7fbdd41f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 >> 172.21.15.160:0/1456408963 conn(0x7fbdd4070790 msgr2=0x7fbdd40c8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 shutdown_connections 2024-02-17T12:57:31.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.581+0000 7fbddc288640 1 -- 172.21.15.160:0/1456408963 wait complete. 2024-02-17T12:57:31.576 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:31.586+0000 7efc1a241040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T12:57:31.584 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new ce087b9b-088a-4074-9d8c-789d3ef5f7be 6 2024-02-17T12:57:31.625 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:31.635+0000 7efc1a241040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T12:57:31.684 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.693+0000 7f9371a13040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:57:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.694+0000 7fbe1f26f640 1 Processor -- start 2024-02-17T12:57:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 -- start start 2024-02-17T12:57:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbe18151da0 0x7fbe1815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 0x7fbe18157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbe180c31d0 0x7fbe1806b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe180c6c30 con 0x7fbe180c31d0 2024-02-17T12:57:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe18152180 con 0x7fbe18151da0 2024-02-17T12:57:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.695+0000 7fbe1f26f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180c6e40 con 0x7fbe180c8850 2024-02-17T12:57:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.696+0000 7fbe1c80a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 0x7fbe18157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.696+0000 7fbe1d00b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbe18151da0 0x7fbe1815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.696+0000 7fbe1d80c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbe180c31d0 0x7fbe1806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.696+0000 7fbe1c80a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 0x7fbe18157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50072/0 (socket says 172.21.15.160:50072) 2024-02-17T12:57:31.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.696+0000 7fbe1c80a640 1 -- 172.21.15.160:0/2428164504 learned_addr learned my addr 172.21.15.160:0/2428164504 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:31.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.698+0000 7fbe1c80a640 1 -- 172.21.15.160:0/2428164504 >> v2:172.21.15.160:3300/0 conn(0x7fbe18151da0 msgr2=0x7fbe1815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:31.689 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.698+0000 7fbe1c80a640 1 --2- 172.21.15.160:0/2428164504 >> v2:172.21.15.160:3300/0 conn(0x7fbe18151da0 0x7fbe1815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.689 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.698+0000 7fbe1c80a640 1 -- 172.21.15.160:0/2428164504 >> v2:172.21.15.136:3300/0 conn(0x7fbe180c31d0 msgr2=0x7fbe1806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:31.689 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.698+0000 7fbe1c80a640 1 --2- 172.21.15.160:0/2428164504 >> v2:172.21.15.136:3300/0 conn(0x7fbe180c31d0 0x7fbe1806b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.689 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.698+0000 7fbe1c80a640 1 -- 172.21.15.160:0/2428164504 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe180c7120 con 0x7fbe180c8850 2024-02-17T12:57:31.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.700+0000 7fbe1c80a640 1 --2- 172.21.15.160:0/2428164504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 0x7fbe18157990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe180c8c90 tx=0x7fbe1402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b153fcf73cd66fa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:31.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.704+0000 7fbe0bfff640 1 -- 172.21.15.160:0/2428164504 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14030860 con 0x7fbe180c8850 2024-02-17T12:57:31.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe0bfff640 1 -- 172.21.15.160:0/2428164504 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140309c0 con 0x7fbe180c8850 2024-02-17T12:57:31.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe0bfff640 1 -- 172.21.15.160:0/2428164504 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14030d50 con 0x7fbe180c8850 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 -- 172.21.15.160:0/2428164504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 msgr2=0x7fbe18157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/2428164504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 0x7fbe18157990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe180c8c90 tx=0x7fbe1402b9a0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 -- 172.21.15.160:0/2428164504 shutdown_connections 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/2428164504 >> v2:172.21.15.136:3300/0 conn(0x7fbe180c31d0 0x7fbe1806b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/2428164504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe180c8850 0x7fbe18157990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/2428164504 >> v2:172.21.15.160:3300/0 conn(0x7fbe18151da0 0x7fbe1815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 -- 172.21.15.160:0/2428164504 >> 172.21.15.160:0/2428164504 conn(0x7fbe1806bbd0 msgr2=0x7fbe1806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 -- 172.21.15.160:0/2428164504 shutdown_connections 2024-02-17T12:57:31.696 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.705+0000 7fbe1f26f640 1 -- 172.21.15.160:0/2428164504 wait complete. 2024-02-17T12:57:31.697 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 Processor -- start 2024-02-17T12:57:31.697 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 -- start start 2024-02-17T12:57:31.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe180c31d0 0x7fbe180c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe180c8850 0x7fbe1814df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe18151da0 0x7fbe1814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:31.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18151460 con 0x7fbe180c8850 2024-02-17T12:57:31.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18157300 con 0x7fbe180c31d0 2024-02-17T12:57:31.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.707+0000 7fbe1f26f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe181575e0 con 0x7fbe18151da0 2024-02-17T12:57:31.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.708+0000 7fbe1d80c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe18151da0 0x7fbe1814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.708+0000 7fbe1d00b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe180c31d0 0x7fbe180c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.708+0000 7fbe1c80a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe180c8850 0x7fbe1814df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:31.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.708+0000 7fbe1d80c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe18151da0 0x7fbe1814e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50084/0 (socket says 172.21.15.160:50084) 2024-02-17T12:57:31.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.708+0000 7fbe1d80c640 1 -- 172.21.15.160:0/3932922658 learned_addr learned my addr 172.21.15.160:0/3932922658 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:31.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.711+0000 7fbe1c80a640 1 -- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe18151da0 msgr2=0x7fbe1814e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.711+0000 7fbe1c80a640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe18151da0 0x7fbe1814e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.711+0000 7fbe1c80a640 1 -- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe180c31d0 msgr2=0x7fbe180c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.711+0000 7fbe1c80a640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe180c31d0 0x7fbe180c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.712+0000 7fbe1c80a640 1 -- 172.21.15.160:0/3932922658 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140094d0 con 0x7fbe180c8850 2024-02-17T12:57:31.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.712+0000 7fbe1d00b640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe180c31d0 0x7fbe180c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:57:31.704 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.714+0000 7fbe1c80a640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe180c8850 0x7fbe1814df90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe14033000 tx=0x7fbe14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:31.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.717+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14039c90 con 0x7fbe180c8850 2024-02-17T12:57:31.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.717+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14039e10 con 0x7fbe180c8850 2024-02-17T12:57:31.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.717+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14043640 con 0x7fbe180c8850 2024-02-17T12:57:31.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.717+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe181578c0 con 0x7fbe180c8850 2024-02-17T12:57:31.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.718+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe180c3ab0 con 0x7fbe180c8850 2024-02-17T12:57:31.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.719+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe18150850 con 0x7fbe180c8850 2024-02-17T12:57:31.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.722+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbe140437a0 con 0x7fbe180c8850 2024-02-17T12:57:31.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.722+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fbe1403e070 con 0x7fbe180c8850 2024-02-17T12:57:31.744 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:31.754+0000 7efc1a241040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:57:31.783 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.793+0000 7f9371a13040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T12:57:31.810 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.819+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbe14034070 con 0x7fbe180c8850 2024-02-17T12:57:31.839 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:31.849+0000 7efc1a241040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T12:57:31.883 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.892+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce087b9b-088a-4074-9d8c-789d3ef5f7be", "id": 6} v 0) v1 -- 0x7fbe1804efc0 con 0x7fbe180c8850 2024-02-17T12:57:31.944 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:31.954+0000 7f9371a13040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:57:31.979 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.988+0000 7fbe09ffb640 1 -- 172.21.15.160:0/3932922658 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce087b9b-088a-4074-9d8c-789d3ef5f7be", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe14043a50 con 0x7fbe180c8850 2024-02-17T12:57:31.979 INFO:teuthology.orchestra.run.smithi160.stdout:6 2024-02-17T12:57:31.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.989+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe180c8850 msgr2=0x7fbe1814df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:31.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.989+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe180c8850 0x7fbe1814df90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe14033000 tx=0x7fbe14004730 comp rx=0 tx=0).stop 2024-02-17T12:57:31.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 shutdown_connections 2024-02-17T12:57:31.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe18151da0 0x7fbe1814e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe180c8850 0x7fbe1814df90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 --2- 172.21.15.160:0/3932922658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe180c31d0 0x7fbe180c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:31.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 >> 172.21.15.160:0/3932922658 conn(0x7fbe1806bbd0 msgr2=0x7fbe18150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:31.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 shutdown_connections 2024-02-17T12:57:31.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:31.990+0000 7fbe1f26f640 1 -- 172.21.15.160:0/3932922658 wait complete. 2024-02-17T12:57:31.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 253c7272-6780-4f74-bf38-3df340c64b27 7 2024-02-17T12:57:31.992 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:32.001+0000 7f9371a13040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T12:57:32.034 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:32.044+0000 7efc1a241040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:57:32.079 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:32.088+0000 7efc1a241040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T12:57:32.132 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.141+0000 7f4064e81640 1 Processor -- start 2024-02-17T12:57:32.132 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.141+0000 7f4064e81640 1 -- start start 2024-02-17T12:57:32.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.142+0000 7f4064e81640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4060150ae0 0x7f40600c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.142+0000 7f4064e81640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4060072da0 con 0x7f4060071dd0 2024-02-17T12:57:32.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.142+0000 7f4064e81640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406006f450 con 0x7f406006fff0 2024-02-17T12:57:32.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.142+0000 7f4064e81640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4060159de0 con 0x7f4060150ae0 2024-02-17T12:57:32.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.143+0000 7f405e59c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4060150ae0 0x7f40600c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.143+0000 7f4057fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4060071dd0 0x7f406006f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.160:36396/0 (socket says 172.21.15.160:36396) 2024-02-17T12:57:32.134 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.143+0000 7f4057fff640 1 -- 172.21.15.160:0/2361009833 learned_addr learned my addr 172.21.15.160:0/2361009833 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-02-17T12:57:32.136 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.146+0000 7f405dd9b640 1 -- 172.21.15.160:0/2361009833 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185633335 0 0) 0x7f4060072da0 con 0x7f4060071dd0 2024-02-17T12:57:32.136 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.146+0000 7f405dd9b640 1 -- 172.21.15.160:0/2361009833 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f404c003520 con 0x7f4060071dd0 2024-02-17T12:57:32.136 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.146+0000 7f405e59c640 1 -- 172.21.15.160:0/2361009833 >> v1:172.21.15.160:6789/0 conn(0x7f406006fff0 legacy=0x7f4060161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:32.136 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.146+0000 7f405e59c640 1 -- 172.21.15.160:0/2361009833 >> v1:172.21.15.136:6789/0 conn(0x7f4060071dd0 legacy=0x7f406006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.136 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.146+0000 7f405e59c640 1 -- 172.21.15.160:0/2361009833 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406015a0a0 con 0x7f4060150ae0 2024-02-17T12:57:32.140 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.150+0000 7f405e59c640 1 --2- 172.21.15.160:0/2361009833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060150ae0 0x7f40600c3730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40500097d0 tx=0x7f405002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52bc95386ae0674c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:32.145 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:32.154+0000 7f9371a13040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.154+0000 7f405dd9b640 1 -- 172.21.15.160:0/2361009833 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050030610 con 0x7f4060150ae0 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.154+0000 7f405dd9b640 1 -- 172.21.15.160:0/2361009833 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4050030770 con 0x7f4060150ae0 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.154+0000 7f405dd9b640 1 -- 172.21.15.160:0/2361009833 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050030b00 con 0x7f4060150ae0 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 -- 172.21.15.160:0/2361009833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060150ae0 msgr2=0x7f40600c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 --2- 172.21.15.160:0/2361009833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060150ae0 0x7f40600c3730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40500097d0 tx=0x7f405002b960 comp rx=0 tx=0).stop 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 -- 172.21.15.160:0/2361009833 shutdown_connections 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 --2- 172.21.15.160:0/2361009833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060150ae0 0x7f40600c3730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 -- 172.21.15.160:0/2361009833 >> 172.21.15.160:0/2361009833 conn(0x7f406006bbd0 msgr2=0x7f406006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 -- 172.21.15.160:0/2361009833 shutdown_connections 2024-02-17T12:57:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.155+0000 7f4064e81640 1 -- 172.21.15.160:0/2361009833 wait complete. 2024-02-17T12:57:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 Processor -- start 2024-02-17T12:57:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 -- start start 2024-02-17T12:57:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f406006fff0 0x7f40601e4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 0x7f40601ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060150ae0 0x7f40601ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406014eb00 con 0x7f4060150ae0 2024-02-17T12:57:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060145890 con 0x7f4060071dd0 2024-02-17T12:57:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.157+0000 7f4064e81640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4060145b70 con 0x7f406006fff0 2024-02-17T12:57:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.158+0000 7f4057fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 0x7f40601ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.158+0000 7f405e59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f406006fff0 0x7f40601e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.158+0000 7f405ed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060150ae0 0x7f40601ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.158+0000 7f4057fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 0x7f40601ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:34888/0 (socket says 172.21.15.160:34888) 2024-02-17T12:57:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.158+0000 7f4057fff640 1 -- 172.21.15.160:0/125404355 learned_addr learned my addr 172.21.15.160:0/125404355 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-02-17T12:57:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.162+0000 7f4057fff640 1 -- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f406006fff0 msgr2=0x7f40601e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.162+0000 7f4057fff640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f406006fff0 0x7f40601e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.162+0000 7f4057fff640 1 -- 172.21.15.160:0/125404355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060150ae0 msgr2=0x7f40601ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.162+0000 7f4057fff640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060150ae0 0x7f40601ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.162+0000 7f4057fff640 1 -- 172.21.15.160:0/125404355 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050009400 con 0x7f4060071dd0 2024-02-17T12:57:32.154 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.164+0000 7f4057fff640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 0x7f40601ef340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f404800c430 tx=0x7f404800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:32.158 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.168+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048005ce0 con 0x7f4060071dd0 2024-02-17T12:57:32.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.168+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4048005e40 con 0x7f4060071dd0 2024-02-17T12:57:32.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.168+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480072f0 con 0x7f4060071dd0 2024-02-17T12:57:32.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.168+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4060145e50 con 0x7f4060071dd0 2024-02-17T12:57:32.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.168+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060146410 con 0x7f4060071dd0 2024-02-17T12:57:32.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.169+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406004efc0 con 0x7f4060071dd0 2024-02-17T12:57:32.242 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:32.252+0000 7efc1a241040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T12:57:32.259 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.268+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4048007450 con 0x7f4060071dd0 2024-02-17T12:57:32.259 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.269+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f404801ba10 con 0x7f4060071dd0 2024-02-17T12:57:32.259 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.269+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4048017070 con 0x7f4060071dd0 2024-02-17T12:57:32.330 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.339+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "253c7272-6780-4f74-bf38-3df340c64b27", "id": 7} v 0) v1 -- 0x7f4060072960 con 0x7f4060071dd0 2024-02-17T12:57:32.396 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.406+0000 7f4056ffd640 1 -- 172.21.15.160:0/125404355 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "253c7272-6780-4f74-bf38-3df340c64b27", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f404801bd20 con 0x7f4060071dd0 2024-02-17T12:57:32.397 INFO:teuthology.orchestra.run.smithi160.stdout:7 2024-02-17T12:57:32.397 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 msgr2=0x7f40601ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 0x7f40601ef340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f404800c430 tx=0x7f404800c8f0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 shutdown_connections 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4060150ae0 0x7f40601ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4060071dd0 0x7f40601ef340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 --2- 172.21.15.160:0/125404355 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f406006fff0 0x7f40601e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 >> 172.21.15.160:0/125404355 conn(0x7f406006bbd0 msgr2=0x7f40600cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 shutdown_connections 2024-02-17T12:57:32.398 INFO:teuthology.orchestra.run.smithi160.stderr:2024-02-17T12:57:32.407+0000 7f4064e81640 1 -- 172.21.15.160:0/125404355 wait complete. 2024-02-17T12:57:32.408 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-17T12:57:32.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-02-17T12:57:32.410 INFO:tasks.ceph.osd.0:Started 2024-02-17T12:57:32.411 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-17T12:57:32.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-02-17T12:57:32.413 INFO:tasks.ceph.osd.1:Started 2024-02-17T12:57:32.413 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-17T12:57:32.413 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-02-17T12:57:32.415 INFO:tasks.ceph.osd.2:Started 2024-02-17T12:57:32.415 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-17T12:57:32.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-02-17T12:57:32.417 INFO:tasks.ceph.osd.3:Started 2024-02-17T12:57:32.417 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-17T12:57:32.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-02-17T12:57:32.419 INFO:tasks.ceph.osd.4:Started 2024-02-17T12:57:32.420 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-17T12:57:32.420 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-02-17T12:57:32.422 INFO:tasks.ceph.osd.5:Started 2024-02-17T12:57:32.422 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-17T12:57:32.422 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-02-17T12:57:32.424 INFO:tasks.ceph.osd.6:Started 2024-02-17T12:57:32.424 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-17T12:57:32.424 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-02-17T12:57:32.426 INFO:tasks.ceph.osd.7:Started 2024-02-17T12:57:32.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:57:32.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.569+0000 7fe8bbdd7640 1 Processor -- start 2024-02-17T12:57:32.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.569+0000 7fe8bbdd7640 1 -- start start 2024-02-17T12:57:32.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.570+0000 7fe8bbdd7640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe8b4150ae0 0x7fe8b40c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.570+0000 7fe8bbdd7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b4072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.570+0000 7fe8bbdd7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe8b406f8e0 0x7fe8b406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.570+0000 7fe8bbdd7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b4072da0 con 0x7fe8b406f8e0 2024-02-17T12:57:32.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.570+0000 7fe8bbdd7640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b406f450 con 0x7fe8b4150ae0 2024-02-17T12:57:32.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.570+0000 7fe8bbdd7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4070270 con 0x7fe8b4071dd0 2024-02-17T12:57:32.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.571+0000 7fe8b9372640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b4072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.571+0000 7fe8b9b73640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe8b4150ae0 0x7fe8b40c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.571+0000 7fe8b9b73640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe8b4150ae0 0x7fe8b40c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:43412/0 (socket says 172.21.15.136:43412) 2024-02-17T12:57:32.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.571+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2905562416 learned_addr learned my addr 172.21.15.136:0/2905562416 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:32.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.572+0000 7fe8ba374640 1 --2- 172.21.15.136:0/2905562416 >> v2:172.21.15.136:3300/0 conn(0x7fe8b406f8e0 0x7fe8b406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.574+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 msgr2=0x7fe8b4072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:32.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.574+0000 7fe8b9b73640 1 --2- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b4072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.574+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2905562416 >> v2:172.21.15.136:3300/0 conn(0x7fe8b406f8e0 msgr2=0x7fe8b406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:32.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.574+0000 7fe8b9b73640 1 --2- 172.21.15.136:0/2905562416 >> v2:172.21.15.136:3300/0 conn(0x7fe8b406f8e0 0x7fe8b406fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.574+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2905562416 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4159de0 con 0x7fe8b4150ae0 2024-02-17T12:57:32.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.575+0000 7fe8b9b73640 1 --2- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4150ae0 0x7fe8b40c3730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8b406d910 tx=0x7fe8b002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78645512a48b143b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:32.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.577+0000 7fe8b8b71640 1 -- 172.21.15.136:0/2905562416 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0030860 con 0x7fe8b4150ae0 2024-02-17T12:57:32.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.579+0000 7fe8b8b71640 1 -- 172.21.15.136:0/2905562416 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b00309c0 con 0x7fe8b4150ae0 2024-02-17T12:57:32.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.579+0000 7fe8b8b71640 1 -- 172.21.15.136:0/2905562416 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0030d50 con 0x7fe8b4150ae0 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4150ae0 msgr2=0x7fe8b40c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4150ae0 0x7fe8b40c3730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8b406d910 tx=0x7fe8b002b9a0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2905562416 shutdown_connections 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2905562416 >> v2:172.21.15.136:3300/0 conn(0x7fe8b406f8e0 0x7fe8b406fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b4072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2905562416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b4150ae0 0x7fe8b40c3730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2905562416 >> 172.21.15.136:0/2905562416 conn(0x7fe8b406bbd0 msgr2=0x7fe8b406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2905562416 shutdown_connections 2024-02-17T12:57:32.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.580+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2905562416 wait complete. 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.581+0000 7fe8bbdd7640 1 Processor -- start 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.581+0000 7fe8bbdd7640 1 -- start start 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.582+0000 7fe8bbdd7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 0x7fe8b40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.582+0000 7fe8bbdd7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b41431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.582+0000 7fe8bbdd7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8b4150ae0 0x7fe8b413dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.582+0000 7fe8bbdd7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41ec780 con 0x7fe8b4150ae0 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.582+0000 7fe8bbdd7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4142120 con 0x7fe8b406f8e0 2024-02-17T12:57:32.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.582+0000 7fe8bbdd7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4142400 con 0x7fe8b4071dd0 2024-02-17T12:57:32.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.583+0000 7fe8b9372640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b41431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.583+0000 7fe8b9b73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 0x7fe8b40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.583+0000 7fe8ba374640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8b4150ae0 0x7fe8b413dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:32.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.583+0000 7fe8b9b73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 0x7fe8b40caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:43428/0 (socket says 172.21.15.136:43428) 2024-02-17T12:57:32.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.583+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2598931780 learned_addr learned my addr 172.21.15.136:0/2598931780 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:32.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.586+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 msgr2=0x7fe8b41431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.586+0000 7fe8b9b73640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b41431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.586+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2598931780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8b4150ae0 msgr2=0x7fe8b413dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.586+0000 7fe8b9b73640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8b4150ae0 0x7fe8b413dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.586+0000 7fe8b9b73640 1 -- 172.21.15.136:0/2598931780 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00094d0 con 0x7fe8b406f8e0 2024-02-17T12:57:32.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.588+0000 7fe8b9b73640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 0x7fe8b40caa00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000c00 tx=0x7fe8b0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:32.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.592+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0039a90 con 0x7fe8b406f8e0 2024-02-17T12:57:32.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.592+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0039c10 con 0x7fe8b406f8e0 2024-02-17T12:57:32.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.592+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0043410 con 0x7fe8b406f8e0 2024-02-17T12:57:32.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.592+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41426e0 con 0x7fe8b406f8e0 2024-02-17T12:57:32.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.592+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b4142ca0 con 0x7fe8b406f8e0 2024-02-17T12:57:32.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.593+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b404efc0 con 0x7fe8b406f8e0 2024-02-17T12:57:32.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.689+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe8b0043570 con 0x7fe8b406f8e0 2024-02-17T12:57:32.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.693+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe8b004ca80 con 0x7fe8b406f8e0 2024-02-17T12:57:32.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.694+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe8b0048070 con 0x7fe8b406f8e0 2024-02-17T12:57:32.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.755+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8b40c6c30 con 0x7fe8b406f8e0 2024-02-17T12:57:32.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.804+0000 7fe8aa7fc640 1 -- 172.21.15.136:0/2598931780 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe8b0034070 con 0x7fe8b406f8e0 2024-02-17T12:57:32.795 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:32.795 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":10,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:57:32.352162+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 msgr2=0x7fe8b40caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 0x7fe8b40caa00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000c00 tx=0x7fe8b0004730 comp rx=0 tx=0).stop 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 shutdown_connections 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8b4150ae0 0x7fe8b413dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8b4071dd0 0x7fe8b41431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 --2- 172.21.15.136:0/2598931780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8b406f8e0 0x7fe8b40caa00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 >> 172.21.15.136:0/2598931780 conn(0x7fe8b406bbd0 msgr2=0x7fe8b414e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:32.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 shutdown_connections 2024-02-17T12:57:32.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:32.805+0000 7fe8bbdd7640 1 -- 172.21.15.136:0/2598931780 wait complete. 2024-02-17T12:57:32.806 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-17T12:57:32.807 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-17T12:57:33.029 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:33.039+0000 7f9371a13040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T12:57:33.040 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-02-17T12:57:33.050+0000 7f68380f9640 -1 Falling back to public interface 2024-02-17T12:57:33.051 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-02-17T12:57:33.061+0000 7f59a70a6640 -1 Falling back to public interface 2024-02-17T12:57:33.052 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-02-17T12:57:33.061+0000 7f5c39c0f640 -1 Falling back to public interface 2024-02-17T12:57:33.052 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-02-17T12:57:33.062+0000 7fc2c968b640 -1 Falling back to public interface 2024-02-17T12:57:33.058 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-02-17T12:57:33.068+0000 7f2f9c538640 -1 Falling back to public interface 2024-02-17T12:57:33.076 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-02-17T12:57:33.085+0000 7ff9b9699640 -1 Falling back to public interface 2024-02-17T12:57:33.076 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-02-17T12:57:33.086+0000 7f9ff49fd640 -1 Falling back to public interface 2024-02-17T12:57:33.081 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-02-17T12:57:33.090+0000 7f3c94d21640 -1 Falling back to public interface 2024-02-17T12:57:33.125 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:33.134+0000 7efc1a241040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T12:57:33.310 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:33.320+0000 7f9371a13040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T12:57:33.363 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:33.373+0000 7f9371a13040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T12:57:33.400 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:33.410+0000 7efc1a241040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T12:57:33.450 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:33.460+0000 7efc1a241040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T12:57:33.478 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:33.488+0000 7f9371a13040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T12:57:33.564 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-02-17T12:57:33.574+0000 7efc1a241040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T12:57:33.611 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T12:57:33.722 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.731+0000 7fb6d273e640 1 Processor -- start 2024-02-17T12:57:33.722 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.731+0000 7fb6d273e640 1 -- start start 2024-02-17T12:57:33.723 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.732+0000 7fb6d273e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb6cc0c2dd0 0x7fb6cc0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:33.723 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.732+0000 7fb6d273e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 0x7fb6cc0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:33.723 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.732+0000 7fb6d273e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc071f00 con 0x7fb6cc151c30 2024-02-17T12:57:33.723 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.732+0000 7fb6d273e640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc0723d0 con 0x7fb6cc0c2dd0 2024-02-17T12:57:33.723 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.732+0000 7fb6d273e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0c7170 con 0x7fb6cc071a90 2024-02-17T12:57:33.724 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.733+0000 7fb6cb7fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb6cc0c2dd0 0x7fb6cc0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:33.724 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.733+0000 7fb6d0cdb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 0x7fb6cc0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:33.724 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.733+0000 7fb6d0cdb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 0x7fb6cc0c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36570/0 (socket says 172.21.15.136:36570) 2024-02-17T12:57:33.724 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.733+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/4224162169 learned_addr learned my addr 172.21.15.136:0/4224162169 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:33.724 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.733+0000 7fb6cb7fe640 1 --2- 172.21.15.136:0/4224162169 >> v2:172.21.15.160:3300/0 conn(0x7fb6cc0c2dd0 0x7fb6cc0c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:43438/0 (socket says 172.21.15.136:43438) 2024-02-17T12:57:33.726 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.735+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/4224162169 >> v2:172.21.15.160:3300/0 conn(0x7fb6cc0c2dd0 msgr2=0x7fb6cc0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:33.726 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.735+0000 7fb6d0cdb640 1 --2- 172.21.15.136:0/4224162169 >> v2:172.21.15.160:3300/0 conn(0x7fb6cc0c2dd0 0x7fb6cc0c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:33.726 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.735+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/4224162169 >> v1:172.21.15.136:6789/0 conn(0x7fb6cc151c30 legacy=0x7fb6cc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:33.726 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.735+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/4224162169 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc0c8fe0 con 0x7fb6cc071a90 2024-02-17T12:57:33.728 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.737+0000 7fb6d0cdb640 1 --2- 172.21.15.136:0/4224162169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 0x7fb6cc0c5940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc071740 tx=0x7fb6c402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8feb7aa499d60038 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:33.731 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.741+0000 7fb6caffd640 1 -- 172.21.15.136:0/4224162169 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c402ca50 con 0x7fb6cc071a90 2024-02-17T12:57:33.731 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.741+0000 7fb6caffd640 1 -- 172.21.15.136:0/4224162169 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c402cbb0 con 0x7fb6cc071a90 2024-02-17T12:57:33.731 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.741+0000 7fb6caffd640 1 -- 172.21.15.136:0/4224162169 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40343f0 con 0x7fb6cc071a90 2024-02-17T12:57:33.733 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.741+0000 7fb6d273e640 1 -- 172.21.15.136:0/4224162169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 msgr2=0x7fb6cc0c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.741+0000 7fb6d273e640 1 --2- 172.21.15.136:0/4224162169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 0x7fb6cc0c5940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc071740 tx=0x7fb6c402beb0 comp rx=0 tx=0).stop 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.742+0000 7fb6d273e640 1 -- 172.21.15.136:0/4224162169 shutdown_connections 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.742+0000 7fb6d273e640 1 --2- 172.21.15.136:0/4224162169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc071a90 0x7fb6cc0c5940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.742+0000 7fb6d273e640 1 --2- 172.21.15.136:0/4224162169 >> v2:172.21.15.160:3300/0 conn(0x7fb6cc0c2dd0 0x7fb6cc0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.742+0000 7fb6d273e640 1 -- 172.21.15.136:0/4224162169 >> 172.21.15.136:0/4224162169 conn(0x7fb6cc06bcb0 msgr2=0x7fb6cc06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.742+0000 7fb6d273e640 1 -- 172.21.15.136:0/4224162169 shutdown_connections 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.742+0000 7fb6d273e640 1 -- 172.21.15.136:0/4224162169 wait complete. 2024-02-17T12:57:33.734 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 Processor -- start 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 -- start start 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6cc071a90 0x7fb6cc1e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc0c2dd0 0x7fb6cc1e0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 0x7fb6cc1e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1e2dc0 con 0x7fb6cc071a90 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1e3120 con 0x7fb6cc151c30 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.743+0000 7fb6d273e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1e33c0 con 0x7fb6cc0c2dd0 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.744+0000 7fb6d0cdb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 0x7fb6cc1e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.744+0000 7fb6cb7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc0c2dd0 0x7fb6cc1e0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.745+0000 7fb6d0cdb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 0x7fb6cc1e13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:43442/0 (socket says 172.21.15.136:43442) 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.745+0000 7fb6cb7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc0c2dd0 0x7fb6cc1e0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36586/0 (socket says 172.21.15.136:36586) 2024-02-17T12:57:33.736 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.745+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/1334940795 learned_addr learned my addr 172.21.15.136:0/1334940795 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:33.738 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.748+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc0c2dd0 msgr2=0x7fb6cc1e0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:33.739 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.748+0000 7fb6d0cdb640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc0c2dd0 0x7fb6cc1e0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:33.739 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.748+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/1334940795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6cc071a90 msgr2=0x7fb6cc1e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:33.739 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.748+0000 7fb6d0cdb640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6cc071a90 0x7fb6cc1e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:33.739 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.748+0000 7fb6d0cdb640 1 -- 172.21.15.136:0/1334940795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009b30 con 0x7fb6cc151c30 2024-02-17T12:57:33.741 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.750+0000 7fb6d0cdb640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 0x7fb6cc1e13d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4036040 tx=0x7fb6c4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:33.744 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.754+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c403e450 con 0x7fb6cc151c30 2024-02-17T12:57:33.745 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.754+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c403e5d0 con 0x7fb6cc151c30 2024-02-17T12:57:33.745 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.754+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1e36a0 con 0x7fb6cc151c30 2024-02-17T12:57:33.745 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.754+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c403e980 con 0x7fb6cc151c30 2024-02-17T12:57:33.745 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.754+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1e3c60 con 0x7fb6cc151c30 2024-02-17T12:57:33.745 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.755+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc0c4280 con 0x7fb6cc151c30 2024-02-17T12:57:33.843 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.853+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb6c403eae0 con 0x7fb6cc151c30 2024-02-17T12:57:33.850 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.860+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb6c40047f0 con 0x7fb6cc151c30 2024-02-17T12:57:33.850 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.860+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb6cc0c4280 con 0x7fb6cc151c30 2024-02-17T12:57:33.912 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.921+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6cc04eee0 con 0x7fb6cc151c30 2024-02-17T12:57:33.960 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:33.969+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 2) v1 ==== 44919+0+0 (secure 0 0 0) 0x7fb6c4003990 con 0x7fb6cc151c30 2024-02-17T12:57:34.189 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.198+0000 7fb6c8ff9640 1 -- 172.21.15.136:0/1334940795 <== mon.1 v2:172.21.15.160:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb6c4051420 con 0x7fb6cc151c30 2024-02-17T12:57:34.189 INFO:teuthology.misc.health.smithi136.stdout: 2024-02-17T12:57:34.189 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":10,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:57:32.352162+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:57:34.190 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 msgr2=0x7fb6cc1e13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:34.190 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 0x7fb6cc1e13d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4036040 tx=0x7fb6c4004a40 comp rx=0 tx=0).stop 2024-02-17T12:57:34.190 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 shutdown_connections 2024-02-17T12:57:34.191 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6cc151c30 0x7fb6cc1e13d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:34.191 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6cc0c2dd0 0x7fb6cc1e0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:34.191 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 --2- 172.21.15.136:0/1334940795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6cc071a90 0x7fb6cc1e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:34.191 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 >> 172.21.15.136:0/1334940795 conn(0x7fb6cc06bcb0 msgr2=0x7fb6cc0c68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:34.191 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 shutdown_connections 2024-02-17T12:57:34.191 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:34.199+0000 7fb6d273e640 1 -- 172.21.15.136:0/1334940795 wait complete. 2024-02-17T12:57:34.199 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-17T12:57:35.160 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:35.169+0000 7f9312370640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-17T12:57:35.212 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T12:57:35.222+0000 7f9312370640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-17T12:57:36.487 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-02-17T12:57:36.496+0000 7f5c39c0f640 -1 osd.1 0 log_to_monitors true 2024-02-17T12:57:36.505 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-02-17T12:57:36.514+0000 7f68380f9640 -1 osd.4 0 log_to_monitors true 2024-02-17T12:57:36.557 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-02-17T12:57:36.567+0000 7f2f9c538640 -1 osd.2 0 log_to_monitors true 2024-02-17T12:57:36.571 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-02-17T12:57:36.581+0000 7f59a70a6640 -1 osd.5 0 log_to_monitors true 2024-02-17T12:57:36.575 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-02-17T12:57:36.585+0000 7fc2c968b640 -1 osd.7 0 log_to_monitors true 2024-02-17T12:57:36.582 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-02-17T12:57:36.592+0000 7f9ff49fd640 -1 osd.6 0 log_to_monitors true 2024-02-17T12:57:36.593 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-02-17T12:57:36.603+0000 7ff9b9699640 -1 osd.0 0 log_to_monitors true 2024-02-17T12:57:36.607 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-02-17T12:57:36.616+0000 7f3c94d21640 -1 osd.3 0 log_to_monitors true 2024-02-17T12:57:39.945 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-02-17T12:57:39.954+0000 7ff9b5e43640 -1 osd.0 0 waiting for initial osdmap 2024-02-17T12:57:40.012 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-02-17T12:57:40.021+0000 7f3c90cb7640 -1 osd.3 0 waiting for initial osdmap 2024-02-17T12:57:40.058 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-02-17T12:57:40.067+0000 7f2f984ce640 -1 osd.2 0 waiting for initial osdmap 2024-02-17T12:57:40.062 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-02-17T12:57:40.072+0000 7f5c35ea9640 -1 osd.1 0 waiting for initial osdmap 2024-02-17T12:57:40.072 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-02-17T12:57:40.082+0000 7f3c88ad7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.107 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-02-17T12:57:40.117+0000 7ff9ad44f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.110 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-02-17T12:57:40.120+0000 7f5c2d4b5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.130 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-02-17T12:57:40.140+0000 7f2f902ee640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.419 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-02-17T12:57:40.426+0000 7f9ff0993640 -1 osd.6 0 waiting for initial osdmap 2024-02-17T12:57:40.438 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-02-17T12:57:40.448+0000 7f9fe87b3640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.576 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-02-17T12:57:40.585+0000 7fc2c5621640 -1 osd.7 0 waiting for initial osdmap 2024-02-17T12:57:40.619 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-02-17T12:57:40.629+0000 7f59a3850640 -1 osd.5 0 waiting for initial osdmap 2024-02-17T12:57:40.629 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-02-17T12:57:40.639+0000 7fc2bd441640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.635 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-02-17T12:57:40.645+0000 7f683408f640 -1 osd.4 0 waiting for initial osdmap 2024-02-17T12:57:40.720 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-02-17T12:57:40.730+0000 7f599ae5c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:40.724 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-02-17T12:57:40.734+0000 7f682beaf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:57:41.005 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T12:57:41.108 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.118+0000 7f6ab4c39640 1 Processor -- start 2024-02-17T12:57:41.109 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.118+0000 7f6ab4c39640 1 -- start start 2024-02-17T12:57:41.109 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.118+0000 7f6ab4c39640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab0153be0 0x7f6ab006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.109 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.119+0000 7f6ab4c39640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab006c500 con 0x7f6ab00c8080 2024-02-17T12:57:41.109 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.119+0000 7f6ab4c39640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab0159f30 con 0x7f6ab00c7c80 2024-02-17T12:57:41.110 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.119+0000 7f6ab4c39640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab015a210 con 0x7f6ab0153be0 2024-02-17T12:57:41.122 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.132+0000 7f6aae59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab0153be0 0x7f6ab006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.125 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.134+0000 7f6aa5d9b640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6ab00c7c80 0x7f6ab00cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:42652/0 (socket says 172.21.15.136:42652) 2024-02-17T12:57:41.125 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.135+0000 7f6aa5d9b640 1 -- 172.21.15.136:0/1813841741 learned_addr learned my addr 172.21.15.136:0/1813841741 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:41.129 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.139+0000 7f6aae59c640 1 -- 172.21.15.136:0/1813841741 >> v1:172.21.15.160:6789/0 conn(0x7f6ab00c7c80 legacy=0x7f6ab00cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.129 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.139+0000 7f6aae59c640 1 -- 172.21.15.136:0/1813841741 >> v1:172.21.15.136:6789/0 conn(0x7f6ab00c8080 legacy=0x7f6ab00c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:41.129 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.139+0000 7f6aae59c640 1 -- 172.21.15.136:0/1813841741 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab015a4f0 con 0x7f6ab0153be0 2024-02-17T12:57:41.133 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.142+0000 7f6aae59c640 1 --2- 172.21.15.136:0/1813841741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab0153be0 0x7f6ab006bcb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00097d0 tx=0x7f6aa002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e54c9c7e7dfdf7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:41.136 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.145+0000 7f6aadd9b640 1 -- 172.21.15.136:0/1813841741 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0031890 con 0x7f6ab0153be0 2024-02-17T12:57:41.136 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.145+0000 7f6aadd9b640 1 -- 172.21.15.136:0/1813841741 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa00319f0 con 0x7f6ab0153be0 2024-02-17T12:57:41.136 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.145+0000 7f6aadd9b640 1 -- 172.21.15.136:0/1813841741 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0031d80 con 0x7f6ab0153be0 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1813841741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab0153be0 msgr2=0x7f6ab006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1813841741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab0153be0 0x7f6ab006bcb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00097d0 tx=0x7f6aa002b930 comp rx=0 tx=0).stop 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1813841741 shutdown_connections 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1813841741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab0153be0 0x7f6ab006bcb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1813841741 >> 172.21.15.136:0/1813841741 conn(0x7f6ab006aba0 msgr2=0x7f6ab006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1813841741 shutdown_connections 2024-02-17T12:57:41.137 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.146+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1813841741 wait complete. 2024-02-17T12:57:41.138 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 Processor -- start 2024-02-17T12:57:41.138 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 -- start start 2024-02-17T12:57:41.139 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 0x7f6ab014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.139 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ab00c8080 0x7f6ab00cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.139 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab0153be0 0x7f6ab00c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.139 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab014bd00 con 0x7f6ab00c8080 2024-02-17T12:57:41.139 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c8a80 con 0x7f6ab0153be0 2024-02-17T12:57:41.139 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.148+0000 7f6ab4c39640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c8d60 con 0x7f6ab00c7c80 2024-02-17T12:57:41.140 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.149+0000 7f6aae59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 0x7f6ab014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.140 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.149+0000 7f6aaed9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab0153be0 0x7f6ab00c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.140 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.149+0000 7f6aae59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 0x7f6ab014b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36686/0 (socket says 172.21.15.136:36686) 2024-02-17T12:57:41.140 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.149+0000 7f6aae59c640 1 -- 172.21.15.136:0/1160995160 learned_addr learned my addr 172.21.15.136:0/1160995160 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:41.143 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.152+0000 7f6aae59c640 1 -- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab0153be0 msgr2=0x7f6ab00c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.143 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.152+0000 7f6aae59c640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab0153be0 0x7f6ab00c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.143 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.152+0000 7f6aae59c640 1 -- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ab00c8080 msgr2=0x7f6ab00cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.143 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.152+0000 7f6aae59c640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ab00c8080 0x7f6ab00cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.143 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.152+0000 7f6aae59c640 1 -- 172.21.15.136:0/1160995160 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0009400 con 0x7f6ab00c7c80 2024-02-17T12:57:41.146 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.156+0000 7f6aae59c640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 0x7f6ab014b570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0034040 tx=0x7f6aa00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:41.150 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.160+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00453f0 con 0x7f6ab00c7c80 2024-02-17T12:57:41.150 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.160+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab00c9040 con 0x7f6ab00c7c80 2024-02-17T12:57:41.151 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.160+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab00c9600 con 0x7f6ab00c7c80 2024-02-17T12:57:41.151 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.161+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab004eee0 con 0x7f6ab00c7c80 2024-02-17T12:57:41.153 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.163+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0045550 con 0x7f6ab00c7c80 2024-02-17T12:57:41.404 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.414+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00458e0 con 0x7f6ab00c7c80 2024-02-17T12:57:41.405 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.414+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f6aa004e450 con 0x7f6ab00c7c80 2024-02-17T12:57:41.405 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.414+0000 7f6aa77fe640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6a9006b780 0x7f6a9006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.405 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.414+0000 7f6aa5d9b640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6a9006b780 0x7f6a9006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.405 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.415+0000 7f6aa5d9b640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6a9006b780 0x7f6a9006dc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000f60 tx=0x7f6a98007a80 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:41.406 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.416+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f6aa007bcb0 con 0x7f6ab00c7c80 2024-02-17T12:57:41.472 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.481+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6aa0077850 con 0x7f6ab00c7c80 2024-02-17T12:57:41.692 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.702+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ab006f310 con 0x7f6ab00c7c80 2024-02-17T12:57:41.749 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.758+0000 7f6aa77fe640 1 -- 172.21.15.136:0/1160995160 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10957 (secure 0 0 0) 0x7f6aa007af10 con 0x7f6ab00c7c80 2024-02-17T12:57:41.749 INFO:teuthology.misc.health.smithi136.stdout: 2024-02-17T12:57:41.749 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":13,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:57:41.157181+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:57:41.751 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6a9006b780 msgr2=0x7f6a9006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.751 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6a9006b780 0x7f6a9006dc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000f60 tx=0x7f6a98007a80 comp rx=0 tx=0).stop 2024-02-17T12:57:41.751 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 msgr2=0x7f6ab014b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.751 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 0x7f6ab014b570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0034040 tx=0x7f6aa00046c0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.751 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 shutdown_connections 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6a9006b780 0x7f6a9006dc40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab0153be0 0x7f6ab00c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ab00c8080 0x7f6ab00cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 --2- 172.21.15.136:0/1160995160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00c7c80 0x7f6ab014b570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 >> 172.21.15.136:0/1160995160 conn(0x7f6ab006aba0 msgr2=0x7f6ab01585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 shutdown_connections 2024-02-17T12:57:41.752 INFO:teuthology.misc.health.smithi136.stderr:2024-02-17T12:57:41.760+0000 7f6ab4c39640 1 -- 172.21.15.136:0/1160995160 wait complete. 2024-02-17T12:57:41.761 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-17T12:57:41.761 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-17T12:57:41.762 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-17T12:57:41.762 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T12:57:41.762 DEBUG:teuthology.orchestra.run.smithi136:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-02-17T12:57:41.764 INFO:tasks.ceph.mds.a:Started 2024-02-17T12:57:41.764 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-17T12:57:41.764 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T12:57:41.765 DEBUG:teuthology.orchestra.run.smithi136:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-02-17T12:57:41.766 INFO:tasks.ceph.mds.c:Started 2024-02-17T12:57:41.766 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-17T12:57:41.766 INFO:tasks.ceph.mds.e:Restarting daemon 2024-02-17T12:57:41.767 DEBUG:teuthology.orchestra.run.smithi136:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-02-17T12:57:41.768 INFO:tasks.ceph.mds.e:Started 2024-02-17T12:57:41.769 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-17T12:57:41.769 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T12:57:41.769 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-02-17T12:57:41.771 INFO:tasks.ceph.mds.b:Started 2024-02-17T12:57:41.771 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-17T12:57:41.771 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T12:57:41.771 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-02-17T12:57:41.773 INFO:tasks.ceph.mds.d:Started 2024-02-17T12:57:41.773 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-17T12:57:41.773 INFO:tasks.ceph.mds.f:Restarting daemon 2024-02-17T12:57:41.773 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-02-17T12:57:41.775 INFO:tasks.ceph.mds.f:Started 2024-02-17T12:57:41.776 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-17T12:57:41.776 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:57:41.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.891+0000 7fb360281640 1 Processor -- start 2024-02-17T12:57:41.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.891+0000 7fb360281640 1 -- start start 2024-02-17T12:57:41.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.892+0000 7fb360281640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb358151cf0 0x7fb35806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.892+0000 7fb360281640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb35815b0f0 0x7fb35815b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.892+0000 7fb360281640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb358072010 con 0x7fb3580c9fb0 2024-02-17T12:57:41.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.892+0000 7fb360281640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35815ba70 con 0x7fb35815b0f0 2024-02-17T12:57:41.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.893+0000 7fb360281640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb358071a90 con 0x7fb358151cf0 2024-02-17T12:57:41.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.893+0000 7fb35e81e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb35815b0f0 0x7fb35815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.893+0000 7fb35e01d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb358151cf0 0x7fb35806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.894+0000 7fb35d81c640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb3580c9fb0 0x7fb3580c58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53560/0 (socket says 172.21.15.136:53560) 2024-02-17T12:57:41.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.894+0000 7fb35d81c640 1 -- 172.21.15.136:0/396381633 learned_addr learned my addr 172.21.15.136:0/396381633 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:41.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.897+0000 7fb35e01d640 1 -- 172.21.15.136:0/396381633 >> v2:172.21.15.136:3300/0 conn(0x7fb35815b0f0 msgr2=0x7fb35815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:41.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.897+0000 7fb35e01d640 1 --2- 172.21.15.136:0/396381633 >> v2:172.21.15.136:3300/0 conn(0x7fb35815b0f0 0x7fb35815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.897+0000 7fb35e01d640 1 -- 172.21.15.136:0/396381633 >> v1:172.21.15.136:6789/0 conn(0x7fb3580c9fb0 legacy=0x7fb3580c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.897+0000 7fb35e01d640 1 -- 172.21.15.136:0/396381633 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358071d30 con 0x7fb358151cf0 2024-02-17T12:57:41.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.900+0000 7fb35e01d640 1 --2- 172.21.15.136:0/396381633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb35806fdf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb358070cb0 tx=0x7fb35402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2e961190460b99 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:41.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.905+0000 7fb35d01b640 1 -- 172.21.15.136:0/396381633 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35402e070 con 0x7fb358151cf0 2024-02-17T12:57:41.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.905+0000 7fb35d01b640 1 -- 172.21.15.136:0/396381633 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3540315a0 con 0x7fb358151cf0 2024-02-17T12:57:41.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.905+0000 7fb35d01b640 1 -- 172.21.15.136:0/396381633 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354031930 con 0x7fb358151cf0 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 -- 172.21.15.136:0/396381633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 msgr2=0x7fb35806fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 --2- 172.21.15.136:0/396381633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb35806fdf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb358070cb0 tx=0x7fb35402b840 comp rx=0 tx=0).stop 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 -- 172.21.15.136:0/396381633 shutdown_connections 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 --2- 172.21.15.136:0/396381633 >> v2:172.21.15.136:3300/0 conn(0x7fb35815b0f0 0x7fb35815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 --2- 172.21.15.136:0/396381633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb35806fdf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 -- 172.21.15.136:0/396381633 >> 172.21.15.136:0/396381633 conn(0x7fb35806bbd0 msgr2=0x7fb35806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 -- 172.21.15.136:0/396381633 shutdown_connections 2024-02-17T12:57:41.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.906+0000 7fb360281640 1 -- 172.21.15.136:0/396381633 wait complete. 2024-02-17T12:57:41.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.908+0000 7fb360281640 1 Processor -- start 2024-02-17T12:57:41.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.908+0000 7fb360281640 1 -- start start 2024-02-17T12:57:41.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.909+0000 7fb360281640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3580c9fb0 0x7fb35814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.909+0000 7fb360281640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb3581e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.909+0000 7fb360281640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb35815b0f0 0x7fb358145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:41.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.909+0000 7fb360281640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580c98b0 con 0x7fb3580c9fb0 2024-02-17T12:57:41.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.909+0000 7fb360281640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581e1940 con 0x7fb358151cf0 2024-02-17T12:57:41.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.909+0000 7fb360281640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581e1660 con 0x7fb35815b0f0 2024-02-17T12:57:41.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.910+0000 7fb35e01d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3580c9fb0 0x7fb35814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.910+0000 7fb35d81c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb3581e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.910+0000 7fb35e81e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb35815b0f0 0x7fb358145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:41.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.910+0000 7fb35e01d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3580c9fb0 0x7fb35814ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54686/0 (socket says 172.21.15.136:54686) 2024-02-17T12:57:41.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.910+0000 7fb35e01d640 1 -- 172.21.15.136:0/1210607856 learned_addr learned my addr 172.21.15.136:0/1210607856 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:41.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.915+0000 7fb35d81c640 1 -- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb35815b0f0 msgr2=0x7fb358145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.915+0000 7fb35d81c640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb35815b0f0 0x7fb358145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.915+0000 7fb35d81c640 1 -- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3580c9fb0 msgr2=0x7fb35814ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:41.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.915+0000 7fb35d81c640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3580c9fb0 0x7fb35814ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:41.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.915+0000 7fb35d81c640 1 -- 172.21.15.136:0/1210607856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009400 con 0x7fb358151cf0 2024-02-17T12:57:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.919+0000 7fb35d81c640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb3581e0bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb348000f60 tx=0x7fb34800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:41.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.924+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348005ce0 con 0x7fb358151cf0 2024-02-17T12:57:41.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.924+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348005e40 con 0x7fb358151cf0 2024-02-17T12:57:41.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.924+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348007310 con 0x7fb358151cf0 2024-02-17T12:57:41.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.924+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3581e20e0 con 0x7fb358151cf0 2024-02-17T12:57:41.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.924+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3581e26a0 con 0x7fb358151cf0 2024-02-17T12:57:41.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:41.925+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358067cb0 con 0x7fb358151cf0 2024-02-17T12:57:42.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.198+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fb348007470 con 0x7fb358151cf0 2024-02-17T12:57:42.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.199+0000 7fb34effd640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb33c06b7d0 0x7fb33c06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:42.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.199+0000 7fb35e01d640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb33c06b7d0 0x7fb33c06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:42.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.199+0000 7fb35e01d640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb33c06b7d0 0x7fb33c06dc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb35402b880 tx=0x7fb35403d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:42.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.206+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb348007720 con 0x7fb358151cf0 2024-02-17T12:57:42.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.223+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb348054510 con 0x7fb358151cf0 2024-02-17T12:57:42.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.434+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35804efc0 con 0x7fb358151cf0 2024-02-17T12:57:42.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.474+0000 7fb34effd640 1 -- 172.21.15.136:0/1210607856 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10957 (secure 0 0 0) 0x7fb348017070 con 0x7fb358151cf0 2024-02-17T12:57:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:42.465 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":13,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:57:41.157181+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb33c06b7d0 msgr2=0x7fb33c06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb33c06b7d0 0x7fb33c06dc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb35402b880 tx=0x7fb35403d040 comp rx=0 tx=0).stop 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 msgr2=0x7fb3581e0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb3581e0bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb348000f60 tx=0x7fb34800c760 comp rx=0 tx=0).stop 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 shutdown_connections 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb33c06b7d0 0x7fb33c06dc90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb35815b0f0 0x7fb358145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb358151cf0 0x7fb3581e0bb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 --2- 172.21.15.136:0/1210607856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3580c9fb0 0x7fb35814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 >> 172.21.15.136:0/1210607856 conn(0x7fb35806bbd0 msgr2=0x7fb35814f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:42.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 shutdown_connections 2024-02-17T12:57:42.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.476+0000 7fb360281640 1 -- 172.21.15.136:0/1210607856 wait complete. 2024-02-17T12:57:42.481 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-02-17T12:57:42.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:57:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.649+0000 7fe69d823640 1 Processor -- start 2024-02-17T12:57:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.649+0000 7fe69d823640 1 -- start start 2024-02-17T12:57:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.650+0000 7fe69d823640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe69815a5b0 0x7fe6980c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.650+0000 7fe69d823640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6980c3d00 con 0x7fe6980c6630 2024-02-17T12:57:42.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.650+0000 7fe69d823640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe698070400 con 0x7fe698150c70 2024-02-17T12:57:42.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.650+0000 7fe69d823640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6980c4d90 con 0x7fe69815a5b0 2024-02-17T12:57:42.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.651+0000 7fe6977fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe6980c6630 0x7fe6980c9120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53574/0 (socket says 172.21.15.136:53574) 2024-02-17T12:57:42.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.651+0000 7fe6977fe640 1 -- 172.21.15.136:0/220379273 learned_addr learned my addr 172.21.15.136:0/220379273 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:42.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.652+0000 7fe6967fc640 1 --2- 172.21.15.136:0/220379273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe69815a5b0 0x7fe6980c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:42.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.658+0000 7fe6967fc640 1 -- 172.21.15.136:0/220379273 >> v1:172.21.15.160:6789/0 conn(0x7fe698150c70 legacy=0x7fe698159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:42.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.658+0000 7fe6967fc640 1 -- 172.21.15.136:0/220379273 >> v1:172.21.15.136:6789/0 conn(0x7fe6980c6630 legacy=0x7fe6980c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:42.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.658+0000 7fe6967fc640 1 -- 172.21.15.136:0/220379273 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6980c39d0 con 0x7fe69815a5b0 2024-02-17T12:57:42.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.662+0000 7fe6967fc640 1 --2- 172.21.15.136:0/220379273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe69815a5b0 0x7fe6980c8be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0097d0 tx=0x7fe68c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f1b5a65dd423c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:42.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.706+0000 7fe695ffb640 1 -- 172.21.15.136:0/220379273 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c031800 con 0x7fe69815a5b0 2024-02-17T12:57:42.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.709+0000 7fe695ffb640 1 -- 172.21.15.136:0/220379273 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c031960 con 0x7fe69815a5b0 2024-02-17T12:57:42.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.709+0000 7fe695ffb640 1 -- 172.21.15.136:0/220379273 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c031cf0 con 0x7fe69815a5b0 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 -- 172.21.15.136:0/220379273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe69815a5b0 msgr2=0x7fe6980c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 --2- 172.21.15.136:0/220379273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe69815a5b0 0x7fe6980c8be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0097d0 tx=0x7fe68c02b8a0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 -- 172.21.15.136:0/220379273 shutdown_connections 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 --2- 172.21.15.136:0/220379273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe69815a5b0 0x7fe6980c8be0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 -- 172.21.15.136:0/220379273 >> 172.21.15.136:0/220379273 conn(0x7fe698071a20 msgr2=0x7fe698071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 -- 172.21.15.136:0/220379273 shutdown_connections 2024-02-17T12:57:42.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.710+0000 7fe69d823640 1 -- 172.21.15.136:0/220379273 wait complete. 2024-02-17T12:57:42.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.712+0000 7fe69d823640 1 Processor -- start 2024-02-17T12:57:42.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.712+0000 7fe69d823640 1 -- start start 2024-02-17T12:57:42.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.713+0000 7fe69d823640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6980c6630 0x7fe6980c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:42.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.713+0000 7fe69d823640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 0x7fe6981f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:42.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.713+0000 7fe69d823640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6980ccfd0 0x7fe69814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:42.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.713+0000 7fe69d823640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69806f890 con 0x7fe6980ccfd0 2024-02-17T12:57:42.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.713+0000 7fe69d823640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6980c2ec0 con 0x7fe6980c6630 2024-02-17T12:57:42.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.713+0000 7fe69d823640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69813f680 con 0x7fe698150c70 2024-02-17T12:57:42.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.714+0000 7fe6967fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 0x7fe6981f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:42.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.714+0000 7fe6967fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 0x7fe6981f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:46264/0 (socket says 172.21.15.136:46264) 2024-02-17T12:57:42.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.714+0000 7fe6967fc640 1 -- 172.21.15.136:0/3870292918 learned_addr learned my addr 172.21.15.136:0/3870292918 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:42.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.717+0000 7fe696ffd640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6980c6630 0x7fe6980c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:42.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.719+0000 7fe6967fc640 1 -- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6980c6630 msgr2=0x7fe6980c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:42.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.719+0000 7fe6967fc640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6980c6630 0x7fe6980c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.719+0000 7fe6967fc640 1 -- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6980ccfd0 msgr2=0x7fe69814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:42.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.719+0000 7fe6967fc640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6980ccfd0 0x7fe69814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:42.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.719+0000 7fe6967fc640 1 -- 172.21.15.136:0/3870292918 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c009400 con 0x7fe698150c70 2024-02-17T12:57:42.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.725+0000 7fe6967fc640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 0x7fe6981f35d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe68c034040 tx=0x7fe68c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:42.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.729+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c03bcc0 con 0x7fe698150c70 2024-02-17T12:57:42.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.729+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c03be60 con 0x7fe698150c70 2024-02-17T12:57:42.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.729+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c045630 con 0x7fe698150c70 2024-02-17T12:57:42.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.729+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6980ca990 con 0x7fe698150c70 2024-02-17T12:57:42.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.729+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69813f3a0 con 0x7fe698150c70 2024-02-17T12:57:42.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.731+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6980cab20 con 0x7fe698150c70 2024-02-17T12:57:42.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.749+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fe68c0443a0 con 0x7fe698150c70 2024-02-17T12:57:42.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.749+0000 7fe67ffff640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe68406b7d0 0x7fe68406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:42.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.749+0000 7fe696ffd640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe68406b7d0 0x7fe68406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:42.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:42.750+0000 7fe696ffd640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe68406b7d0 0x7fe68406dc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe6880017f0 tx=0x7fe688009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:43.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.012+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe68c02e070 con 0x7fe698150c70 2024-02-17T12:57:43.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.030+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe68c077600 con 0x7fe698150c70 2024-02-17T12:57:43.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.326+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe69814ac30 con 0x7fe698150c70 2024-02-17T12:57:43.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.480+0000 7fe67ffff640 1 -- 172.21.15.136:0/3870292918 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fe68c07acc0 con 0x7fe698150c70 2024-02-17T12:57:43.471 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:43.471 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-02-17T12:57:43.471 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 1 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe68406b7d0 msgr2=0x7fe68406dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe68406b7d0 0x7fe68406dc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe6880017f0 tx=0x7fe688009040 comp rx=0 tx=0).stop 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 msgr2=0x7fe6981f35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 0x7fe6981f35d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe68c034040 tx=0x7fe68c0046c0 comp rx=0 tx=0).stop 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 shutdown_connections 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe68406b7d0 0x7fe68406dc90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6980ccfd0 0x7fe69814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe698150c70 0x7fe6981f35d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 --2- 172.21.15.136:0/3870292918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6980c6630 0x7fe6980c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 >> 172.21.15.136:0/3870292918 conn(0x7fe698071a20 msgr2=0x7fe698073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:43.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.482+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 shutdown_connections 2024-02-17T12:57:43.474 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:43.484+0000 7fe69d823640 1 -- 172.21.15.136:0/3870292918 wait complete. 2024-02-17T12:57:45.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:57:45.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.602+0000 7f6d60177640 1 Processor -- start 2024-02-17T12:57:45.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.602+0000 7f6d60177640 1 -- start start 2024-02-17T12:57:45.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.603+0000 7f6d60177640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6d580cbc00 0x7f6d5806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:45.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.603+0000 7f6d60177640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580cb470 con 0x7f6d580ca4e0 2024-02-17T12:57:45.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.603+0000 7f6d60177640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580cb750 con 0x7f6d581624d0 2024-02-17T12:57:45.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.603+0000 7f6d60177640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5815d1f0 con 0x7f6d580cbc00 2024-02-17T12:57:45.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.604+0000 7f6d5e714640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6d581624d0 0x7f6d581648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:53412/0 (socket says 172.21.15.136:53412) 2024-02-17T12:57:45.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.604+0000 7f6d5e714640 1 -- 172.21.15.136:0/258860608 learned_addr learned my addr 172.21.15.136:0/258860608 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:45.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.604+0000 7f6d5df13640 1 --2- 172.21.15.136:0/258860608 >> v2:172.21.15.160:3300/0 conn(0x7f6d580cbc00 0x7f6d5806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:45.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.611+0000 7f6d5df13640 1 -- 172.21.15.136:0/258860608 >> v1:172.21.15.160:6789/0 conn(0x7f6d581624d0 legacy=0x7f6d581648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:45.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.611+0000 7f6d5df13640 1 -- 172.21.15.136:0/258860608 >> v1:172.21.15.136:6789/0 conn(0x7f6d580ca4e0 legacy=0x7f6d580cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:45.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.611+0000 7f6d5df13640 1 -- 172.21.15.136:0/258860608 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5815d4d0 con 0x7f6d580cbc00 2024-02-17T12:57:45.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.616+0000 7f6d5df13640 1 --2- 172.21.15.136:0/258860608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580cbc00 0x7f6d5806acd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d540097a0 tx=0x7f6d5402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b5079699365bae8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.622+0000 7f6d5cf11640 1 -- 172.21.15.136:0/258860608 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54030610 con 0x7f6d580cbc00 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.622+0000 7f6d5cf11640 1 -- 172.21.15.136:0/258860608 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54030770 con 0x7f6d580cbc00 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.622+0000 7f6d5cf11640 1 -- 172.21.15.136:0/258860608 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54030b00 con 0x7f6d580cbc00 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 -- 172.21.15.136:0/258860608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580cbc00 msgr2=0x7f6d5806acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 --2- 172.21.15.136:0/258860608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580cbc00 0x7f6d5806acd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d540097a0 tx=0x7f6d5402b960 comp rx=0 tx=0).stop 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 -- 172.21.15.136:0/258860608 shutdown_connections 2024-02-17T12:57:45.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 --2- 172.21.15.136:0/258860608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580cbc00 0x7f6d5806acd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:45.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 -- 172.21.15.136:0/258860608 >> 172.21.15.136:0/258860608 conn(0x7f6d580721f0 msgr2=0x7f6d580725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:45.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 -- 172.21.15.136:0/258860608 shutdown_connections 2024-02-17T12:57:45.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.623+0000 7f6d60177640 1 -- 172.21.15.136:0/258860608 wait complete. 2024-02-17T12:57:45.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.625+0000 7f6d60177640 1 Processor -- start 2024-02-17T12:57:45.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.625+0000 7f6d60177640 1 -- start start 2024-02-17T12:57:45.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.626+0000 7f6d60177640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 0x7f6d5815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:45.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.626+0000 7f6d60177640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d580cbc00 0x7f6d581f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:45.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.626+0000 7f6d60177640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d581624d0 0x7f6d581f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.626+0000 7f6d60177640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581f34c0 con 0x7f6d580cbc00 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.626+0000 7f6d60177640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581eff30 con 0x7f6d580ca4e0 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.626+0000 7f6d60177640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58152390 con 0x7f6d581624d0 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.627+0000 7f6d5e714640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d581624d0 0x7f6d581f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.627+0000 7f6d5df13640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 0x7f6d5815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.627+0000 7f6d5d712640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d580cbc00 0x7f6d581f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.627+0000 7f6d5df13640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 0x7f6d5815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:58560/0 (socket says 172.21.15.136:58560) 2024-02-17T12:57:45.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.627+0000 7f6d5df13640 1 -- 172.21.15.136:0/2004590084 learned_addr learned my addr 172.21.15.136:0/2004590084 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:45.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.632+0000 7f6d5df13640 1 -- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d581624d0 msgr2=0x7f6d581f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:45.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.632+0000 7f6d5df13640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d581624d0 0x7f6d581f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:45.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.632+0000 7f6d5df13640 1 -- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d580cbc00 msgr2=0x7f6d581f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:45.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.632+0000 7f6d5df13640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d580cbc00 0x7f6d581f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:45.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.632+0000 7f6d5df13640 1 -- 172.21.15.136:0/2004590084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009400 con 0x7f6d580ca4e0 2024-02-17T12:57:45.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.636+0000 7f6d5df13640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 0x7f6d5815ad40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d5402bf70 tx=0x7f6d54004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:45.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.642+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5403e040 con 0x7f6d580ca4e0 2024-02-17T12:57:45.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.642+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54039cf0 con 0x7f6d580ca4e0 2024-02-17T12:57:45.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.642+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54044630 con 0x7f6d580ca4e0 2024-02-17T12:57:45.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.642+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5815b280 con 0x7f6d580ca4e0 2024-02-17T12:57:45.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.642+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d581f01f0 con 0x7f6d580ca4e0 2024-02-17T12:57:45.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.643+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58154220 con 0x7f6d580ca4e0 2024-02-17T12:57:45.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.676+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f6d5404d3b0 con 0x7f6d580ca4e0 2024-02-17T12:57:45.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.676+0000 7f6d4e7fc640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d3c06b7d0 0x7f6d3c06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:45.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.677+0000 7f6d5d712640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d3c06b7d0 0x7f6d3c06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:45.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.677+0000 7f6d5d712640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d3c06b7d0 0x7f6d3c06dc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d58143350 tx=0x7f6d48009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:45.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:45.681+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d5407b2f0 con 0x7f6d580ca4e0 2024-02-17T12:57:46.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.030+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d54077590 con 0x7f6d580ca4e0 2024-02-17T12:57:46.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.391+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d5815b280 con 0x7f6d580ca4e0 2024-02-17T12:57:46.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.653+0000 7f6d4e7fc640 1 -- 172.21.15.136:0/2004590084 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f6d54049230 con 0x7f6d580ca4e0 2024-02-17T12:57:46.645 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:46.645 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-02-17T12:57:46.645 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 1 2024-02-17T12:57:46.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d3c06b7d0 msgr2=0x7f6d3c06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:46.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d3c06b7d0 0x7f6d3c06dc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d58143350 tx=0x7f6d48009040 comp rx=0 tx=0).stop 2024-02-17T12:57:46.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 msgr2=0x7f6d5815ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:46.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 0x7f6d5815ad40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d5402bf70 tx=0x7f6d54004730 comp rx=0 tx=0).stop 2024-02-17T12:57:46.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 shutdown_connections 2024-02-17T12:57:46.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d3c06b7d0 0x7f6d3c06dc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:46.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d581624d0 0x7f6d581f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:46.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d580cbc00 0x7f6d581f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:46.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 --2- 172.21.15.136:0/2004590084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d580ca4e0 0x7f6d5815ad40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:46.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.656+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 >> 172.21.15.136:0/2004590084 conn(0x7f6d580721f0 msgr2=0x7f6d580c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:46.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.657+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 shutdown_connections 2024-02-17T12:57:46.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:46.657+0000 7f6d60177640 1 -- 172.21.15.136:0/2004590084 wait complete. 2024-02-17T12:57:48.211 INFO:tasks.ceph.mds.e.smithi136.stdout:starting mds.e at 2024-02-17T12:57:48.279 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-02-17T12:57:48.370 INFO:tasks.ceph.mds.c.smithi136.stdout:starting mds.c at 2024-02-17T12:57:48.385 INFO:tasks.ceph.mds.f.smithi160.stdout:starting mds.f at 2024-02-17T12:57:48.411 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-02-17T12:57:48.418 INFO:tasks.ceph.mds.a.smithi136.stdout:starting mds.a at 2024-02-17T12:57:48.660 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 Processor -- start 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 -- start start 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbcc00c7e30 0x7fbcc0070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 0x7fbcc0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc0157830 con 0x7fbcc0157450 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc006cd20 con 0x7fbcc00c7e30 2024-02-17T12:57:48.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.791+0000 7fbcc593a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc006c6f0 con 0x7fbcc006bbd0 2024-02-17T12:57:48.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.822+0000 7fbcbeffd640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fbcc0157450 0x7fbcc0159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53608/0 (socket says 172.21.15.136:53608) 2024-02-17T12:57:48.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.822+0000 7fbcbeffd640 1 -- 172.21.15.136:0/1265523890 learned_addr learned my addr 172.21.15.136:0/1265523890 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:48.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.823+0000 7fbcbf7fe640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 0x7fbcc0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:48.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.831+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619427043 0 0) 0x7fbcc0157830 con 0x7fbcc0157450 2024-02-17T12:57:48.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.831+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca8003520 con 0x7fbcc0157450 2024-02-17T12:57:48.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.833+0000 7fbcbe7fc640 1 --2- 172.21.15.136:0/1265523890 >> v2:172.21.15.160:3300/0 conn(0x7fbcc00c7e30 0x7fbcc0070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880875416 0 0) 0x7fbca8003520 con 0x7fbcc0157450 2024-02-17T12:57:48.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 msgr2=0x7fbcc0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 0x7fbcc0070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 >> v2:172.21.15.160:3300/0 conn(0x7fbcc00c7e30 msgr2=0x7fbcc0070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 --2- 172.21.15.136:0/1265523890 >> v2:172.21.15.160:3300/0 conn(0x7fbcc00c7e30 0x7fbcc0070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc00caab0 con 0x7fbcc0157450 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3338030640 0 0) 0x7fbcb0001670 con 0x7fbcc0157450 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 >> v1:172.21.15.136:6789/0 conn(0x7fbcc0157450 legacy=0x7fbcc0159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbca8003970 0x7fbca8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca80047c0 0x7fbca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 0x7fbca800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8005590 con 0x7fbca8003970 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca800bec0 con 0x7fbca80047c0 2024-02-17T12:57:48.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.834+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca800c000 con 0x7fbcc006bbd0 2024-02-17T12:57:48.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.839+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbca8003970 0x7fbca8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:48.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.841+0000 7fbcbeffd640 1 -- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 msgr2=0x7fbca800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:48.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.841+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc006bbd0 0x7fbca800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.841+0000 7fbcbeffd640 1 -- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca80047c0 msgr2=0x7fbca8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:48.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.841+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca80047c0 0x7fbca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.841+0000 7fbcbeffd640 1 -- 172.21.15.136:0/1265523890 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8003520 con 0x7fbca8003970 2024-02-17T12:57:48.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.843+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbca8003970 0x7fbca8003d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000c160 tx=0x7fbca80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f3d1c82ad55572 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:48.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0005ad0 con 0x7fbca8003970 2024-02-17T12:57:48.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0005c30 con 0x7fbca8003970 2024-02-17T12:57:48.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcbdffb640 1 -- 172.21.15.136:0/1265523890 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb002c810 con 0x7fbca8003970 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcc593a640 1 -- 172.21.15.136:0/1265523890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbca8003970 msgr2=0x7fbca8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcc593a640 1 --2- 172.21.15.136:0/1265523890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbca8003970 0x7fbca8003d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000c160 tx=0x7fbca80057f0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcbf7fe640 1 -- 172.21.15.136:0/1265523890 reap_dead start 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcc593a640 1 -- 172.21.15.136:0/1265523890 shutdown_connections 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.851+0000 7fbcc593a640 1 -- 172.21.15.136:0/1265523890 >> 172.21.15.136:0/1265523890 conn(0x7fbcc006fe80 msgr2=0x7fbcc006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.852+0000 7fbcc593a640 1 -- 172.21.15.136:0/1265523890 shutdown_connections 2024-02-17T12:57:48.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.852+0000 7fbcc593a640 1 -- 172.21.15.136:0/1265523890 wait complete. 2024-02-17T12:57:48.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.853+0000 7fbcc593a640 1 Processor -- start 2024-02-17T12:57:48.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.853+0000 7fbcc593a640 1 -- start start 2024-02-17T12:57:48.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcc593a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 0x7fbcc0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcc593a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc00c3dd0 0x7fbcc00cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcc593a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcc00cd900 0x7fbcc00c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcc593a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc01ef7e0 con 0x7fbcc00cd900 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcc593a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00cc320 con 0x7fbca8003970 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcc593a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00cc600 con 0x7fbcc00c3dd0 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.854+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 0x7fbcc0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.855+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 0x7fbcc0157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:58648/0 (socket says 172.21.15.136:58648) 2024-02-17T12:57:48.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.855+0000 7fbcbeffd640 1 -- 172.21.15.136:0/916394748 learned_addr learned my addr 172.21.15.136:0/916394748 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:48.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.856+0000 7fbcbf7fe640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcc00cd900 0x7fbcc00c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:48.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.858+0000 7fbcbeffd640 1 -- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc00c3dd0 msgr2=0x7fbcc00cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:48.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.858+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc00c3dd0 0x7fbcc00cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.858+0000 7fbcbeffd640 1 -- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcc00cd900 msgr2=0x7fbcc00c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:48.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.858+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcc00cd900 0x7fbcc00c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:48.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.858+0000 7fbcbeffd640 1 -- 172.21.15.136:0/916394748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc00cc8e0 con 0x7fbca8003970 2024-02-17T12:57:48.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.861+0000 7fbcbeffd640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 0x7fbcc0157c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000fb0 tx=0x7fbcb0000fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:48.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.864+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0039070 con 0x7fbca8003970 2024-02-17T12:57:48.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.865+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0007270 con 0x7fbca8003970 2024-02-17T12:57:48.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.865+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc00ccbc0 con 0x7fbca8003970 2024-02-17T12:57:48.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.865+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0007620 con 0x7fbca8003970 2024-02-17T12:57:48.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.865+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc00c7780 con 0x7fbca8003970 2024-02-17T12:57:48.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.866+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc0067e00 con 0x7fbca8003970 2024-02-17T12:57:48.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.893+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbcb0032070 con 0x7fbca8003970 2024-02-17T12:57:48.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.893+0000 7fbca7fff640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbcac06b860 0x7fbcac06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:48.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.893+0000 7fbcbe7fc640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbcac06b860 0x7fbcac06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:48.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:48.894+0000 7fbcbe7fc640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbcac06b860 0x7fbcac06dd20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00c3ac0 tx=0x7fbcb4008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:49.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.145+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbcb003c040 con 0x7fbca8003970 2024-02-17T12:57:49.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.155+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbcb0076520 con 0x7fbca8003970 2024-02-17T12:57:49.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.391+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcc004efc0 con 0x7fbca8003970 2024-02-17T12:57:49.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.416+0000 7fbca7fff640 1 -- 172.21.15.136:0/916394748 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fbcb002de60 con 0x7fbca8003970 2024-02-17T12:57:49.407 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:49.407 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-17T12:57:49.407 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 2 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbcac06b860 msgr2=0x7fbcac06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbcac06b860 0x7fbcac06dd20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00c3ac0 tx=0x7fbcb4008040 comp rx=0 tx=0).stop 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 msgr2=0x7fbcc0157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 0x7fbcc0157c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000fb0 tx=0x7fbcb0000fe0 comp rx=0 tx=0).stop 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 shutdown_connections 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbcac06b860 0x7fbcac06dd20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbcc00cd900 0x7fbcc00c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:49.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcc00c3dd0 0x7fbcc00cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:49.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 --2- 172.21.15.136:0/916394748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbca8003970 0x7fbcc0157c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:49.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 >> 172.21.15.136:0/916394748 conn(0x7fbcc006fe80 msgr2=0x7fbcc015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:49.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 shutdown_connections 2024-02-17T12:57:49.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:49.418+0000 7fbcc593a640 1 -- 172.21.15.136:0/916394748 wait complete. 2024-02-17T12:57:51.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:57:51.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.533+0000 7f01f3d25640 1 Processor -- start 2024-02-17T12:57:51.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 -- start start 2024-02-17T12:57:51.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01ec0c2640 0x7f01ec0668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f01ec0c2a20 0x7f01ec06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0c2e00 con 0x7f01ec0c2a20 2024-02-17T12:57:51.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0c6580 con 0x7f01ec0c2640 2024-02-17T12:57:51.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.534+0000 7f01f3d25640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0c6860 con 0x7f01ec06c010 2024-02-17T12:57:51.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.535+0000 7f01f12c0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f01ec0c2a20 0x7f01ec06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.535+0000 7f01f22c2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.535+0000 7f01f1ac1640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01ec0c2640 0x7f01ec0668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.535+0000 7f01f12c0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f01ec0c2a20 0x7f01ec06bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49694/0 (socket says 172.21.15.136:49694) 2024-02-17T12:57:51.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.535+0000 7f01f12c0640 1 -- 172.21.15.136:0/4204156032 learned_addr learned my addr 172.21.15.136:0/4204156032 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:51.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.537+0000 7f01f12c0640 1 -- 172.21.15.136:0/4204156032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 msgr2=0x7f01ec0c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:51.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.537+0000 7f01f12c0640 1 --2- 172.21.15.136:0/4204156032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.537+0000 7f01f12c0640 1 -- 172.21.15.136:0/4204156032 >> v2:172.21.15.160:3300/0 conn(0x7f01ec0c2640 msgr2=0x7f01ec0668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:51.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.537+0000 7f01f12c0640 1 --2- 172.21.15.136:0/4204156032 >> v2:172.21.15.160:3300/0 conn(0x7f01ec0c2640 0x7f01ec0668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.537+0000 7f01f12c0640 1 -- 172.21.15.136:0/4204156032 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec159fe0 con 0x7f01ec0c2a20 2024-02-17T12:57:51.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.539+0000 7f01f12c0640 1 --2- 172.21.15.136:0/4204156032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2a20 0x7f01ec06bad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01ec070ea0 tx=0x7f01dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474871732cfff3f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f0abf640 1 -- 172.21.15.136:0/4204156032 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc031870 con 0x7f01ec0c2a20 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f0abf640 1 -- 172.21.15.136:0/4204156032 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0319d0 con 0x7f01ec0c2a20 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f0abf640 1 -- 172.21.15.136:0/4204156032 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc031d60 con 0x7f01ec0c2a20 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 -- 172.21.15.136:0/4204156032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2a20 msgr2=0x7f01ec06bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 --2- 172.21.15.136:0/4204156032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2a20 0x7f01ec06bad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01ec070ea0 tx=0x7f01dc02b910 comp rx=0 tx=0).stop 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 -- 172.21.15.136:0/4204156032 shutdown_connections 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 --2- 172.21.15.136:0/4204156032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 --2- 172.21.15.136:0/4204156032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2a20 0x7f01ec06bad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 --2- 172.21.15.136:0/4204156032 >> v2:172.21.15.160:3300/0 conn(0x7f01ec0c2640 0x7f01ec0668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.543+0000 7f01f3d25640 1 -- 172.21.15.136:0/4204156032 >> 172.21.15.136:0/4204156032 conn(0x7f01ec0c8680 msgr2=0x7f01ec0c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:51.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.544+0000 7f01f3d25640 1 -- 172.21.15.136:0/4204156032 shutdown_connections 2024-02-17T12:57:51.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.544+0000 7f01f3d25640 1 -- 172.21.15.136:0/4204156032 wait complete. 2024-02-17T12:57:51.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.545+0000 7f01f3d25640 1 Processor -- start 2024-02-17T12:57:51.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.545+0000 7f01f3d25640 1 -- start start 2024-02-17T12:57:51.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f3d25640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f3d25640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 0x7f01ec1f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f3d25640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01ec0c2a20 0x7f01ec1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f3d25640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec159da0 con 0x7f01ec0c2640 2024-02-17T12:57:51.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f3d25640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1584e0 con 0x7f01ec0c2a20 2024-02-17T12:57:51.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f3d25640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1587c0 con 0x7f01ec06c010 2024-02-17T12:57:51.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f12c0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 0x7f01ec1f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f12c0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 0x7f01ec1f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49700/0 (socket says 172.21.15.136:49700) 2024-02-17T12:57:51.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f12c0640 1 -- 172.21.15.136:0/2303626861 learned_addr learned my addr 172.21.15.136:0/2303626861 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:51.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.546+0000 7f01f1ac1640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.547+0000 7f01f22c2640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01ec0c2a20 0x7f01ec1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.550+0000 7f01f12c0640 1 -- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 msgr2=0x7f01ec0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:51.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.550+0000 7f01f12c0640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.550+0000 7f01f12c0640 1 -- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01ec0c2a20 msgr2=0x7f01ec1f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:51.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.550+0000 7f01f12c0640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01ec0c2a20 0x7f01ec1f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:51.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.550+0000 7f01f12c0640 1 -- 172.21.15.136:0/2303626861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0094d0 con 0x7f01ec0c2640 2024-02-17T12:57:51.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.552+0000 7f01f12c0640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 0x7f01ec1f2e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01dc02b950 tx=0x7f01dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:51.546 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.555+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc03ac60 con 0x7f01ec0c2640 2024-02-17T12:57:51.546 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.555+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc03adc0 con 0x7f01ec0c2640 2024-02-17T12:57:51.546 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.556+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc044630 con 0x7f01ec0c2640 2024-02-17T12:57:51.546 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.556+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec158aa0 con 0x7f01ec0c2640 2024-02-17T12:57:51.546 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.556+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec157350 con 0x7f01ec0c2640 2024-02-17T12:57:51.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.556+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec158fc0 con 0x7f01ec0c2640 2024-02-17T12:57:51.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.578+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f01dc04d450 con 0x7f01ec0c2640 2024-02-17T12:57:51.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.578+0000 7f01e27fc640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f01d006b860 0x7f01d006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:51.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.578+0000 7f01f1ac1640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f01d006b860 0x7f01d006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:51.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.578+0000 7f01f1ac1640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f01d006b860 0x7f01d006dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009aa0 tx=0x7f01e8009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:51.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.581+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01dc02d040 con 0x7f01ec0c2640 2024-02-17T12:57:51.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:51.819+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01dc0775f0 con 0x7f01ec0c2640 2024-02-17T12:57:52.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.027+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01ec04efc0 con 0x7f01ec0c2640 2024-02-17T12:57:52.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.045+0000 7f01e27fc640 1 -- 172.21.15.136:0/2303626861 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5292 (secure 0 0 0) 0x7f01dc035020 con 0x7f01ec0c2640 2024-02-17T12:57:52.036 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:52.036 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4297,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-17T12:57:52.036 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 3 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f01d006b860 msgr2=0x7f01d006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f01d006b860 0x7f01d006dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009aa0 tx=0x7f01e8009190 comp rx=0 tx=0).stop 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 msgr2=0x7f01ec1f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 0x7f01ec1f2e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01dc02b950 tx=0x7f01dc0046c0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 shutdown_connections 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f01d006b860 0x7f01d006dd20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01ec0c2a20 0x7f01ec1f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f01ec0c2640 0x7f01ec1f2e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 --2- 172.21.15.136:0/2303626861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01ec06c010 0x7f01ec0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 >> 172.21.15.136:0/2303626861 conn(0x7f01ec0c8680 msgr2=0x7f01ec0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 shutdown_connections 2024-02-17T12:57:52.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.047+0000 7f01f3d25640 1 -- 172.21.15.136:0/2303626861 wait complete. 2024-02-17T12:57:52.049 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:57:52.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.161+0000 7f0ab50c9640 1 Processor -- start 2024-02-17T12:57:52.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.161+0000 7f0ab50c9640 1 -- start start 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0ab50c9640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cbc00 0x7f0ab006acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0ab50c9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 0x7f0ab00cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0ab50c9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab00cb470 con 0x7f0ab00cc520 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0ab50c9640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00cc950 con 0x7f0ab00cbc00 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0ab50c9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00cb750 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0aae59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 0x7f0ab00cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.162+0000 7f0aaed9d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cbc00 0x7f0ab006acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.163+0000 7f0aae59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 0x7f0ab00cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:53058/0 (socket says 172.21.15.136:53058) 2024-02-17T12:57:52.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.163+0000 7f0aae59c640 1 -- 172.21.15.136:0/346661380 learned_addr learned my addr 172.21.15.136:0/346661380 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:52.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.165+0000 7f0aae59c640 1 -- 172.21.15.136:0/346661380 >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cbc00 msgr2=0x7f0ab006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:52.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.165+0000 7f0aae59c640 1 --2- 172.21.15.136:0/346661380 >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cbc00 0x7f0ab006acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.165+0000 7f0aae59c640 1 -- 172.21.15.136:0/346661380 >> v1:172.21.15.136:6789/0 conn(0x7f0ab00cc520 legacy=0x7f0ab0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:52.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.165+0000 7f0aae59c640 1 -- 172.21.15.136:0/346661380 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab015d1f0 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.167+0000 7f0aae59c640 1 --2- 172.21.15.136:0/346661380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 0x7f0ab00cbfe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009850 tx=0x7f0aa002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c609520d83b1fc07 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:52.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.170+0000 7f0aadd9b640 1 -- 172.21.15.136:0/346661380 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0004230 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0aadd9b640 1 -- 172.21.15.136:0/346661380 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa0004390 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0aadd9b640 1 -- 172.21.15.136:0/346661380 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0031830 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 -- 172.21.15.136:0/346661380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 msgr2=0x7f0ab00cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/346661380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 0x7f0ab00cbfe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009850 tx=0x7f0aa002b8d0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 -- 172.21.15.136:0/346661380 shutdown_connections 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/346661380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00ca4e0 0x7f0ab00cbfe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/346661380 >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cbc00 0x7f0ab006acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 -- 172.21.15.136:0/346661380 >> 172.21.15.136:0/346661380 conn(0x7f0ab00721f0 msgr2=0x7f0ab00725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 -- 172.21.15.136:0/346661380 shutdown_connections 2024-02-17T12:57:52.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.171+0000 7f0ab50c9640 1 -- 172.21.15.136:0/346661380 wait complete. 2024-02-17T12:57:52.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 Processor -- start 2024-02-17T12:57:52.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 -- start start 2024-02-17T12:57:52.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 0x7f0ab01f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cbc00 0x7f0ab006af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00cc520 0x7f0ab01e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01f0a10 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01f4160 con 0x7f0ab00cbc00 2024-02-17T12:57:52.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.173+0000 7f0ab50c9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01e5d60 con 0x7f0ab00cc520 2024-02-17T12:57:52.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.175+0000 7f0aaed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 0x7f0ab01f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.175+0000 7f0aaed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 0x7f0ab01f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49712/0 (socket says 172.21.15.136:49712) 2024-02-17T12:57:52.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.175+0000 7f0aaed9d640 1 -- 172.21.15.136:0/416274504 learned_addr learned my addr 172.21.15.136:0/416274504 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:52.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.179+0000 7f0aaed9d640 1 -- 172.21.15.136:0/416274504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00cc520 msgr2=0x7f0ab01e5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.179+0000 7f0aaed9d640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00cc520 0x7f0ab01e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.179+0000 7f0aaed9d640 1 -- 172.21.15.136:0/416274504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cbc00 msgr2=0x7f0ab006af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.179+0000 7f0aaed9d640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cbc00 0x7f0ab006af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.179+0000 7f0aaed9d640 1 -- 172.21.15.136:0/416274504 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009460 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.181+0000 7f0aaed9d640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 0x7f0ab01f3c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400e9b0 tx=0x7f0aa400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:52.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.184+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4009670 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.184+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400c9a0 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.184+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400cd50 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.184+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab01efd90 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.184+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab01f0350 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.185+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab0150450 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.429+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0aa4013470 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.429+0000 7f0a977fe640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a9c06b860 0x7f0a9c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.430+0000 7f0aae59c640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a9c06b860 0x7f0a9c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.430+0000 7f0aae59c640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a9c06b860 0x7f0a9c06dd20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0035000 tx=0x7f0aa0030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:52.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.442+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0aa4059ac0 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.442+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0aa4055660 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.620+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ab004efc0 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.727+0000 7f0a977fe640 1 -- 172.21.15.136:0/416274504 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f0aa4021090 con 0x7f0ab00ca4e0 2024-02-17T12:57:52.718 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:52.718 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":16,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:57:45.343232+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:57:52.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.729+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a9c06b860 msgr2=0x7f0a9c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.729+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a9c06b860 0x7f0a9c06dd20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0035000 tx=0x7f0aa0030000 comp rx=0 tx=0).stop 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.729+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 msgr2=0x7f0ab01f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.729+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 0x7f0ab01f3c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400e9b0 tx=0x7f0aa400ee70 comp rx=0 tx=0).stop 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.729+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 shutdown_connections 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a9c06b860 0x7f0a9c06dd20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00cc520 0x7f0ab01e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cbc00 0x7f0ab006af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 --2- 172.21.15.136:0/416274504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab00ca4e0 0x7f0ab01f3c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 >> 172.21.15.136:0/416274504 conn(0x7f0ab00721f0 msgr2=0x7f0ab014d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 shutdown_connections 2024-02-17T12:57:52.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.730+0000 7f0ab50c9640 1 -- 172.21.15.136:0/416274504 wait complete. 2024-02-17T12:57:52.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:57:52.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:57:52.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.845+0000 7faaa049d640 1 Processor -- start 2024-02-17T12:57:52.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.845+0000 7faaa049d640 1 -- start start 2024-02-17T12:57:52.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faaa049d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa980c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faaa049d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faa9815db60 0x7faa980ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faaa049d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9815a980 con 0x7faa980cb420 2024-02-17T12:57:52.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faaa049d640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9815e130 con 0x7faa9815db60 2024-02-17T12:57:52.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faaa049d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa98159b60 con 0x7faa98153d50 2024-02-17T12:57:52.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faa9e239640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa980c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.846+0000 7faa9ea3a640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faa9815db60 0x7faa980ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.847+0000 7faa9e239640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa980c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:53088/0 (socket says 172.21.15.136:53088) 2024-02-17T12:57:52.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.847+0000 7faa9e239640 1 -- 172.21.15.136:0/487224294 learned_addr learned my addr 172.21.15.136:0/487224294 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:52.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.849+0000 7faa9e239640 1 -- 172.21.15.136:0/487224294 >> v2:172.21.15.160:3300/0 conn(0x7faa9815db60 msgr2=0x7faa980ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:52.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.849+0000 7faa9e239640 1 --2- 172.21.15.136:0/487224294 >> v2:172.21.15.160:3300/0 conn(0x7faa9815db60 0x7faa980ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.849+0000 7faa9e239640 1 -- 172.21.15.136:0/487224294 >> v1:172.21.15.160:6789/0 conn(0x7faa980cb420 legacy=0x7faa9806acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.849+0000 7faa9e239640 1 -- 172.21.15.136:0/487224294 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98159d70 con 0x7faa98153d50 2024-02-17T12:57:52.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.853+0000 7faa9e239640 1 --2- 172.21.15.136:0/487224294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa980c46a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa94009870 tx=0x7faa9402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a4a03f2796a9837 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:52.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.858+0000 7faa9d237640 1 -- 172.21.15.136:0/487224294 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9402f840 con 0x7faa98153d50 2024-02-17T12:57:52.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.858+0000 7faa9d237640 1 -- 172.21.15.136:0/487224294 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9402f9a0 con 0x7faa98153d50 2024-02-17T12:57:52.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.858+0000 7faa9d237640 1 -- 172.21.15.136:0/487224294 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9402fd30 con 0x7faa98153d50 2024-02-17T12:57:52.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 -- 172.21.15.136:0/487224294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 msgr2=0x7faa980c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 --2- 172.21.15.136:0/487224294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa980c46a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa94009870 tx=0x7faa9402ba20 comp rx=0 tx=0).stop 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 -- 172.21.15.136:0/487224294 shutdown_connections 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 --2- 172.21.15.136:0/487224294 >> v2:172.21.15.160:3300/0 conn(0x7faa9815db60 0x7faa980ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 --2- 172.21.15.136:0/487224294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa980c46a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 -- 172.21.15.136:0/487224294 >> 172.21.15.136:0/487224294 conn(0x7faa980721f0 msgr2=0x7faa980725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 -- 172.21.15.136:0/487224294 shutdown_connections 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.859+0000 7faaa049d640 1 -- 172.21.15.136:0/487224294 wait complete. 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.860+0000 7faaa049d640 1 Processor -- start 2024-02-17T12:57:52.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.860+0000 7faaa049d640 1 -- start start 2024-02-17T12:57:52.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faaa049d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 0x7faa98152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faaa049d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa981f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faaa049d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa9815db60 0x7faa98154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faaa049d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa98154450 con 0x7faa980cb420 2024-02-17T12:57:52.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faaa049d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa981e5e50 con 0x7faa9815db60 2024-02-17T12:57:52.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faaa049d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa981e5b70 con 0x7faa98153d50 2024-02-17T12:57:52.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faa9e239640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 0x7faa98152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faa9da38640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa981f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faa9ea3a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa9815db60 0x7faa98154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faa9e239640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 0x7faa98152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49722/0 (socket says 172.21.15.136:49722) 2024-02-17T12:57:52.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.861+0000 7faa9e239640 1 -- 172.21.15.136:0/199854223 learned_addr learned my addr 172.21.15.136:0/199854223 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:52.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.865+0000 7faa9e239640 1 -- 172.21.15.136:0/199854223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 msgr2=0x7faa981f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.865+0000 7faa9e239640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa981f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.865+0000 7faa9e239640 1 -- 172.21.15.136:0/199854223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa9815db60 msgr2=0x7faa98154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:52.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.865+0000 7faa9e239640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa9815db60 0x7faa98154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:52.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.865+0000 7faa9e239640 1 -- 172.21.15.136:0/199854223 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940094d0 con 0x7faa980cb420 2024-02-17T12:57:52.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.867+0000 7faa9e239640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 0x7faa98152d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa94009990 tx=0x7faa940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:52.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.871+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9403b040 con 0x7faa980cb420 2024-02-17T12:57:52.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.871+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94037c40 con 0x7faa980cb420 2024-02-17T12:57:52.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.871+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa981e4060 con 0x7faa980cb420 2024-02-17T12:57:52.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.871+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94042480 con 0x7faa980cb420 2024-02-17T12:57:52.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.871+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa981e4620 con 0x7faa980cb420 2024-02-17T12:57:52.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.872+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa98157580 con 0x7faa980cb420 2024-02-17T12:57:52.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.891+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7faa940425e0 con 0x7faa980cb420 2024-02-17T12:57:52.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.891+0000 7faa8effd640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7faa7c06b810 0x7faa7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:52.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.891+0000 7faa9da38640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7faa7c06b810 0x7faa7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:52.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.892+0000 7faa9da38640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7faa7c06b810 0x7faa7c06dcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa9815c190 tx=0x7faa88009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:52.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:52.895+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa9407c450 con 0x7faa980cb420 2024-02-17T12:57:53.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.132+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa940786f0 con 0x7faa980cb420 2024-02-17T12:57:53.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.308+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa9804efc0 con 0x7faa980cb420 2024-02-17T12:57:53.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.329+0000 7faa8effd640 1 -- 172.21.15.136:0/199854223 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa9407bdb0 con 0x7faa980cb420 2024-02-17T12:57:53.320 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7faa7c06b810 msgr2=0x7faa7c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7faa7c06b810 0x7faa7c06dcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa9815c190 tx=0x7faa88009040 comp rx=0 tx=0).stop 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 msgr2=0x7faa98152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 0x7faa98152d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa94009990 tx=0x7faa940046c0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 shutdown_connections 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7faa7c06b810 0x7faa7c06dcd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa9815db60 0x7faa98154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa98153d50 0x7faa981f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 --2- 172.21.15.136:0/199854223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa980cb420 0x7faa98152d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 >> 172.21.15.136:0/199854223 conn(0x7faa980721f0 msgr2=0x7faa980ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 shutdown_connections 2024-02-17T12:57:53.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.331+0000 7faaa049d640 1 -- 172.21.15.136:0/199854223 wait complete. 2024-02-17T12:57:53.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:57:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.442+0000 7f6cf189d640 1 Processor -- start 2024-02-17T12:57:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.442+0000 7f6cf189d640 1 -- start start 2024-02-17T12:57:53.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.443+0000 7f6cf189d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6cec0c4420 0x7f6cec0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.443+0000 7f6cf189d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.443+0000 7f6cf189d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0c8340 con 0x7f6cec151e20 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.443+0000 7f6cf189d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec0c9be0 con 0x7f6cec0c4420 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.443+0000 7f6cf189d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0ca3a0 con 0x7f6cec0c9750 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.444+0000 7f6cea7fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6cec0c4420 0x7f6cec0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.444+0000 7f6ceb7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.444+0000 7f6ceaffd640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6cec151e20 0x7f6cec0c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59234/0 (socket says 172.21.15.136:59234) 2024-02-17T12:57:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.444+0000 7f6ceaffd640 1 -- 172.21.15.136:0/2342437237 learned_addr learned my addr 172.21.15.136:0/2342437237 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.446+0000 7f6ceb7fe640 1 -- 172.21.15.136:0/2342437237 >> v2:172.21.15.136:3300/0 conn(0x7f6cec0c4420 msgr2=0x7f6cec0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.446+0000 7f6ceb7fe640 1 --2- 172.21.15.136:0/2342437237 >> v2:172.21.15.136:3300/0 conn(0x7f6cec0c4420 0x7f6cec0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.446+0000 7f6ceb7fe640 1 -- 172.21.15.136:0/2342437237 >> v1:172.21.15.136:6789/0 conn(0x7f6cec151e20 legacy=0x7f6cec0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.446+0000 7f6ceb7fe640 1 -- 172.21.15.136:0/2342437237 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0c94d0 con 0x7f6cec0c9750 2024-02-17T12:57:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.448+0000 7f6ceb7fe640 1 --2- 172.21.15.136:0/2342437237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec070720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097a0 tx=0x7f6ce402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ebb4a82b957ac7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.452+0000 7f6ce9ffb640 1 -- 172.21.15.136:0/2342437237 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4031830 con 0x7f6cec0c9750 2024-02-17T12:57:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.452+0000 7f6ce9ffb640 1 -- 172.21.15.136:0/2342437237 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4031990 con 0x7f6cec0c9750 2024-02-17T12:57:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.452+0000 7f6ce9ffb640 1 -- 172.21.15.136:0/2342437237 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4031d20 con 0x7f6cec0c9750 2024-02-17T12:57:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 -- 172.21.15.136:0/2342437237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 msgr2=0x7f6cec070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2342437237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec070720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097a0 tx=0x7f6ce402b8d0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 -- 172.21.15.136:0/2342437237 shutdown_connections 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2342437237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec070720 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2342437237 >> v2:172.21.15.136:3300/0 conn(0x7f6cec0c4420 0x7f6cec0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 -- 172.21.15.136:0/2342437237 >> 172.21.15.136:0/2342437237 conn(0x7f6cec06fe80 msgr2=0x7f6cec06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 -- 172.21.15.136:0/2342437237 shutdown_connections 2024-02-17T12:57:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.453+0000 7f6cf189d640 1 -- 172.21.15.136:0/2342437237 wait complete. 2024-02-17T12:57:53.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.454+0000 7f6cf189d640 1 Processor -- start 2024-02-17T12:57:53.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.454+0000 7f6cf189d640 1 -- start start 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cf189d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 0x7f6cec0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cf189d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec14b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cf189d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cec151e20 0x7f6cec158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cf189d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec14b800 con 0x7f6cec0c4420 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cf189d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec149de0 con 0x7f6cec151e20 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cf189d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec158490 con 0x7f6cec0c9750 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6ceaffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 0x7f6cec0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.455+0000 7f6cea7fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec14b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.456+0000 7f6ceaffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 0x7f6cec0c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49742/0 (socket says 172.21.15.136:49742) 2024-02-17T12:57:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.456+0000 7f6ceaffd640 1 -- 172.21.15.136:0/2656157374 learned_addr learned my addr 172.21.15.136:0/2656157374 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.456+0000 7f6ceb7fe640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cec151e20 0x7f6cec158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.459+0000 7f6ceaffd640 1 -- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 msgr2=0x7f6cec14b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.459+0000 7f6ceaffd640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec14b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.459+0000 7f6ceaffd640 1 -- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cec151e20 msgr2=0x7f6cec158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.459+0000 7f6ceaffd640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cec151e20 0x7f6cec158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.459+0000 7f6ceaffd640 1 -- 172.21.15.136:0/2656157374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4009400 con 0x7f6cec0c4420 2024-02-17T12:57:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.459+0000 7f6cea7fc640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec14b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:57:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.461+0000 7f6ceaffd640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 0x7f6cec0c4ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00cb40 tx=0x7f6cdc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.465+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00ac40 con 0x7f6cec0c4420 2024-02-17T12:57:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.465+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc00ada0 con 0x7f6cec0c4420 2024-02-17T12:57:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.465+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc012620 con 0x7f6cec0c4420 2024-02-17T12:57:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.465+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec158e60 con 0x7f6cec0c4420 2024-02-17T12:57:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.465+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec149820 con 0x7f6cec0c4420 2024-02-17T12:57:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.466+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec067e00 con 0x7f6cec0c4420 2024-02-17T12:57:53.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.712+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6cdc007070 con 0x7f6cec0c4420 2024-02-17T12:57:53.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.712+0000 7f6cd3fff640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6cd806b890 0x7f6cd806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:53.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.712+0000 7f6cea7fc640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6cd806b890 0x7f6cd806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:53.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.713+0000 7f6cea7fc640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6cd806b890 0x7f6cd806dd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0ce460 tx=0x7f6ce0009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:53.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.738+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6cdc058dc0 con 0x7f6cec0c4420 2024-02-17T12:57:53.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.738+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6cdc055060 con 0x7f6cec0c4420 2024-02-17T12:57:53.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.913+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6cec04efc0 con 0x7f6cec0c4420 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.918+0000 7f6cd3fff640 1 -- 172.21.15.136:0/2656157374 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6cdc017060 con 0x7f6cec0c4420 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout:[ 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 1, 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": ".mgr" 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-02-17T12:57:53.909 INFO:teuthology.orchestra.run.smithi136.stdout:] 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6cd806b890 msgr2=0x7f6cd806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6cd806b890 0x7f6cd806dd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0ce460 tx=0x7f6ce0009190 comp rx=0 tx=0).stop 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 msgr2=0x7f6cec0c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 0x7f6cec0c4ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00cb40 tx=0x7f6cdc00a060 comp rx=0 tx=0).stop 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 shutdown_connections 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6cd806b890 0x7f6cd806dd50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cec151e20 0x7f6cec158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cec0c9750 0x7f6cec14b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 --2- 172.21.15.136:0/2656157374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cec0c4420 0x7f6cec0c4ab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:53.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 >> 172.21.15.136:0/2656157374 conn(0x7f6cec06fe80 msgr2=0x7f6cec15ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:53.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 shutdown_connections 2024-02-17T12:57:53.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:53.921+0000 7f6cf189d640 1 -- 172.21.15.136:0/2656157374 wait complete. 2024-02-17T12:57:53.922 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T12:57:53.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T12:57:54.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.036+0000 7f6dbb0df640 1 Processor -- start 2024-02-17T12:57:54.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.036+0000 7f6dbb0df640 1 -- start start 2024-02-17T12:57:54.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.037+0000 7f6dbb0df640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6db4154fa0 0x7f6db40c2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:54.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.037+0000 7f6dbb0df640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db415b440 0x7f6db415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:54.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.037+0000 7f6dbb0df640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40c8e80 con 0x7f6db40caa70 2024-02-17T12:57:54.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.037+0000 7f6dbb0df640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40c9c50 con 0x7f6db4154fa0 2024-02-17T12:57:54.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.037+0000 7f6dbb0df640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415bdf0 con 0x7f6db415b440 2024-02-17T12:57:54.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.038+0000 7f6db967c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db415b440 0x7f6db415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:54.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.038+0000 7f6db3fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6db40caa70 0x7f6db4070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59248/0 (socket says 172.21.15.136:59248) 2024-02-17T12:57:54.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.038+0000 7f6db3fff640 1 -- 172.21.15.136:0/2812341251 learned_addr learned my addr 172.21.15.136:0/2812341251 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:54.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.038+0000 7f6db8e7b640 1 --2- 172.21.15.136:0/2812341251 >> v2:172.21.15.136:3300/0 conn(0x7f6db4154fa0 0x7f6db40c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:54.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.040+0000 7f6db967c640 1 -- 172.21.15.136:0/2812341251 >> v2:172.21.15.136:3300/0 conn(0x7f6db4154fa0 msgr2=0x7f6db40c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:54.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.040+0000 7f6db967c640 1 --2- 172.21.15.136:0/2812341251 >> v2:172.21.15.136:3300/0 conn(0x7f6db4154fa0 0x7f6db40c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:54.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.040+0000 7f6db967c640 1 -- 172.21.15.136:0/2812341251 >> v1:172.21.15.136:6789/0 conn(0x7f6db40caa70 legacy=0x7f6db4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:54.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.040+0000 7f6db967c640 1 -- 172.21.15.136:0/2812341251 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40c2840 con 0x7f6db415b440 2024-02-17T12:57:54.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.043+0000 7f6db967c640 1 --2- 172.21.15.136:0/2812341251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db415b440 0x7f6db415b8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6db40c2a30 tx=0x7f6dac02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea478cd455feb3d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:54.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.047+0000 7f6db37fe640 1 -- 172.21.15.136:0/2812341251 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac02cc40 con 0x7f6db415b440 2024-02-17T12:57:54.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.047+0000 7f6db37fe640 1 -- 172.21.15.136:0/2812341251 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac02cda0 con 0x7f6db415b440 2024-02-17T12:57:54.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.047+0000 7f6db37fe640 1 -- 172.21.15.136:0/2812341251 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac034660 con 0x7f6db415b440 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 -- 172.21.15.136:0/2812341251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db415b440 msgr2=0x7f6db415b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/2812341251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db415b440 0x7f6db415b8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6db40c2a30 tx=0x7f6dac02be90 comp rx=0 tx=0).stop 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 -- 172.21.15.136:0/2812341251 shutdown_connections 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/2812341251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db415b440 0x7f6db415b8b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/2812341251 >> v2:172.21.15.136:3300/0 conn(0x7f6db4154fa0 0x7f6db40c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 -- 172.21.15.136:0/2812341251 >> 172.21.15.136:0/2812341251 conn(0x7f6db406e900 msgr2=0x7f6db406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 -- 172.21.15.136:0/2812341251 shutdown_connections 2024-02-17T12:57:54.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.048+0000 7f6dbb0df640 1 -- 172.21.15.136:0/2812341251 wait complete. 2024-02-17T12:57:54.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.049+0000 7f6dbb0df640 1 Processor -- start 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.049+0000 7f6dbb0df640 1 -- start start 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6dbb0df640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 0x7f6db40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6dbb0df640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db4154fa0 0x7f6db4159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6dbb0df640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6db415b440 0x7f6db41edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6dbb0df640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41f0df0 con 0x7f6db40caa70 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6dbb0df640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41f10b0 con 0x7f6db415b440 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6dbb0df640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41f1390 con 0x7f6db4154fa0 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6db8e7b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 0x7f6db40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6db3fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db4154fa0 0x7f6db4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6db8e7b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 0x7f6db40b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49754/0 (socket says 172.21.15.136:49754) 2024-02-17T12:57:54.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.050+0000 7f6db8e7b640 1 -- 172.21.15.136:0/1610951996 learned_addr learned my addr 172.21.15.136:0/1610951996 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:54.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.051+0000 7f6db967c640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6db415b440 0x7f6db41edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:54.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.054+0000 7f6db8e7b640 1 -- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db4154fa0 msgr2=0x7f6db4159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:54.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.054+0000 7f6db8e7b640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db4154fa0 0x7f6db4159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:54.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.054+0000 7f6db8e7b640 1 -- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6db415b440 msgr2=0x7f6db41edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:54.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.054+0000 7f6db8e7b640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6db415b440 0x7f6db41edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:54.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.054+0000 7f6db8e7b640 1 -- 172.21.15.136:0/1610951996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009a70 con 0x7f6db40caa70 2024-02-17T12:57:54.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.056+0000 7f6db8e7b640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 0x7f6db40b2aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6da800e9b0 tx=0x7f6da800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:54.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.059+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8009670 con 0x7f6db40caa70 2024-02-17T12:57:54.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.059+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800c9a0 con 0x7f6db40caa70 2024-02-17T12:57:54.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.059+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800cd50 con 0x7f6db40caa70 2024-02-17T12:57:54.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.060+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db41f1670 con 0x7f6db40caa70 2024-02-17T12:57:54.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.060+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db41f1c30 con 0x7f6db40caa70 2024-02-17T12:57:54.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.060+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db40c9390 con 0x7f6db40caa70 2024-02-17T12:57:54.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.078+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6da8013470 con 0x7f6db40caa70 2024-02-17T12:57:54.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.078+0000 7f6db17fa640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d9806b810 0x7f6d9806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:54.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.078+0000 7f6db3fff640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d9806b810 0x7f6d9806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:54.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.079+0000 7f6db3fff640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d9806b810 0x7f6d9806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6db41e3cf0 tx=0x7f6da0007e80 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:54.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.081+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6da80592d0 con 0x7f6db40caa70 2024-02-17T12:57:54.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.318+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6da80b68c0 con 0x7f6db40caa70 2024-02-17T12:57:54.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:54.496+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6db40c9390 con 0x7f6db40caa70 2024-02-17T12:57:55.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.437+0000 7f6db17fa640 1 -- 172.21.15.136:0/1610951996 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6db40c9390 con 0x7f6db40caa70 2024-02-17T12:57:55.429 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' created 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d9806b810 msgr2=0x7f6d9806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d9806b810 0x7f6d9806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6db41e3cf0 tx=0x7f6da0007e80 comp rx=0 tx=0).stop 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 msgr2=0x7f6db40b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 0x7f6db40b2aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6da800e9b0 tx=0x7f6da800ee70 comp rx=0 tx=0).stop 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 shutdown_connections 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6d9806b810 0x7f6d9806dcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6db415b440 0x7f6db41edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6db4154fa0 0x7f6db4159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 --2- 172.21.15.136:0/1610951996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6db40caa70 0x7f6db40b2aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 >> 172.21.15.136:0/1610951996 conn(0x7f6db406e900 msgr2=0x7f6db4158e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 shutdown_connections 2024-02-17T12:57:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.439+0000 7f6dbb0df640 1 -- 172.21.15.136:0/1610951996 wait complete. 2024-02-17T12:57:55.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-02-17T12:57:55.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.568+0000 7efe6ce9d640 1 Processor -- start 2024-02-17T12:57:55.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.568+0000 7efe6ce9d640 1 -- start start 2024-02-17T12:57:55.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.568+0000 7efe6ce9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efe681634e0 0x7efe681658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:55.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.568+0000 7efe6ce9d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6806b3e0 con 0x7efe680ca4e0 2024-02-17T12:57:55.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.568+0000 7efe6ce9d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680cb470 con 0x7efe680cbc00 2024-02-17T12:57:55.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.568+0000 7efe6ce9d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe680cb750 con 0x7efe681634e0 2024-02-17T12:57:55.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.569+0000 7efe66d9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efe681634e0 0x7efe681658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:55.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.569+0000 7efe6659c640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7efe680cbc00 0x7efe6806acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:44692/0 (socket says 172.21.15.136:44692) 2024-02-17T12:57:55.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.569+0000 7efe6659c640 1 -- 172.21.15.136:0/1649520832 learned_addr learned my addr 172.21.15.136:0/1649520832 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:55.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.572+0000 7efe65d9b640 1 -- 172.21.15.136:0/1649520832 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290897150 0 0) 0x7efe680cb470 con 0x7efe680cbc00 2024-02-17T12:57:55.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.572+0000 7efe65d9b640 1 -- 172.21.15.136:0/1649520832 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe54003520 con 0x7efe680cbc00 2024-02-17T12:57:55.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.572+0000 7efe66d9d640 1 -- 172.21.15.136:0/1649520832 >> v1:172.21.15.160:6789/0 conn(0x7efe680cbc00 legacy=0x7efe6806acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.572+0000 7efe66d9d640 1 -- 172.21.15.136:0/1649520832 >> v1:172.21.15.136:6789/0 conn(0x7efe680ca4e0 legacy=0x7efe680cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.572+0000 7efe66d9d640 1 -- 172.21.15.136:0/1649520832 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6815d1f0 con 0x7efe681634e0 2024-02-17T12:57:55.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.576+0000 7efe66d9d640 1 --2- 172.21.15.136:0/1649520832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe681634e0 0x7efe681658d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe60009d90 tx=0x7efe6002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1242da357eea2c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:55.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.581+0000 7efe65d9b640 1 -- 172.21.15.136:0/1649520832 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6002cd00 con 0x7efe681634e0 2024-02-17T12:57:55.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.581+0000 7efe65d9b640 1 -- 172.21.15.136:0/1649520832 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6002ce60 con 0x7efe681634e0 2024-02-17T12:57:55.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.581+0000 7efe65d9b640 1 -- 172.21.15.136:0/1649520832 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60034660 con 0x7efe681634e0 2024-02-17T12:57:55.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 -- 172.21.15.136:0/1649520832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe681634e0 msgr2=0x7efe681658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/1649520832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe681634e0 0x7efe681658d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe60009d90 tx=0x7efe6002bf50 comp rx=0 tx=0).stop 2024-02-17T12:57:55.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 -- 172.21.15.136:0/1649520832 shutdown_connections 2024-02-17T12:57:55.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/1649520832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe681634e0 0x7efe681658d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 -- 172.21.15.136:0/1649520832 >> 172.21.15.136:0/1649520832 conn(0x7efe680721f0 msgr2=0x7efe680725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:55.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 -- 172.21.15.136:0/1649520832 shutdown_connections 2024-02-17T12:57:55.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.582+0000 7efe6ce9d640 1 -- 172.21.15.136:0/1649520832 wait complete. 2024-02-17T12:57:55.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.583+0000 7efe6ce9d640 1 Processor -- start 2024-02-17T12:57:55.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 -- start start 2024-02-17T12:57:55.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 0x7efe680c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:55.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe680cbc00 0x7efe6815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe681634e0 0x7efe68145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6815cac0 con 0x7efe680ca4e0 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680c2c60 con 0x7efe681634e0 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.584+0000 7efe6ce9d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680cd230 con 0x7efe680cbc00 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.585+0000 7efe6659c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 0x7efe680c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.585+0000 7efe66d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe681634e0 0x7efe68145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.585+0000 7efe5dd9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe680cbc00 0x7efe6815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.585+0000 7efe6659c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 0x7efe680c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49782/0 (socket says 172.21.15.136:49782) 2024-02-17T12:57:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.585+0000 7efe6659c640 1 -- 172.21.15.136:0/327071994 learned_addr learned my addr 172.21.15.136:0/327071994 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:55.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.588+0000 7efe6659c640 1 -- 172.21.15.136:0/327071994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe680cbc00 msgr2=0x7efe6815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.588+0000 7efe6659c640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe680cbc00 0x7efe6815bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.588+0000 7efe6659c640 1 -- 172.21.15.136:0/327071994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe681634e0 msgr2=0x7efe68145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.588+0000 7efe6659c640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe681634e0 0x7efe68145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.588+0000 7efe6659c640 1 -- 172.21.15.136:0/327071994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60009a70 con 0x7efe680ca4e0 2024-02-17T12:57:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.590+0000 7efe6659c640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 0x7efe680c2720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c430 tx=0x7efe5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.594+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58005ce0 con 0x7efe680ca4e0 2024-02-17T12:57:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.594+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58005e40 con 0x7efe680ca4e0 2024-02-17T12:57:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.594+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580072f0 con 0x7efe680ca4e0 2024-02-17T12:57:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.594+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6815cdc0 con 0x7efe680ca4e0 2024-02-17T12:57:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.594+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe68148380 con 0x7efe680ca4e0 2024-02-17T12:57:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.595+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe680726d0 con 0x7efe680ca4e0 2024-02-17T12:57:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.613+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7efe58007450 con 0x7efe680ca4e0 2024-02-17T12:57:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.613+0000 7efe5f7fe640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7efe4806b810 0x7efe4806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.613+0000 7efe5dd9b640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7efe4806b810 0x7efe4806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.613+0000 7efe5dd9b640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7efe4806b810 0x7efe4806dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe680cf300 tx=0x7efe50009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.616+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efe58058300 con 0x7efe680ca4e0 2024-02-17T12:57:55.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:55.851+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe580545a0 con 0x7efe680ca4e0 2024-02-17T12:57:56.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.027+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7efe680726d0 con 0x7efe680ca4e0 2024-02-17T12:57:56.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.598+0000 7efe5f7fe640 1 -- 172.21.15.136:0/327071994 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7efe680726d0 con 0x7efe680ca4e0 2024-02-17T12:57:56.590 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' created 2024-02-17T12:57:56.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7efe4806b810 msgr2=0x7efe4806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7efe4806b810 0x7efe4806dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe680cf300 tx=0x7efe50009040 comp rx=0 tx=0).stop 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 msgr2=0x7efe680c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 0x7efe680c2720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c430 tx=0x7efe5800c8f0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 shutdown_connections 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7efe4806b810 0x7efe4806dcd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe681634e0 0x7efe68145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe680cbc00 0x7efe6815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 --2- 172.21.15.136:0/327071994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe680ca4e0 0x7efe680c2720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 >> 172.21.15.136:0/327071994 conn(0x7efe680721f0 msgr2=0x7efe680cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 shutdown_connections 2024-02-17T12:57:56.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.600+0000 7efe6ce9d640 1 -- 172.21.15.136:0/327071994 wait complete. 2024-02-17T12:57:56.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T12:57:56.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.744+0000 7f7dbff8c640 1 Processor -- start 2024-02-17T12:57:56.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.744+0000 7f7dbff8c640 1 -- start start 2024-02-17T12:57:56.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbff8c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7db8153be0 0x7f7db80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:56.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbff8c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:56.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbff8c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7db806b830 0x7f7db80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:56.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbff8c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db80cadc0 con 0x7f7db806b830 2024-02-17T12:57:56.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbff8c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db815d610 con 0x7f7db8153be0 2024-02-17T12:57:56.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbff8c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db815d8f0 con 0x7f7db815a6e0 2024-02-17T12:57:56.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.745+0000 7f7dbe529640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7db806b830 0x7f7db80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:56.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.746+0000 7f7dbe529640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7db806b830 0x7f7db80cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49794/0 (socket says 172.21.15.136:49794) 2024-02-17T12:57:56.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.746+0000 7f7dbe529640 1 -- 172.21.15.136:0/2021057341 learned_addr learned my addr 172.21.15.136:0/2021057341 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:56.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.748+0000 7f7dbe529640 1 -- 172.21.15.136:0/2021057341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 msgr2=0x7f7db806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:56.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.748+0000 7f7dbe529640 1 --2- 172.21.15.136:0/2021057341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.748+0000 7f7dbe529640 1 -- 172.21.15.136:0/2021057341 >> v2:172.21.15.160:3300/0 conn(0x7f7db8153be0 msgr2=0x7f7db80c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:56.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.748+0000 7f7dbe529640 1 --2- 172.21.15.136:0/2021057341 >> v2:172.21.15.160:3300/0 conn(0x7f7db8153be0 0x7f7db80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.748+0000 7f7dbe529640 1 -- 172.21.15.136:0/2021057341 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db815dbd0 con 0x7f7db806b830 2024-02-17T12:57:56.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.750+0000 7f7dbe529640 1 --2- 172.21.15.136:0/2021057341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db806b830 0x7f7db80cb2a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7db806ddb0 tx=0x7f7db002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aab6c2b6de7e415 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:56.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.761+0000 7f7dbcd26640 1 -- 172.21.15.136:0/2021057341 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db002cb00 con 0x7f7db806b830 2024-02-17T12:57:56.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.761+0000 7f7dbcd26640 1 -- 172.21.15.136:0/2021057341 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db002cc60 con 0x7f7db806b830 2024-02-17T12:57:56.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.761+0000 7f7dbcd26640 1 -- 172.21.15.136:0/2021057341 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00343f0 con 0x7f7db806b830 2024-02-17T12:57:56.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2021057341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db806b830 msgr2=0x7f7db80cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:56.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2021057341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db806b830 0x7f7db80cb2a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7db806ddb0 tx=0x7f7db002bf60 comp rx=0 tx=0).stop 2024-02-17T12:57:56.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2021057341 shutdown_connections 2024-02-17T12:57:56.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2021057341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db806b830 0x7f7db80cb2a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2021057341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2021057341 >> v2:172.21.15.160:3300/0 conn(0x7f7db8153be0 0x7f7db80c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2021057341 >> 172.21.15.136:0/2021057341 conn(0x7f7db806ca00 msgr2=0x7f7db806d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:56.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2021057341 shutdown_connections 2024-02-17T12:57:56.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.762+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2021057341 wait complete. 2024-02-17T12:57:56.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.763+0000 7f7dbff8c640 1 Processor -- start 2024-02-17T12:57:56.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.763+0000 7f7dbff8c640 1 -- start start 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.764+0000 7f7dbff8c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7db806b830 0x7f7db8143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.764+0000 7f7dbff8c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db8153be0 0x7f7db81f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.764+0000 7f7dbff8c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db81f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.764+0000 7f7dbff8c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db8144710 con 0x7f7db8153be0 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.764+0000 7f7dbff8c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db81f3960 con 0x7f7db806b830 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.764+0000 7f7dbff8c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db81f3c00 con 0x7f7db815a6e0 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.765+0000 7f7dbe529640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db81f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.765+0000 7f7dbe529640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db81f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:53150/0 (socket says 172.21.15.136:53150) 2024-02-17T12:57:56.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.765+0000 7f7dbe529640 1 -- 172.21.15.136:0/2215569366 learned_addr learned my addr 172.21.15.136:0/2215569366 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:56.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.767+0000 7f7dbdd28640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7db806b830 0x7f7db8143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:56.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.769+0000 7f7dbe529640 1 -- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7db806b830 msgr2=0x7f7db8143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:56.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.769+0000 7f7dbe529640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7db806b830 0x7f7db8143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.769+0000 7f7dbe529640 1 -- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db8153be0 msgr2=0x7f7db81f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:56.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.769+0000 7f7dbe529640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db8153be0 0x7f7db81f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:56.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.769+0000 7f7dbe529640 1 -- 172.21.15.136:0/2215569366 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db0009b30 con 0x7f7db815a6e0 2024-02-17T12:57:56.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.771+0000 7f7dbe529640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db81f3270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7db0036040 tx=0x7f7db0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:56.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.774+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0009510 con 0x7f7db815a6e0 2024-02-17T12:57:56.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.774+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db80cdf40 con 0x7f7db815a6e0 2024-02-17T12:57:56.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.774+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db80ce500 con 0x7f7db815a6e0 2024-02-17T12:57:56.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:56.775+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db8157da0 con 0x7f7db815a6e0 2024-02-17T12:57:57.032 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.041+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db003e450 con 0x7f7db815a6e0 2024-02-17T12:57:57.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.041+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db003e7c0 con 0x7f7db815a6e0 2024-02-17T12:57:57.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.042+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7db003e960 con 0x7f7db815a6e0 2024-02-17T12:57:57.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.042+0000 7f7dae7fc640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d9c06b810 0x7f7d9c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.042+0000 7f7dbdd28640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d9c06b810 0x7f7d9c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:57.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.043+0000 7f7dbdd28640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d9c06b810 0x7f7d9c06dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009990 tx=0x7f7da8009110 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:57.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.046+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7db007c4d0 con 0x7f7db815a6e0 2024-02-17T12:57:57.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.056+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7db0078070 con 0x7f7db815a6e0 2024-02-17T12:57:57.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.263+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7db804efc0 con 0x7f7db815a6e0 2024-02-17T12:57:57.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.786+0000 7f7dae7fc640 1 -- 172.21.15.136:0/2215569366 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7db007b730 con 0x7f7db815a6e0 2024-02-17T12:57:57.778 INFO:teuthology.orchestra.run.smithi136.stderr:new fs with metadata pool 2 and data pool 3 2024-02-17T12:57:57.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.789+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d9c06b810 msgr2=0x7f7d9c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:57.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.789+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d9c06b810 0x7f7d9c06dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009990 tx=0x7f7da8009110 comp rx=0 tx=0).stop 2024-02-17T12:57:57.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.789+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 msgr2=0x7f7db81f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:57.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.789+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db81f3270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7db0036040 tx=0x7f7db0004a40 comp rx=0 tx=0).stop 2024-02-17T12:57:57.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.791+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 shutdown_connections 2024-02-17T12:57:57.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.791+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d9c06b810 0x7f7d9c06dcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.791+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7db815a6e0 0x7f7db81f3270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.791+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db8153be0 0x7f7db81f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.791+0000 7f7dbff8c640 1 --2- 172.21.15.136:0/2215569366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7db806b830 0x7f7db8143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.791+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 >> 172.21.15.136:0/2215569366 conn(0x7f7db806ca00 msgr2=0x7f7db80c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:57.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.793+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 shutdown_connections 2024-02-17T12:57:57.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.793+0000 7f7dbff8c640 1 -- 172.21.15.136:0/2215569366 wait complete. 2024-02-17T12:57:57.803 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-02-17T12:57:57.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-02-17T12:57:57.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.923+0000 7fd964a1c640 1 Processor -- start 2024-02-17T12:57:57.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.924+0000 7fd964a1c640 1 -- start start 2024-02-17T12:57:57.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.924+0000 7fd964a1c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd960154120 0x7fd9600c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.924+0000 7fd964a1c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd9600c78b0 0x7fd9600ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.924+0000 7fd964a1c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600c71e0 con 0x7fd9600c7490 2024-02-17T12:57:57.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.924+0000 7fd964a1c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96015dbd0 con 0x7fd9600c78b0 2024-02-17T12:57:57.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.924+0000 7fd964a1c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9600c6f00 con 0x7fd960154120 2024-02-17T12:57:57.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.931+0000 7fd95e59c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd960154120 0x7fd9600c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:57.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.931+0000 7fd95e59c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd960154120 0x7fd9600c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:46700/0 (socket says 172.21.15.136:46700) 2024-02-17T12:57:57.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.931+0000 7fd95e59c640 1 -- 172.21.15.136:0/2816783357 learned_addr learned my addr 172.21.15.136:0/2816783357 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:57.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.934+0000 7fd95e59c640 1 -- 172.21.15.136:0/2816783357 >> v2:172.21.15.136:3300/0 conn(0x7fd9600c78b0 msgr2=0x7fd9600ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:57.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.934+0000 7fd95e59c640 1 --2- 172.21.15.136:0/2816783357 >> v2:172.21.15.136:3300/0 conn(0x7fd9600c78b0 0x7fd9600ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.934+0000 7fd95e59c640 1 -- 172.21.15.136:0/2816783357 >> v1:172.21.15.136:6789/0 conn(0x7fd9600c7490 legacy=0x7fd9600cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:57.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.934+0000 7fd95e59c640 1 -- 172.21.15.136:0/2816783357 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96015d2a0 con 0x7fd960154120 2024-02-17T12:57:57.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.936+0000 7fd95e59c640 1 --2- 172.21.15.136:0/2816783357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd960154120 0x7fd9600c6850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9600cff00 tx=0x7fd95002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6d6c6112173b2d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:57.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.939+0000 7fd95d59a640 1 -- 172.21.15.136:0/2816783357 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950031870 con 0x7fd960154120 2024-02-17T12:57:57.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd95d59a640 1 -- 172.21.15.136:0/2816783357 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9500319d0 con 0x7fd960154120 2024-02-17T12:57:57.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd95d59a640 1 -- 172.21.15.136:0/2816783357 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950031d60 con 0x7fd960154120 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 -- 172.21.15.136:0/2816783357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd960154120 msgr2=0x7fd9600c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 --2- 172.21.15.136:0/2816783357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd960154120 0x7fd9600c6850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9600cff00 tx=0x7fd95002b910 comp rx=0 tx=0).stop 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 -- 172.21.15.136:0/2816783357 shutdown_connections 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 --2- 172.21.15.136:0/2816783357 >> v2:172.21.15.136:3300/0 conn(0x7fd9600c78b0 0x7fd9600ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 --2- 172.21.15.136:0/2816783357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd960154120 0x7fd9600c6850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 -- 172.21.15.136:0/2816783357 >> 172.21.15.136:0/2816783357 conn(0x7fd96006d450 msgr2=0x7fd96006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 -- 172.21.15.136:0/2816783357 shutdown_connections 2024-02-17T12:57:57.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.940+0000 7fd964a1c640 1 -- 172.21.15.136:0/2816783357 wait complete. 2024-02-17T12:57:57.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 Processor -- start 2024-02-17T12:57:57.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 -- start start 2024-02-17T12:57:57.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9600c7490 0x7fd9601f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 0x7fd96015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd960154120 0x7fd96015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601f39f0 con 0x7fd9600c7490 2024-02-17T12:57:57.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601f3cd0 con 0x7fd9600c78b0 2024-02-17T12:57:57.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.942+0000 7fd964a1c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600cee40 con 0x7fd960154120 2024-02-17T12:57:57.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.943+0000 7fd95dd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 0x7fd96015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:57.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.943+0000 7fd95ed9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd960154120 0x7fd96015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:57.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.943+0000 7fd95dd9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 0x7fd96015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:46716/0 (socket says 172.21.15.136:46716) 2024-02-17T12:57:57.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.943+0000 7fd95dd9b640 1 -- 172.21.15.136:0/995442601 learned_addr learned my addr 172.21.15.136:0/995442601 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.946+0000 7fd95dd9b640 1 -- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd960154120 msgr2=0x7fd96015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.946+0000 7fd95dd9b640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd960154120 0x7fd96015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.946+0000 7fd95dd9b640 1 -- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9600c7490 msgr2=0x7fd9601f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.946+0000 7fd95dd9b640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9600c7490 0x7fd9601f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.946+0000 7fd95dd9b640 1 -- 172.21.15.136:0/995442601 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500094d0 con 0x7fd9600c78b0 2024-02-17T12:57:57.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.951+0000 7fd95dd9b640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 0x7fd96015c010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c410 tx=0x7fd95400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:57.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.954+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540035f0 con 0x7fd9600c78b0 2024-02-17T12:57:57.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.954+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954003750 con 0x7fd9600c78b0 2024-02-17T12:57:57.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.954+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9600cf120 con 0x7fd9600c78b0 2024-02-17T12:57:57.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.954+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954003b40 con 0x7fd9600c78b0 2024-02-17T12:57:57.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.954+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96015a790 con 0x7fd9600c78b0 2024-02-17T12:57:57.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.955+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9600cadf0 con 0x7fd9600c78b0 2024-02-17T12:57:57.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.973+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd954003ca0 con 0x7fd9600c78b0 2024-02-17T12:57:57.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.973+0000 7fd94effd640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd94006b890 0x7fd94006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:57.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.974+0000 7fd95e59c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd94006b890 0x7fd94006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:57.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.974+0000 7fd95e59c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd94006b890 0x7fd94006dd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd950036000 tx=0x7fd950030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:57.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:57.976+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd954058430 con 0x7fd9600c78b0 2024-02-17T12:57:58.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.217+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9540546d0 con 0x7fd9600c78b0 2024-02-17T12:57:58.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.403+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd96015e040 con 0x7fd9600c78b0 2024-02-17T12:57:58.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.702+0000 7fd94effd640 1 -- 172.21.15.136:0/995442601 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd96015e040 con 0x7fd9600c78b0 2024-02-17T12:57:58.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd94006b890 msgr2=0x7fd94006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd94006b890 0x7fd94006dd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd950036000 tx=0x7fd950030000 comp rx=0 tx=0).stop 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 msgr2=0x7fd96015c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 0x7fd96015c010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c410 tx=0x7fd95400c8d0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 shutdown_connections 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd94006b890 0x7fd94006dd50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd960154120 0x7fd96015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9600c78b0 0x7fd96015c010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 --2- 172.21.15.136:0/995442601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9600c7490 0x7fd9601f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 >> 172.21.15.136:0/995442601 conn(0x7fd96006d450 msgr2=0x7fd960150550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 shutdown_connections 2024-02-17T12:57:58.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.705+0000 7fd964a1c640 1 -- 172.21.15.136:0/995442601 wait complete. 2024-02-17T12:57:58.708 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:57:58.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 Processor -- start 2024-02-17T12:57:58.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 -- start start 2024-02-17T12:57:58.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec151f30 0x7fc6ec0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:58.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc6ec06ff90 0x7fc6ec0c2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:58.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0c7ed0 con 0x7fc6ec06f480 2024-02-17T12:57:58.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c2d80 con 0x7fc6ec06ff90 2024-02-17T12:57:58.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.826+0000 7fc6f2f3a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec158560 con 0x7fc6ec151f30 2024-02-17T12:57:58.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.827+0000 7fc6f0cd6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec151f30 0x7fc6ec0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:58.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.827+0000 7fc6ebfff640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc6ec06f480 0x7fc6ec0cd440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:44706/0 (socket says 172.21.15.136:44706) 2024-02-17T12:57:58.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.827+0000 7fc6ebfff640 1 -- 172.21.15.136:0/3982888425 learned_addr learned my addr 172.21.15.136:0/3982888425 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:57:58.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.830+0000 7fc6f0cd6640 1 -- 172.21.15.136:0/3982888425 >> v2:172.21.15.136:3300/0 conn(0x7fc6ec06ff90 msgr2=0x7fc6ec0c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:57:58.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.830+0000 7fc6f0cd6640 1 --2- 172.21.15.136:0/3982888425 >> v2:172.21.15.136:3300/0 conn(0x7fc6ec06ff90 0x7fc6ec0c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.830+0000 7fc6f0cd6640 1 -- 172.21.15.136:0/3982888425 >> v1:172.21.15.160:6789/0 conn(0x7fc6ec06f480 legacy=0x7fc6ec0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:58.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.830+0000 7fc6f0cd6640 1 -- 172.21.15.136:0/3982888425 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec158800 con 0x7fc6ec151f30 2024-02-17T12:57:58.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.832+0000 7fc6f0cd6640 1 --2- 172.21.15.136:0/3982888425 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec151f30 0x7fc6ec0c92b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00097a0 tx=0x7fc6e002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be22b582b8fe3df server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:58.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.836+0000 7fc6eb7fe640 1 -- 172.21.15.136:0/3982888425 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0031830 con 0x7fc6ec151f30 2024-02-17T12:57:58.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.836+0000 7fc6eb7fe640 1 -- 172.21.15.136:0/3982888425 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0031990 con 0x7fc6ec151f30 2024-02-17T12:57:58.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.836+0000 7fc6eb7fe640 1 -- 172.21.15.136:0/3982888425 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0031d20 con 0x7fc6ec151f30 2024-02-17T12:57:58.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.836+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/3982888425 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec151f30 msgr2=0x7fc6ec0c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:58.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.836+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/3982888425 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec151f30 0x7fc6ec0c92b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00097a0 tx=0x7fc6e002b8d0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.837+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/3982888425 shutdown_connections 2024-02-17T12:57:58.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.837+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/3982888425 >> v2:172.21.15.136:3300/0 conn(0x7fc6ec06ff90 0x7fc6ec0c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.837+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/3982888425 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec151f30 0x7fc6ec0c92b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.837+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/3982888425 >> 172.21.15.136:0/3982888425 conn(0x7fc6ec06aee0 msgr2=0x7fc6ec0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:57:58.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.837+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/3982888425 shutdown_connections 2024-02-17T12:57:58.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.837+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/3982888425 wait complete. 2024-02-17T12:57:58.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.838+0000 7fc6f2f3a640 1 Processor -- start 2024-02-17T12:57:58.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.838+0000 7fc6f2f3a640 1 -- start start 2024-02-17T12:57:58.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f2f3a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec06f480 0x7fc6ec14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:58.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f2f3a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ec06ff90 0x7fc6ec14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f2f3a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 0x7fc6ec14c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f2f3a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec14d930 con 0x7fc6ec151f30 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f2f3a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c5c60 con 0x7fc6ec06ff90 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f2f3a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c4cf0 con 0x7fc6ec06f480 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f14d7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 0x7fc6ec14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6ebfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ec06ff90 0x7fc6ec14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f14d7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 0x7fc6ec14c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49850/0 (socket says 172.21.15.136:49850) 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.839+0000 7fc6f14d7640 1 -- 172.21.15.136:0/654796980 learned_addr learned my addr 172.21.15.136:0/654796980 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:57:58.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.840+0000 7fc6f0cd6640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec06f480 0x7fc6ec14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:58.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.843+0000 7fc6f14d7640 1 -- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec06f480 msgr2=0x7fc6ec14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:58.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.843+0000 7fc6f14d7640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec06f480 0x7fc6ec14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.843+0000 7fc6f14d7640 1 -- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ec06ff90 msgr2=0x7fc6ec14d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:57:58.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.843+0000 7fc6f14d7640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ec06ff90 0x7fc6ec14d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:57:58.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.843+0000 7fc6f14d7640 1 -- 172.21.15.136:0/654796980 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009400 con 0x7fc6ec151f30 2024-02-17T12:57:58.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.845+0000 7fc6f14d7640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 0x7fc6ec14c320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400b970 tx=0x7fc6e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:58.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.849+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400cb40 con 0x7fc6ec151f30 2024-02-17T12:57:58.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.849+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e400ccc0 con 0x7fc6ec151f30 2024-02-17T12:57:58.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.849+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4014680 con 0x7fc6ec151f30 2024-02-17T12:57:58.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.849+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec0c4fb0 con 0x7fc6ec151f30 2024-02-17T12:57:58.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.850+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec0c5eb0 con 0x7fc6ec151f30 2024-02-17T12:57:58.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:58.851+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec069970 con 0x7fc6ec151f30 2024-02-17T12:57:59.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:57:59.127 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:57:59.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.171+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc6e401d3b0 con 0x7fc6ec151f30 2024-02-17T12:57:59.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.172+0000 7fc6e97fa640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc6d006b810 0x7fc6d006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:57:59.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.172+0000 7fc6f0cd6640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc6d006b810 0x7fc6d006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:57:59.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.172+0000 7fc6f0cd6640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc6d006b810 0x7fc6d006dcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0036000 tx=0x7fc6e003c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:57:59.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.184+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6007+0+0 (secure 0 0 0) 0x7fc6e400ce30 con 0x7fc6ec151f30 2024-02-17T12:57:59.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.185+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6e4054fe0 con 0x7fc6ec151f30 2024-02-17T12:57:59.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:57:59.366+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc6ec06fd70 con 0x7fc6ec151f30 2024-02-17T12:58:01.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.271+0000 7fc6e97fa640 1 -- 172.21.15.136:0/654796980 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc6e4019020 con 0x7fc6ec151f30 2024-02-17T12:58:01.263 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data_ec' created 2024-02-17T12:58:01.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc6d006b810 msgr2=0x7fc6d006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:01.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc6d006b810 0x7fc6d006dcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0036000 tx=0x7fc6e003c040 comp rx=0 tx=0).stop 2024-02-17T12:58:01.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 msgr2=0x7fc6ec14c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:01.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 0x7fc6ec14c320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400b970 tx=0x7fc6e400be30 comp rx=0 tx=0).stop 2024-02-17T12:58:01.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 shutdown_connections 2024-02-17T12:58:01.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc6d006b810 0x7fc6d006dcd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6ec151f30 0x7fc6ec14c320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ec06ff90 0x7fc6ec14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 --2- 172.21.15.136:0/654796980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ec06f480 0x7fc6ec14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 >> 172.21.15.136:0/654796980 conn(0x7fc6ec06aee0 msgr2=0x7fc6ec0c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 shutdown_connections 2024-02-17T12:58:01.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.273+0000 7fc6f2f3a640 1 -- 172.21.15.136:0/654796980 wait complete. 2024-02-17T12:58:01.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-02-17T12:58:01.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.398+0000 7fe2acf13640 1 Processor -- start 2024-02-17T12:58:01.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.398+0000 7fe2acf13640 1 -- start start 2024-02-17T12:58:01.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.399+0000 7fe2acf13640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 0x7fe2a80afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:01.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.399+0000 7fe2acf13640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe2a80c8630 0x7fe2a81645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:01.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.399+0000 7fe2acf13640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80c8b00 con 0x7fe2a8157360 2024-02-17T12:58:01.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.399+0000 7fe2acf13640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a806f330 con 0x7fe2a80c8630 2024-02-17T12:58:01.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.399+0000 7fe2acf13640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80b02d0 con 0x7fe2a806d950 2024-02-17T12:58:01.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.400+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 0x7fe2a80afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:01.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.400+0000 7fe2a6d9d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe2a80c8630 0x7fe2a81645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:01.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.400+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 0x7fe2a80afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:53178/0 (socket says 172.21.15.136:53178) 2024-02-17T12:58:01.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.400+0000 7fe29ffff640 1 -- 172.21.15.136:0/1294756201 learned_addr learned my addr 172.21.15.136:0/1294756201 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:01.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.403+0000 7fe29ffff640 1 -- 172.21.15.136:0/1294756201 >> v2:172.21.15.160:3300/0 conn(0x7fe2a80c8630 msgr2=0x7fe2a81645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:01.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.403+0000 7fe29ffff640 1 --2- 172.21.15.136:0/1294756201 >> v2:172.21.15.160:3300/0 conn(0x7fe2a80c8630 0x7fe2a81645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.403+0000 7fe29ffff640 1 -- 172.21.15.136:0/1294756201 >> v1:172.21.15.160:6789/0 conn(0x7fe2a8157360 legacy=0x7fe2a80cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:01.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.403+0000 7fe29ffff640 1 -- 172.21.15.136:0/1294756201 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a806f800 con 0x7fe2a806d950 2024-02-17T12:58:01.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.405+0000 7fe29ffff640 1 --2- 172.21.15.136:0/1294756201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 0x7fe2a80afd90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe290009870 tx=0x7fe29002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baad3fcb9dbca1a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:01.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2a5d9b640 1 -- 172.21.15.136:0/1294756201 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29002f840 con 0x7fe2a806d950 2024-02-17T12:58:01.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2a5d9b640 1 -- 172.21.15.136:0/1294756201 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29002f9a0 con 0x7fe2a806d950 2024-02-17T12:58:01.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2a5d9b640 1 -- 172.21.15.136:0/1294756201 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29002fd30 con 0x7fe2a806d950 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 -- 172.21.15.136:0/1294756201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 msgr2=0x7fe2a80afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1294756201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 0x7fe2a80afd90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe290009870 tx=0x7fe29002ba20 comp rx=0 tx=0).stop 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 -- 172.21.15.136:0/1294756201 shutdown_connections 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1294756201 >> v2:172.21.15.160:3300/0 conn(0x7fe2a80c8630 0x7fe2a81645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1294756201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a806d950 0x7fe2a80afd90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 -- 172.21.15.136:0/1294756201 >> 172.21.15.136:0/1294756201 conn(0x7fe2a806aee0 msgr2=0x7fe2a80668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 -- 172.21.15.136:0/1294756201 shutdown_connections 2024-02-17T12:58:01.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.409+0000 7fe2acf13640 1 -- 172.21.15.136:0/1294756201 wait complete. 2024-02-17T12:58:01.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.410+0000 7fe2acf13640 1 Processor -- start 2024-02-17T12:58:01.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.410+0000 7fe2acf13640 1 -- start start 2024-02-17T12:58:01.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.411+0000 7fe2acf13640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a806d950 0x7fe2a80c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:01.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.411+0000 7fe2acf13640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 0x7fe2a8159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:01.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.411+0000 7fe2acf13640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2a8157360 0x7fe2a81ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:01.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.411+0000 7fe2acf13640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80c6550 con 0x7fe2a8157360 2024-02-17T12:58:01.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.411+0000 7fe2acf13640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80b07f0 con 0x7fe2a806d950 2024-02-17T12:58:01.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.411+0000 7fe2acf13640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80b0ad0 con 0x7fe2a80c8630 2024-02-17T12:58:01.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.412+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 0x7fe2a8159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:01.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.412+0000 7fe2a6d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2a8157360 0x7fe2a81ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:01.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.412+0000 7fe2a659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a806d950 0x7fe2a80c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:01.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.412+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 0x7fe2a8159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:53180/0 (socket says 172.21.15.136:53180) 2024-02-17T12:58:01.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.412+0000 7fe29ffff640 1 -- 172.21.15.136:0/1379963530 learned_addr learned my addr 172.21.15.136:0/1379963530 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:01.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.415+0000 7fe29ffff640 1 -- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a806d950 msgr2=0x7fe2a80c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:01.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.415+0000 7fe29ffff640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a806d950 0x7fe2a80c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.415+0000 7fe29ffff640 1 -- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2a8157360 msgr2=0x7fe2a81ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:01.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.415+0000 7fe29ffff640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2a8157360 0x7fe2a81ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:01.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.415+0000 7fe29ffff640 1 -- 172.21.15.136:0/1379963530 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900094d0 con 0x7fe2a80c8630 2024-02-17T12:58:01.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.417+0000 7fe29ffff640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 0x7fe2a8159a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe290000c00 tx=0x7fe2900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:01.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.422+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29003b040 con 0x7fe2a80c8630 2024-02-17T12:58:01.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.422+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe290037c60 con 0x7fe2a80c8630 2024-02-17T12:58:01.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.422+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a81f2e50 con 0x7fe2a80c8630 2024-02-17T12:58:01.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.422+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290042480 con 0x7fe2a80c8630 2024-02-17T12:58:01.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.422+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a81f3410 con 0x7fe2a80c8630 2024-02-17T12:58:01.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.422+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a8069970 con 0x7fe2a80c8630 2024-02-17T12:58:01.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.441+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe2900425e0 con 0x7fe2a80c8630 2024-02-17T12:58:01.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.441+0000 7fe29effd640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe28806b890 0x7fe28806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:01.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.441+0000 7fe2a659c640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe28806b890 0x7fe28806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:01.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.441+0000 7fe2a659c640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe28806b890 0x7fe28806dd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2980016e0 tx=0x7fe298009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:01.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.672+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe29007c450 con 0x7fe2a80c8630 2024-02-17T12:58:01.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.683+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2900786f0 con 0x7fe2a80c8630 2024-02-17T12:58:01.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:01.855+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fe2a80af960 con 0x7fe2a80c8630 2024-02-17T12:58:02.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.511+0000 7fe29effd640 1 -- 172.21.15.136:0/1379963530 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe29007bdb0 con 0x7fe2a80c8630 2024-02-17T12:58:02.502 INFO:teuthology.orchestra.run.smithi136.stderr:set pool 4 allow_ec_overwrites to true 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe28806b890 msgr2=0x7fe28806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe28806b890 0x7fe28806dd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2980016e0 tx=0x7fe298009040 comp rx=0 tx=0).stop 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 msgr2=0x7fe2a8159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 0x7fe2a8159a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe290000c00 tx=0x7fe2900046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 shutdown_connections 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe28806b890 0x7fe28806dd50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2a8157360 0x7fe2a81ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80c8630 0x7fe2a8159a50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 --2- 172.21.15.136:0/1379963530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a806d950 0x7fe2a80c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 >> 172.21.15.136:0/1379963530 conn(0x7fe2a806aee0 msgr2=0x7fe2a8157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:02.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.513+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 shutdown_connections 2024-02-17T12:58:02.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.514+0000 7fe2acf13640 1 -- 172.21.15.136:0/1379963530 wait complete. 2024-02-17T12:58:02.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-02-17T12:58:02.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.639+0000 7f3af1348640 1 Processor -- start 2024-02-17T12:58:02.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.639+0000 7f3af1348640 1 -- start start 2024-02-17T12:58:02.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.639+0000 7f3af1348640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec06acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:02.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.640+0000 7f3af1348640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec0cb470 con 0x7f3aec1624d0 2024-02-17T12:58:02.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.640+0000 7f3af1348640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec0cb750 con 0x7f3aec0ca4e0 2024-02-17T12:58:02.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.640+0000 7f3af1348640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec15d1f0 con 0x7f3aec0cbc00 2024-02-17T12:58:02.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.640+0000 7f3aeb7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3aec1624d0 0x7f3aec1648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37988/0 (socket says 172.21.15.136:37988) 2024-02-17T12:58:02.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.640+0000 7f3aeb7fe640 1 -- 172.21.15.136:0/3563726046 learned_addr learned my addr 172.21.15.136:0/3563726046 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:02.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.640+0000 7f3aeaffd640 1 --2- 172.21.15.136:0/3563726046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec06acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:02.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.642+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065884023 0 0) 0x7f3aec0cb750 con 0x7f3aec0ca4e0 2024-02-17T12:58:02.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.642+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad8003520 con 0x7f3aec0ca4e0 2024-02-17T12:58:02.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.643+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487831316 0 0) 0x7f3aec0cb470 con 0x7f3aec1624d0 2024-02-17T12:58:02.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.643+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec0cb750 con 0x7f3aec1624d0 2024-02-17T12:58:02.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.643+0000 7f3aeaffd640 1 -- 172.21.15.136:0/3563726046 >> v1:172.21.15.160:6789/0 conn(0x7f3aec0ca4e0 legacy=0x7f3aec0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.643+0000 7f3aeaffd640 1 -- 172.21.15.136:0/3563726046 >> v1:172.21.15.136:6789/0 conn(0x7f3aec1624d0 legacy=0x7f3aec1648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.643+0000 7f3aeaffd640 1 -- 172.21.15.136:0/3563726046 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec15d4d0 con 0x7f3aec0cbc00 2024-02-17T12:58:02.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.645+0000 7f3aeaffd640 1 --2- 172.21.15.136:0/3563726046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec06acd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0097d0 tx=0x7f3adc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb4cc0526ad4c5b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:02.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.649+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc030880 con 0x7f3aec0cbc00 2024-02-17T12:58:02.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.649+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc0309e0 con 0x7f3aec0cbc00 2024-02-17T12:58:02.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.649+0000 7f3aea7fc640 1 -- 172.21.15.136:0/3563726046 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc030d70 con 0x7f3aec0cbc00 2024-02-17T12:58:02.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 -- 172.21.15.136:0/3563726046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 msgr2=0x7f3aec06acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 --2- 172.21.15.136:0/3563726046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec06acd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0097d0 tx=0x7f3adc02b9c0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 -- 172.21.15.136:0/3563726046 shutdown_connections 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 --2- 172.21.15.136:0/3563726046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec06acd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 -- 172.21.15.136:0/3563726046 >> 172.21.15.136:0/3563726046 conn(0x7f3aec0721f0 msgr2=0x7f3aec0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 -- 172.21.15.136:0/3563726046 shutdown_connections 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.650+0000 7f3af1348640 1 -- 172.21.15.136:0/3563726046 wait complete. 2024-02-17T12:58:02.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.651+0000 7f3af1348640 1 Processor -- start 2024-02-17T12:58:02.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.651+0000 7f3af1348640 1 -- start start 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3af1348640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3aec0ca4e0 0x7f3aec0c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3af1348640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3af1348640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aec1624d0 0x7f3aec0c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3af1348640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0c5370 con 0x7f3aec0ca4e0 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3af1348640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0cedf0 con 0x7f3aec1624d0 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3af1348640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec1f06f0 con 0x7f3aec0cbc00 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3aeaffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3aec0ca4e0 0x7f3aec0c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3ae3fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3aeb7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aec1624d0 0x7f3aec0c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:02.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.652+0000 7f3aeaffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3aec0ca4e0 0x7f3aec0c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:32946/0 (socket says 172.21.15.136:32946) 2024-02-17T12:58:02.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.653+0000 7f3aeaffd640 1 -- 172.21.15.136:0/3584214367 learned_addr learned my addr 172.21.15.136:0/3584214367 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:02.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.656+0000 7f3aeb7fe640 1 -- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 msgr2=0x7f3aec0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.656+0000 7f3aeb7fe640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec0c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.656+0000 7f3aeb7fe640 1 -- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3aec0ca4e0 msgr2=0x7f3aec0c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:02.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.656+0000 7f3aeb7fe640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3aec0ca4e0 0x7f3aec0c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:02.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.656+0000 7f3aeb7fe640 1 -- 172.21.15.136:0/3584214367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc009400 con 0x7f3aec1624d0 2024-02-17T12:58:02.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.656+0000 7f3ae3fff640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:58:02.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.659+0000 7f3aeb7fe640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aec1624d0 0x7f3aec0c5d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400ca70 tx=0x7f3ae400ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:02.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.663+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400ab10 con 0x7f3aec1624d0 2024-02-17T12:58:02.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.663+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400ac70 con 0x7f3aec1624d0 2024-02-17T12:58:02.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.663+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4012600 con 0x7f3aec1624d0 2024-02-17T12:58:02.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.663+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec1f09d0 con 0x7f3aec1624d0 2024-02-17T12:58:02.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.663+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec0cf040 con 0x7f3aec1624d0 2024-02-17T12:58:02.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.664+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec0c5120 con 0x7f3aec1624d0 2024-02-17T12:58:02.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.906+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3ae4007070 con 0x7f3aec1624d0 2024-02-17T12:58:02.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.907+0000 7f3ae37fe640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3acc06b890 0x7f3acc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:02.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.907+0000 7f3aeaffd640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3acc06b890 0x7f3acc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:02.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.907+0000 7f3aeaffd640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3acc06b890 0x7f3acc06dd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3adc02ba00 tx=0x7f3adc008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:02.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.909+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3ae400ae20 con 0x7f3aec1624d0 2024-02-17T12:58:02.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:02.919+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ae4054f30 con 0x7f3aec1624d0 2024-02-17T12:58:03.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.129+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3aec1f0b60 con 0x7f3aec1624d0 2024-02-17T12:58:03.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.486+0000 7f3ae37fe640 1 -- 172.21.15.136:0/3584214367 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3ae40585f0 con 0x7f3aec1624d0 2024-02-17T12:58:03.477 INFO:teuthology.orchestra.run.smithi136.stderr:added data pool 4 to fsmap 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3acc06b890 msgr2=0x7f3acc06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3acc06b890 0x7f3acc06dd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3adc02ba00 tx=0x7f3adc008030 comp rx=0 tx=0).stop 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aec1624d0 msgr2=0x7f3aec0c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aec1624d0 0x7f3aec0c5d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400ca70 tx=0x7f3ae400ce70 comp rx=0 tx=0).stop 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 shutdown_connections 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3acc06b890 0x7f3acc06dd50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aec1624d0 0x7f3aec0c5d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3aec0cbc00 0x7f3aec0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 --2- 172.21.15.136:0/3584214367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3aec0ca4e0 0x7f3aec0c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 >> 172.21.15.136:0/3584214367 conn(0x7f3aec0721f0 msgr2=0x7f3aec0cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:03.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 shutdown_connections 2024-02-17T12:58:03.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.488+0000 7f3af1348640 1 -- 172.21.15.136:0/3584214367 wait complete. 2024-02-17T12:58:03.491 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:58:03.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.603+0000 7f67882c0640 1 Processor -- start 2024-02-17T12:58:03.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.603+0000 7f67882c0640 1 -- start start 2024-02-17T12:58:03.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f67882c0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f67800c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:03.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f67882c0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f67800c5de0 0x7f678015b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:03.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f67882c0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6780072010 con 0x7f6780151cf0 2024-02-17T12:58:03.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f67882c0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800701f0 con 0x7f67800c5de0 2024-02-17T12:58:03.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f67882c0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780071a90 con 0x7f678006fdf0 2024-02-17T12:58:03.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f678585b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f67800c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:03.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f678605c640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6780151cf0 0x7f67800c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38004/0 (socket says 172.21.15.136:38004) 2024-02-17T12:58:03.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.604+0000 7f678605c640 1 -- 172.21.15.136:0/1624061276 learned_addr learned my addr 172.21.15.136:0/1624061276 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:03.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.605+0000 7f678685d640 1 --2- 172.21.15.136:0/1624061276 >> v2:172.21.15.136:3300/0 conn(0x7f67800c5de0 0x7f678015b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:03.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.607+0000 7f678585b640 1 -- 172.21.15.136:0/1624061276 >> v2:172.21.15.136:3300/0 conn(0x7f67800c5de0 msgr2=0x7f678015b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:03.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.607+0000 7f678585b640 1 --2- 172.21.15.136:0/1624061276 >> v2:172.21.15.136:3300/0 conn(0x7f67800c5de0 0x7f678015b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.607+0000 7f678585b640 1 -- 172.21.15.136:0/1624061276 >> v1:172.21.15.136:6789/0 conn(0x7f6780151cf0 legacy=0x7f67800c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:03.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.607+0000 7f678585b640 1 -- 172.21.15.136:0/1624061276 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780071d30 con 0x7f678006fdf0 2024-02-17T12:58:03.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.609+0000 7f678585b640 1 --2- 172.21.15.136:0/1624061276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f67800c58a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67700097a0 tx=0x7f677002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e55be501d2c3b455 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:03.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f678505a640 1 -- 172.21.15.136:0/1624061276 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677002e070 con 0x7f678006fdf0 2024-02-17T12:58:03.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f678505a640 1 -- 172.21.15.136:0/1624061276 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700315a0 con 0x7f678006fdf0 2024-02-17T12:58:03.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f678505a640 1 -- 172.21.15.136:0/1624061276 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770031930 con 0x7f678006fdf0 2024-02-17T12:58:03.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 -- 172.21.15.136:0/1624061276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 msgr2=0x7f67800c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:03.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 --2- 172.21.15.136:0/1624061276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f67800c58a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67700097a0 tx=0x7f677002b840 comp rx=0 tx=0).stop 2024-02-17T12:58:03.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 -- 172.21.15.136:0/1624061276 shutdown_connections 2024-02-17T12:58:03.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 --2- 172.21.15.136:0/1624061276 >> v2:172.21.15.136:3300/0 conn(0x7f67800c5de0 0x7f678015b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 --2- 172.21.15.136:0/1624061276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f67800c58a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 -- 172.21.15.136:0/1624061276 >> 172.21.15.136:0/1624061276 conn(0x7f678006bbd0 msgr2=0x7f678006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:03.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 -- 172.21.15.136:0/1624061276 shutdown_connections 2024-02-17T12:58:03.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.613+0000 7f67882c0640 1 -- 172.21.15.136:0/1624061276 wait complete. 2024-02-17T12:58:03.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.614+0000 7f67882c0640 1 Processor -- start 2024-02-17T12:58:03.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.614+0000 7f67882c0640 1 -- start start 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.615+0000 7f67882c0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f678014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.615+0000 7f67882c0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800c5de0 0x7f6780144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.615+0000 7f67882c0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 0x7f6780144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.615+0000 7f67882c0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678014abc0 con 0x7f6780151cf0 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.615+0000 7f67882c0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678014aea0 con 0x7f67800c5de0 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.615+0000 7f67882c0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780149c80 con 0x7f678006fdf0 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.616+0000 7f678685d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 0x7f6780144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.616+0000 7f678605c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f678014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.616+0000 7f678685d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 0x7f6780144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:32972/0 (socket says 172.21.15.136:32972) 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.616+0000 7f678685d640 1 -- 172.21.15.136:0/917446953 learned_addr learned my addr 172.21.15.136:0/917446953 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:03.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.616+0000 7f678585b640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800c5de0 0x7f6780144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:03.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.619+0000 7f678685d640 1 -- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 msgr2=0x7f678014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:03.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.619+0000 7f678685d640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f678014e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.619+0000 7f678685d640 1 -- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800c5de0 msgr2=0x7f6780144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:03.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.619+0000 7f678685d640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800c5de0 0x7f6780144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:03.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.619+0000 7f678685d640 1 -- 172.21.15.136:0/917446953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009400 con 0x7f6780151cf0 2024-02-17T12:58:03.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.621+0000 7f678685d640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 0x7f6780144e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6778007e90 tx=0x7f677800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:03.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.623+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778014420 con 0x7f6780151cf0 2024-02-17T12:58:03.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.623+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6780149f40 con 0x7f6780151cf0 2024-02-17T12:58:03.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.623+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678014a500 con 0x7f6780151cf0 2024-02-17T12:58:03.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.624+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678014ad00 con 0x7f6780151cf0 2024-02-17T12:58:03.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.625+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778014580 con 0x7f6780151cf0 2024-02-17T12:58:03.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.625+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780148f0 con 0x7f6780151cf0 2024-02-17T12:58:03.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.892+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6778014a50 con 0x7f6780151cf0 2024-02-17T12:58:03.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.893+0000 7f6776ffd640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f676406b840 0x7f676406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:03.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.893+0000 7f678605c640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f676406b840 0x7f676406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:03.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.893+0000 7f678605c640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f676406b840 0x7f676406dd00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f677c007fd0 tx=0x7f677c007e80 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:03.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.908+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6778059f20 con 0x7f6780151cf0 2024-02-17T12:58:03.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:03.908+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67780561c0 con 0x7f6780151cf0 2024-02-17T12:58:04.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.114+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f678014ad00 con 0x7f6780151cf0 2024-02-17T12:58:04.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.134+0000 7f6776ffd640 1 -- 172.21.15.136:0/917446953 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6532 (secure 0 0 0) 0x7f678014ad00 con 0x7f6780151cf0 2024-02-17T12:58:04.125 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:04.126 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:03.153588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-17T12:58:04.126 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 7 2024-02-17T12:58:04.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f676406b840 msgr2=0x7f676406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f676406b840 0x7f676406dd00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f677c007fd0 tx=0x7f677c007e80 comp rx=0 tx=0).stop 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 msgr2=0x7f6780144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 0x7f6780144e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6778007e90 tx=0x7f677800e4b0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 shutdown_connections 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f676406b840 0x7f676406dd00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6780151cf0 0x7f6780144e80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800c5de0 0x7f6780144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 --2- 172.21.15.136:0/917446953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006fdf0 0x7f678014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 >> 172.21.15.136:0/917446953 conn(0x7f678006bbd0 msgr2=0x7f678014fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 shutdown_connections 2024-02-17T12:58:04.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.137+0000 7f67882c0640 1 -- 172.21.15.136:0/917446953 wait complete. 2024-02-17T12:58:04.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:04.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.250+0000 7f93efb87640 1 Processor -- start 2024-02-17T12:58:04.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.250+0000 7f93efb87640 1 -- start start 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93efb87640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93e806f4f0 0x7f93e806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93efb87640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93e806f8d0 0x7f93e8156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93efb87640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e806c260 con 0x7f93e80aff30 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93efb87640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e806dbe0 con 0x7f93e806f8d0 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93efb87640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e815a1a0 con 0x7f93e806f4f0 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93ed923640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93e806f4f0 0x7f93e806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93ed122640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93e806f8d0 0x7f93e8156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93ee124640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f93e80aff30 0x7f93e8070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38006/0 (socket says 172.21.15.136:38006) 2024-02-17T12:58:04.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.251+0000 7f93ee124640 1 -- 172.21.15.136:0/161983337 learned_addr learned my addr 172.21.15.136:0/161983337 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:04.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.254+0000 7f93ed923640 1 -- 172.21.15.136:0/161983337 >> v2:172.21.15.136:3300/0 conn(0x7f93e806f8d0 msgr2=0x7f93e8156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:04.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.254+0000 7f93ed923640 1 --2- 172.21.15.136:0/161983337 >> v2:172.21.15.136:3300/0 conn(0x7f93e806f8d0 0x7f93e8156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.254+0000 7f93ed923640 1 -- 172.21.15.136:0/161983337 >> v1:172.21.15.136:6789/0 conn(0x7f93e80aff30 legacy=0x7f93e8070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.254+0000 7f93ed923640 1 -- 172.21.15.136:0/161983337 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e815a480 con 0x7f93e806f4f0 2024-02-17T12:58:04.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.256+0000 7f93ed923640 1 --2- 172.21.15.136:0/161983337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e806bbd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93e8067790 tx=0x7f93e402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dcca397b4df26b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:04.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93ec921640 1 -- 172.21.15.136:0/161983337 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4030610 con 0x7f93e806f4f0 2024-02-17T12:58:04.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93ec921640 1 -- 172.21.15.136:0/161983337 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e4030770 con 0x7f93e806f4f0 2024-02-17T12:58:04.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93ec921640 1 -- 172.21.15.136:0/161983337 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4030b00 con 0x7f93e806f4f0 2024-02-17T12:58:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93efb87640 1 -- 172.21.15.136:0/161983337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 msgr2=0x7f93e806bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93efb87640 1 --2- 172.21.15.136:0/161983337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e806bbd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93e8067790 tx=0x7f93e402b960 comp rx=0 tx=0).stop 2024-02-17T12:58:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93efb87640 1 -- 172.21.15.136:0/161983337 shutdown_connections 2024-02-17T12:58:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93efb87640 1 --2- 172.21.15.136:0/161983337 >> v2:172.21.15.136:3300/0 conn(0x7f93e806f8d0 0x7f93e8156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93efb87640 1 --2- 172.21.15.136:0/161983337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e806bbd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.260+0000 7f93efb87640 1 -- 172.21.15.136:0/161983337 >> 172.21.15.136:0/161983337 conn(0x7f93e806b0f0 msgr2=0x7f93e80668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:04.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.261+0000 7f93efb87640 1 -- 172.21.15.136:0/161983337 shutdown_connections 2024-02-17T12:58:04.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.261+0000 7f93efb87640 1 -- 172.21.15.136:0/161983337 wait complete. 2024-02-17T12:58:04.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 Processor -- start 2024-02-17T12:58:04.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 -- start start 2024-02-17T12:58:04.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e80cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93e806f8d0 0x7f93e8159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93e80aff30 0x7f93e80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80cc120 con 0x7f93e806f8d0 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80aed50 con 0x7f93e806f4f0 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.262+0000 7f93efb87640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80af030 con 0x7f93e80aff30 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.263+0000 7f93ed122640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93e806f8d0 0x7f93e8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.263+0000 7f93ee124640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93e80aff30 0x7f93e80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.263+0000 7f93ed923640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e80cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.263+0000 7f93ed923640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e80cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:54848/0 (socket says 172.21.15.136:54848) 2024-02-17T12:58:04.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.263+0000 7f93ed923640 1 -- 172.21.15.136:0/3696340043 learned_addr learned my addr 172.21.15.136:0/3696340043 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:04.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.267+0000 7f93ed122640 1 -- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93e80aff30 msgr2=0x7f93e80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.267+0000 7f93ed122640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93e80aff30 0x7f93e80cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.267+0000 7f93ed122640 1 -- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 msgr2=0x7f93e80cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.267+0000 7f93ed122640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e80cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.267+0000 7f93ed122640 1 -- 172.21.15.136:0/3696340043 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4009400 con 0x7f93e806f8d0 2024-02-17T12:58:04.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.267+0000 7f93ed923640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e80cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:58:04.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.269+0000 7f93ed122640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93e806f8d0 0x7f93e8159620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93d800e850 tx=0x7f93d800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:04.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.272+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80095b0 con 0x7f93e806f8d0 2024-02-17T12:58:04.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.272+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800c940 con 0x7f93e806f8d0 2024-02-17T12:58:04.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.272+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80af310 con 0x7f93e806f8d0 2024-02-17T12:58:04.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.273+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800ccd0 con 0x7f93e806f8d0 2024-02-17T12:58:04.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.273+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80af8d0 con 0x7f93e806f8d0 2024-02-17T12:58:04.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.273+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e804efc0 con 0x7f93e806f8d0 2024-02-17T12:58:04.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.292+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f93d8013470 con 0x7f93e806f8d0 2024-02-17T12:58:04.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.292+0000 7f93de7fc640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93cc06b890 0x7f93cc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.292+0000 7f93ed923640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93cc06b890 0x7f93cc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.293+0000 7f93ed923640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93cc06b890 0x7f93cc06dd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93e402b9a0 tx=0x7f93e4008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:04.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.295+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f93d800ce30 con 0x7f93e806f8d0 2024-02-17T12:58:04.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.531+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93d80554f0 con 0x7f93e806f8d0 2024-02-17T12:58:04.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.715+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e806fde0 con 0x7f93e806f8d0 2024-02-17T12:58:04.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.763+0000 7f93de7fc640 1 -- 172.21.15.136:0/3696340043 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f93d8017020 con 0x7f93e806f8d0 2024-02-17T12:58:04.754 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:04.754 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:04.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93cc06b890 msgr2=0x7f93cc06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93cc06b890 0x7f93cc06dd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93e402b9a0 tx=0x7f93e4008030 comp rx=0 tx=0).stop 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93e806f8d0 msgr2=0x7f93e8159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93e806f8d0 0x7f93e8159620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93d800e850 tx=0x7f93d800ed10 comp rx=0 tx=0).stop 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 shutdown_connections 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93cc06b890 0x7f93cc06dd50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93e80aff30 0x7f93e80cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93e806f8d0 0x7f93e8159620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 --2- 172.21.15.136:0/3696340043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93e806f4f0 0x7f93e80cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 >> 172.21.15.136:0/3696340043 conn(0x7f93e806b0f0 msgr2=0x7f93e80ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 shutdown_connections 2024-02-17T12:58:04.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.765+0000 7f93efb87640 1 -- 172.21.15.136:0/3696340043 wait complete. 2024-02-17T12:58:04.767 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:04.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.877+0000 7ffa1aaae640 1 Processor -- start 2024-02-17T12:58:04.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.877+0000 7ffa1aaae640 1 -- start start 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.878+0000 7ffa1aaae640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ffa1406f3e0 0x7ffa1406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.878+0000 7ffa1aaae640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140c71e0 con 0x7ffa140c6540 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.878+0000 7ffa1aaae640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140c9040 con 0x7ffa14150c50 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.878+0000 7ffa1aaae640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa14151030 con 0x7ffa1406f3e0 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.879+0000 7ffa13fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ffa140c6540 0x7ffa140c3910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38018/0 (socket says 172.21.15.136:38018) 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.879+0000 7ffa13fff640 1 -- 172.21.15.136:0/1761323122 learned_addr learned my addr 172.21.15.136:0/1761323122 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:04.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.879+0000 7ffa1904b640 1 --2- 172.21.15.136:0/1761323122 >> v2:172.21.15.160:3300/0 conn(0x7ffa1406f3e0 0x7ffa1406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.881+0000 7ffa137fe640 1 -- 172.21.15.136:0/1761323122 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229471567 0 0) 0x7ffa140c71e0 con 0x7ffa140c6540 2024-02-17T12:58:04.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.881+0000 7ffa137fe640 1 -- 172.21.15.136:0/1761323122 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04003520 con 0x7ffa140c6540 2024-02-17T12:58:04.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.882+0000 7ffa1904b640 1 -- 172.21.15.136:0/1761323122 >> v1:172.21.15.160:6789/0 conn(0x7ffa14150c50 legacy=0x7ffa140c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.882+0000 7ffa1904b640 1 -- 172.21.15.136:0/1761323122 >> v1:172.21.15.136:6789/0 conn(0x7ffa140c6540 legacy=0x7ffa140c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.882+0000 7ffa1904b640 1 -- 172.21.15.136:0/1761323122 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140c9320 con 0x7ffa1406f3e0 2024-02-17T12:58:04.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.886+0000 7ffa1904b640 1 --2- 172.21.15.136:0/1761323122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa1406f3e0 0x7ffa1406f810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009d90 tx=0x7ffa0c02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29d428ffa84f468f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:04.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.889+0000 7ffa137fe640 1 -- 172.21.15.136:0/1761323122 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c02cd80 con 0x7ffa1406f3e0 2024-02-17T12:58:04.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.889+0000 7ffa137fe640 1 -- 172.21.15.136:0/1761323122 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c034440 con 0x7ffa1406f3e0 2024-02-17T12:58:04.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.889+0000 7ffa137fe640 1 -- 172.21.15.136:0/1761323122 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0347d0 con 0x7ffa1406f3e0 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1761323122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa1406f3e0 msgr2=0x7ffa1406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1761323122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa1406f3e0 0x7ffa1406f810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009d90 tx=0x7ffa0c02bfd0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1761323122 shutdown_connections 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1761323122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa1406f3e0 0x7ffa1406f810 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1761323122 >> 172.21.15.136:0/1761323122 conn(0x7ffa1406d9b0 msgr2=0x7ffa1406dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1761323122 shutdown_connections 2024-02-17T12:58:04.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.890+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1761323122 wait complete. 2024-02-17T12:58:04.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.891+0000 7ffa1aaae640 1 Processor -- start 2024-02-17T12:58:04.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.891+0000 7ffa1aaae640 1 -- start start 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.892+0000 7ffa1aaae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 0x7ffa141450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.892+0000 7ffa1aaae640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa140c6540 0x7ffa140ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.892+0000 7ffa1aaae640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa14150c50 0x7ffa1414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.892+0000 7ffa1aaae640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140c74c0 con 0x7ffa1406f3e0 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.892+0000 7ffa1aaae640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14145600 con 0x7ffa14150c50 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.892+0000 7ffa1aaae640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141f0db0 con 0x7ffa140c6540 2024-02-17T12:58:04.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.893+0000 7ffa1884a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 0x7ffa141450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.893+0000 7ffa1904b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa14150c50 0x7ffa1414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.893+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa140c6540 0x7ffa140ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.893+0000 7ffa1884a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 0x7ffa141450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33000/0 (socket says 172.21.15.136:33000) 2024-02-17T12:58:04.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.893+0000 7ffa1884a640 1 -- 172.21.15.136:0/1191294842 learned_addr learned my addr 172.21.15.136:0/1191294842 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:04.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.896+0000 7ffa1884a640 1 -- 172.21.15.136:0/1191294842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa140c6540 msgr2=0x7ffa140ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.896+0000 7ffa1884a640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa140c6540 0x7ffa140ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.896+0000 7ffa1884a640 1 -- 172.21.15.136:0/1191294842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa14150c50 msgr2=0x7ffa1414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:04.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.896+0000 7ffa1884a640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa14150c50 0x7ffa1414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:04.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.896+0000 7ffa1884a640 1 -- 172.21.15.136:0/1191294842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009a70 con 0x7ffa1406f3e0 2024-02-17T12:58:04.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.899+0000 7ffa1884a640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 0x7ffa141450c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800c3f0 tx=0x7ffa0800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:04.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.902+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080052d0 con 0x7ffa1406f3e0 2024-02-17T12:58:04.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.902+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08005450 con 0x7ffa1406f3e0 2024-02-17T12:58:04.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.902+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08007260 con 0x7ffa1406f3e0 2024-02-17T12:58:04.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.902+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa14156a80 con 0x7ffa1406f3e0 2024-02-17T12:58:04.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.902+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa14157040 con 0x7ffa1406f3e0 2024-02-17T12:58:04.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.904+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa140cd2b0 con 0x7ffa1406f3e0 2024-02-17T12:58:04.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.921+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ffa080073c0 con 0x7ffa1406f3e0 2024-02-17T12:58:04.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.922+0000 7ffa117fa640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9f806b860 0x7ff9f806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:04.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.922+0000 7ffa13fff640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9f806b860 0x7ff9f806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:04.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.922+0000 7ffa13fff640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9f806b860 0x7ff9f806dd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c77c0 tx=0x7ffa00009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:04.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:04.925+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa08058530 con 0x7ffa1406f3e0 2024-02-17T12:58:05.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.162+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa080547d0 con 0x7ffa1406f3e0 2024-02-17T12:58:05.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.337+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa140c4140 con 0x7ffa1406f3e0 2024-02-17T12:58:05.340 INFO:tasks.ceph.mds.a.smithi136.stderr:2024-02-17T12:58:05.346+0000 f5e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:58:05.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.375+0000 7ffa117fa640 1 -- 172.21.15.136:0/1191294842 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7ffa08081e60 con 0x7ffa1406f3e0 2024-02-17T12:58:05.366 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:05.366 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:05.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.377+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9f806b860 msgr2=0x7ff9f806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:05.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.377+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9f806b860 0x7ff9f806dd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c77c0 tx=0x7ffa00009040 comp rx=0 tx=0).stop 2024-02-17T12:58:05.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.377+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 msgr2=0x7ffa141450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:05.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.377+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 0x7ffa141450c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800c3f0 tx=0x7ffa0800c8b0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.377+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 shutdown_connections 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9f806b860 0x7ff9f806dd20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa14150c50 0x7ffa1414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa140c6540 0x7ffa140ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 --2- 172.21.15.136:0/1191294842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa1406f3e0 0x7ffa141450c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 >> 172.21.15.136:0/1191294842 conn(0x7ffa1406d9b0 msgr2=0x7ffa14146e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 shutdown_connections 2024-02-17T12:58:05.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.378+0000 7ffa1aaae640 1 -- 172.21.15.136:0/1191294842 wait complete. 2024-02-17T12:58:05.393 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:58:05.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.502+0000 7fc77a29d640 1 Processor -- start 2024-02-17T12:58:05.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.502+0000 7fc77a29d640 1 -- start start 2024-02-17T12:58:05.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.503+0000 7fc77a29d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc774157450 0x7fc774159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:05.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.503+0000 7fc77a29d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc7740c7e30 0x7fc774070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:05.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.503+0000 7fc77a29d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc774157830 con 0x7fc77406bbd0 2024-02-17T12:58:05.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.503+0000 7fc77a29d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77406cd20 con 0x7fc7740c7e30 2024-02-17T12:58:05.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.503+0000 7fc77a29d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77406c6f0 con 0x7fc774157450 2024-02-17T12:58:05.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.504+0000 7fc7737fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc7740c7e30 0x7fc774070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:05.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.504+0000 7fc773fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc774157450 0x7fc774159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:05.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.504+0000 7fc77883a640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc77406bbd0 0x7fc7740cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:53256/0 (socket says 172.21.15.136:53256) 2024-02-17T12:58:05.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.504+0000 7fc77883a640 1 -- 172.21.15.136:0/1156037673 learned_addr learned my addr 172.21.15.136:0/1156037673 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:05.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.506+0000 7fc7737fe640 1 -- 172.21.15.136:0/1156037673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc774157450 msgr2=0x7fc774159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:05.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.506+0000 7fc7737fe640 1 --2- 172.21.15.136:0/1156037673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc774157450 0x7fc774159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.506+0000 7fc7737fe640 1 -- 172.21.15.136:0/1156037673 >> v1:172.21.15.160:6789/0 conn(0x7fc77406bbd0 legacy=0x7fc7740cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:05.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.506+0000 7fc7737fe640 1 -- 172.21.15.136:0/1156037673 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740caab0 con 0x7fc7740c7e30 2024-02-17T12:58:05.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.508+0000 7fc7737fe640 1 --2- 172.21.15.136:0/1156037673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7740c7e30 0x7fc774070720 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7680097a0 tx=0x7fc76802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4300de37cff7edde server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:05.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.512+0000 7fc772ffd640 1 -- 172.21.15.136:0/1156037673 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76802e070 con 0x7fc7740c7e30 2024-02-17T12:58:05.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.512+0000 7fc772ffd640 1 -- 172.21.15.136:0/1156037673 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7680315a0 con 0x7fc7740c7e30 2024-02-17T12:58:05.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.512+0000 7fc772ffd640 1 -- 172.21.15.136:0/1156037673 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768031930 con 0x7fc7740c7e30 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 -- 172.21.15.136:0/1156037673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7740c7e30 msgr2=0x7fc774070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1156037673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7740c7e30 0x7fc774070720 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7680097a0 tx=0x7fc76802b840 comp rx=0 tx=0).stop 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 -- 172.21.15.136:0/1156037673 shutdown_connections 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1156037673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7740c7e30 0x7fc774070720 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1156037673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc774157450 0x7fc774159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 -- 172.21.15.136:0/1156037673 >> 172.21.15.136:0/1156037673 conn(0x7fc77406fe80 msgr2=0x7fc77406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 -- 172.21.15.136:0/1156037673 shutdown_connections 2024-02-17T12:58:05.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.513+0000 7fc77a29d640 1 -- 172.21.15.136:0/1156037673 wait complete. 2024-02-17T12:58:05.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.514+0000 7fc77a29d640 1 Processor -- start 2024-02-17T12:58:05.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.514+0000 7fc77a29d640 1 -- start start 2024-02-17T12:58:05.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc77a29d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 0x7fc7741f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:05.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc77a29d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740c7e30 0x7fc7740c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:05.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc77a29d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc774157450 0x7fc7740c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:05.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc77a29d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740c5180 con 0x7fc77406bbd0 2024-02-17T12:58:05.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc77a29d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740c6fe0 con 0x7fc774157450 2024-02-17T12:58:05.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc77a29d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7741e3b50 con 0x7fc7740c7e30 2024-02-17T12:58:05.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.515+0000 7fc773fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 0x7fc7741f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:05.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.516+0000 7fc773fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 0x7fc7741f0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33022/0 (socket says 172.21.15.136:33022) 2024-02-17T12:58:05.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.516+0000 7fc773fff640 1 -- 172.21.15.136:0/1858756241 learned_addr learned my addr 172.21.15.136:0/1858756241 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:05.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.516+0000 7fc7737fe640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740c7e30 0x7fc7740c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:05.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.516+0000 7fc77883a640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc774157450 0x7fc7740c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:05.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.519+0000 7fc773fff640 1 -- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740c7e30 msgr2=0x7fc7740c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:05.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.519+0000 7fc773fff640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740c7e30 0x7fc7740c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.519+0000 7fc773fff640 1 -- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc774157450 msgr2=0x7fc7740c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:05.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.519+0000 7fc773fff640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc774157450 0x7fc7740c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:05.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.519+0000 7fc773fff640 1 -- 172.21.15.136:0/1858756241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009400 con 0x7fc77406bbd0 2024-02-17T12:58:05.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.521+0000 7fc773fff640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 0x7fc7741f0210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e8a0 tx=0x7fc76400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:05.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.525+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640094f0 con 0x7fc77406bbd0 2024-02-17T12:58:05.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.525+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400c8e0 con 0x7fc77406bbd0 2024-02-17T12:58:05.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.525+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7741e40a0 con 0x7fc77406bbd0 2024-02-17T12:58:05.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.525+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400cc90 con 0x7fc77406bbd0 2024-02-17T12:58:05.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.525+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7741e3870 con 0x7fc77406bbd0 2024-02-17T12:58:05.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.526+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7740c8290 con 0x7fc77406bbd0 2024-02-17T12:58:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.544+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc764013470 con 0x7fc77406bbd0 2024-02-17T12:58:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.545+0000 7fc770ff9640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc76006b860 0x7fc76006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.545+0000 7fc7737fe640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc76006b860 0x7fc76006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.545+0000 7fc7737fe640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc76006b860 0x7fc76006dd20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc768036000 tx=0x7fc76803d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:05.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.785+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc764059210 con 0x7fc77406bbd0 2024-02-17T12:58:05.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.785+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7640554b0 con 0x7fc77406bbd0 2024-02-17T12:58:05.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:05.996+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc774067e00 con 0x7fc77406bbd0 2024-02-17T12:58:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.011+0000 7fc770ff9640 1 -- 172.21.15.136:0/1858756241 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6532 (secure 0 0 0) 0x7fc764021090 con 0x7fc77406bbd0 2024-02-17T12:58:06.002 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:06.002 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:03.153588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-17T12:58:06.002 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 7 2024-02-17T12:58:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc76006b860 msgr2=0x7fc76006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc76006b860 0x7fc76006dd20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc768036000 tx=0x7fc76803d040 comp rx=0 tx=0).stop 2024-02-17T12:58:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 msgr2=0x7fc7741f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 0x7fc7741f0210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e8a0 tx=0x7fc76400ed60 comp rx=0 tx=0).stop 2024-02-17T12:58:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 shutdown_connections 2024-02-17T12:58:06.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc76006b860 0x7fc76006dd20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc774157450 0x7fc7740c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740c7e30 0x7fc7740c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 --2- 172.21.15.136:0/1858756241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bbd0 0x7fc7741f0210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 >> 172.21.15.136:0/1858756241 conn(0x7fc77406fe80 msgr2=0x7fc77415c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 shutdown_connections 2024-02-17T12:58:06.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.013+0000 7fc77a29d640 1 -- 172.21.15.136:0/1858756241 wait complete. 2024-02-17T12:58:06.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.124+0000 7ff5e1e17640 1 Processor -- start 2024-02-17T12:58:06.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.124+0000 7ff5e1e17640 1 -- start start 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.125+0000 7ff5e1e17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc153dc0 0x7ff5dc06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.125+0000 7ff5e1e17640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff5dc0c7ed0 0x7ff5dc15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.125+0000 7ff5e1e17640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc15a710 con 0x7ff5dc15d6e0 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.125+0000 7ff5e1e17640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c25f0 con 0x7ff5dc0c7ed0 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.125+0000 7ff5e1e17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc159bd0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.125+0000 7ff5daffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff5dc0c7ed0 0x7ff5dc15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.126+0000 7ff5daffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff5dc0c7ed0 0x7ff5dc15d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33024/0 (socket says 172.21.15.136:33024) 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.126+0000 7ff5daffd640 1 -- 172.21.15.136:0/1091846930 learned_addr learned my addr 172.21.15.136:0/1091846930 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:06.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.126+0000 7ff5db7fe640 1 --2- 172.21.15.136:0/1091846930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc153dc0 0x7ff5dc06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.128+0000 7ff5daffd640 1 -- 172.21.15.136:0/1091846930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc153dc0 msgr2=0x7ff5dc06fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.128+0000 7ff5daffd640 1 --2- 172.21.15.136:0/1091846930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc153dc0 0x7ff5dc06fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.128+0000 7ff5daffd640 1 -- 172.21.15.136:0/1091846930 >> v1:172.21.15.160:6789/0 conn(0x7ff5dc15d6e0 legacy=0x7ff5dc0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.128+0000 7ff5daffd640 1 -- 172.21.15.136:0/1091846930 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0702c0 con 0x7ff5dc0c7ed0 2024-02-17T12:58:06.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.130+0000 7ff5daffd640 1 --2- 172.21.15.136:0/1091846930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc0c7ed0 0x7ff5dc15d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009870 tx=0x7ff5d002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec873fab94ecf09 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:06.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.133+0000 7ff5da7fc640 1 -- 172.21.15.136:0/1091846930 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d002f840 con 0x7ff5dc0c7ed0 2024-02-17T12:58:06.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.133+0000 7ff5da7fc640 1 -- 172.21.15.136:0/1091846930 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d002f9a0 con 0x7ff5dc0c7ed0 2024-02-17T12:58:06.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.133+0000 7ff5da7fc640 1 -- 172.21.15.136:0/1091846930 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d002fd30 con 0x7ff5dc0c7ed0 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 -- 172.21.15.136:0/1091846930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc0c7ed0 msgr2=0x7ff5dc15d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/1091846930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc0c7ed0 0x7ff5dc15d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009870 tx=0x7ff5d002ba20 comp rx=0 tx=0).stop 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 -- 172.21.15.136:0/1091846930 shutdown_connections 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/1091846930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc0c7ed0 0x7ff5dc15d1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/1091846930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc153dc0 0x7ff5dc06fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 -- 172.21.15.136:0/1091846930 >> 172.21.15.136:0/1091846930 conn(0x7ff5dc066d00 msgr2=0x7ff5dc067110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 -- 172.21.15.136:0/1091846930 shutdown_connections 2024-02-17T12:58:06.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.134+0000 7ff5e1e17640 1 -- 172.21.15.136:0/1091846930 wait complete. 2024-02-17T12:58:06.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.136+0000 7ff5e1e17640 1 Processor -- start 2024-02-17T12:58:06.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.136+0000 7ff5e1e17640 1 -- start start 2024-02-17T12:58:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5e1e17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0c7ed0 0x7ff5dc0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5e1e17640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 0x7ff5dc0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5e1e17640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc15d6e0 0x7ff5dc150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5e1e17640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc157980 con 0x7ff5dc153dc0 2024-02-17T12:58:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5e1e17640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc1549b0 con 0x7ff5dc15d6e0 2024-02-17T12:58:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5e1e17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0b1c90 con 0x7ff5dc0c7ed0 2024-02-17T12:58:06.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5daffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 0x7ff5dc0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:06.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc15d6e0 0x7ff5dc150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:06.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5db7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0c7ed0 0x7ff5dc0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:06.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5daffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 0x7ff5dc0b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33036/0 (socket says 172.21.15.136:33036) 2024-02-17T12:58:06.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.137+0000 7ff5daffd640 1 -- 172.21.15.136:0/3333498677 learned_addr learned my addr 172.21.15.136:0/3333498677 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:06.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.141+0000 7ff5daffd640 1 -- 172.21.15.136:0/3333498677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0c7ed0 msgr2=0x7ff5dc0b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.141+0000 7ff5daffd640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0c7ed0 0x7ff5dc0b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.141+0000 7ff5daffd640 1 -- 172.21.15.136:0/3333498677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc15d6e0 msgr2=0x7ff5dc150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.141+0000 7ff5daffd640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc15d6e0 0x7ff5dc150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.141+0000 7ff5daffd640 1 -- 172.21.15.136:0/3333498677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00094d0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.143+0000 7ff5daffd640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 0x7ff5dc0b2df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0000c00 tx=0x7ff5d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:06.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.146+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d003b040 con 0x7ff5dc153dc0 2024-02-17T12:58:06.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.146+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d0037c60 con 0x7ff5dc153dc0 2024-02-17T12:58:06.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.146+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0042480 con 0x7ff5dc153dc0 2024-02-17T12:58:06.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.146+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc1541a0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.146+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc1573e0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.147+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc04efc0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.166+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff5d00425e0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.166+0000 7ff5c3fff640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff5c806b860 0x7ff5c806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:06.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.166+0000 7ff5db7fe640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff5c806b860 0x7ff5c806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:06.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.167+0000 7ff5db7fe640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff5c806b860 0x7ff5c806dd20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009b40 tx=0x7ff5cc009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:06.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.410+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff5d007c300 con 0x7ff5dc153dc0 2024-02-17T12:58:06.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.410+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5d00785a0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.581+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5dc0702c0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.619+0000 7ff5c3fff640 1 -- 172.21.15.136:0/3333498677 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7ff5dc0702c0 con 0x7ff5dc153dc0 2024-02-17T12:58:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:06.611 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff5c806b860 msgr2=0x7ff5c806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff5c806b860 0x7ff5c806dd20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009b40 tx=0x7ff5cc009190 comp rx=0 tx=0).stop 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 msgr2=0x7ff5dc0b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 0x7ff5dc0b2df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0000c00 tx=0x7ff5d00046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 shutdown_connections 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff5c806b860 0x7ff5c806dd20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc15d6e0 0x7ff5dc150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5dc153dc0 0x7ff5dc0b2df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 --2- 172.21.15.136:0/3333498677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0c7ed0 0x7ff5dc0b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:06.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 >> 172.21.15.136:0/3333498677 conn(0x7ff5dc066d00 msgr2=0x7ff5dc0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:06.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 shutdown_connections 2024-02-17T12:58:06.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:06.622+0000 7ff5e1e17640 1 -- 172.21.15.136:0/3333498677 wait complete. 2024-02-17T12:58:07.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T12:57:57.313077+0000', 'modified': '2024-02-17T12:58:03.153588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.136:6839/2320874090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 2320874090}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 2320874090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-02-17T12:58:07.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T12:58:07.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-17T12:58:07.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.339+0000 7f87925f4640 1 Processor -- start 2024-02-17T12:58:07.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.339+0000 7f87925f4640 1 -- start start 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.340+0000 7f87925f4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f878c06f8d0 0x7f878c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.340+0000 7f87925f4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c06c260 con 0x7f878c06f4f0 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.340+0000 7f87925f4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c15a1a0 con 0x7f878c0aff30 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.340+0000 7f87925f4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06dbe0 con 0x7f878c06f8d0 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.341+0000 7f8790b91640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f878c0aff30 0x7f878c070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:53272/0 (socket says 172.21.15.136:53272) 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.341+0000 7f8790b91640 1 -- 172.21.15.136:0/1242895383 learned_addr learned my addr 172.21.15.136:0/1242895383 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:07.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.341+0000 7f878b7fe640 1 --2- 172.21.15.136:0/1242895383 >> v2:172.21.15.136:3300/0 conn(0x7f878c06f8d0 0x7f878c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.343+0000 7f878affd640 1 -- 172.21.15.136:0/1242895383 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465375549 0 0) 0x7f878c15a1a0 con 0x7f878c0aff30 2024-02-17T12:58:07.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.343+0000 7f878affd640 1 -- 172.21.15.136:0/1242895383 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8774003520 con 0x7f878c0aff30 2024-02-17T12:58:07.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.346+0000 7f878b7fe640 1 -- 172.21.15.136:0/1242895383 >> v1:172.21.15.160:6789/0 conn(0x7f878c0aff30 legacy=0x7f878c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.346+0000 7f878b7fe640 1 -- 172.21.15.136:0/1242895383 >> v1:172.21.15.136:6789/0 conn(0x7f878c06f4f0 legacy=0x7f878c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.346+0000 7f878b7fe640 1 -- 172.21.15.136:0/1242895383 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c15a480 con 0x7f878c06f8d0 2024-02-17T12:58:07.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.349+0000 7f878b7fe640 1 --2- 172.21.15.136:0/1242895383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f8d0 0x7f878c06bbd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87800097a0 tx=0x7f878002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bfdaf9ea8697a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.353+0000 7f878affd640 1 -- 172.21.15.136:0/1242895383 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878002f810 con 0x7f878c06f8d0 2024-02-17T12:58:07.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.353+0000 7f878affd640 1 -- 172.21.15.136:0/1242895383 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878002f970 con 0x7f878c06f8d0 2024-02-17T12:58:07.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.353+0000 7f878affd640 1 -- 172.21.15.136:0/1242895383 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878002fd00 con 0x7f878c06f8d0 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 -- 172.21.15.136:0/1242895383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f8d0 msgr2=0x7f878c06bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 --2- 172.21.15.136:0/1242895383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f8d0 0x7f878c06bbd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87800097a0 tx=0x7f878002b9f0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 -- 172.21.15.136:0/1242895383 shutdown_connections 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 --2- 172.21.15.136:0/1242895383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f8d0 0x7f878c06bbd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 -- 172.21.15.136:0/1242895383 >> 172.21.15.136:0/1242895383 conn(0x7f878c06b0f0 msgr2=0x7f878c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 -- 172.21.15.136:0/1242895383 shutdown_connections 2024-02-17T12:58:07.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.354+0000 7f87925f4640 1 -- 172.21.15.136:0/1242895383 wait complete. 2024-02-17T12:58:07.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.355+0000 7f87925f4640 1 Processor -- start 2024-02-17T12:58:07.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.355+0000 7f87925f4640 1 -- start start 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f87925f4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 0x7f878c1ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f87925f4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c06f8d0 0x7f878c0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f87925f4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c0aff30 0x7f878c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f87925f4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0ae8c0 con 0x7f878c06f4f0 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f87925f4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1f03d0 con 0x7f878c06f8d0 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f87925f4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1efb30 con 0x7f878c0aff30 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.356+0000 7f878bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 0x7f878c1ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.357+0000 7f878bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 0x7f878c1ef430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33054/0 (socket says 172.21.15.136:33054) 2024-02-17T12:58:07.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.357+0000 7f878bfff640 1 -- 172.21.15.136:0/4278548485 learned_addr learned my addr 172.21.15.136:0/4278548485 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.357+0000 7f878b7fe640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c06f8d0 0x7f878c0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.357+0000 7f8790b91640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c0aff30 0x7f878c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.360+0000 7f878bfff640 1 -- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c0aff30 msgr2=0x7f878c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.360+0000 7f878bfff640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c0aff30 0x7f878c0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.360+0000 7f878bfff640 1 -- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c06f8d0 msgr2=0x7f878c0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.360+0000 7f878bfff640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c06f8d0 0x7f878c0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.360+0000 7f878bfff640 1 -- 172.21.15.136:0/4278548485 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009400 con 0x7f878c06f4f0 2024-02-17T12:58:07.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.362+0000 7f878bfff640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 0x7f878c1ef430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c3c0 tx=0x7f877c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.365+0000 7f8788ff9640 1 -- 172.21.15.136:0/4278548485 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0052d0 con 0x7f878c06f4f0 2024-02-17T12:58:07.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.365+0000 7f8788ff9640 1 -- 172.21.15.136:0/4278548485 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c005450 con 0x7f878c06f4f0 2024-02-17T12:58:07.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.365+0000 7f8788ff9640 1 -- 172.21.15.136:0/4278548485 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c007260 con 0x7f878c06f4f0 2024-02-17T12:58:07.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.366+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c1efe10 con 0x7f878c06f4f0 2024-02-17T12:58:07.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.366+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0c5a30 con 0x7f878c06f4f0 2024-02-17T12:58:07.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.368+0000 7f87951c7740 1 Processor -- start 2024-02-17T12:58:07.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.368+0000 7f87951c7740 1 -- start start 2024-02-17T12:58:07.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.369+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c1d7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.369+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c1d8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.369+0000 7f87951c7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d6490 0x55764c217290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.369+0000 7f87951c7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c192cd0 con 0x55764c1d6490 2024-02-17T12:58:07.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.369+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c145f20 con 0x55764c2218b0 2024-02-17T12:58:07.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.369+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764c143450 con 0x55764c1d7a30 2024-02-17T12:58:07.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.370+0000 7f8790b91640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c1d7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.370+0000 7f878bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c1d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.370+0000 7f8790b91640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c1d7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60584/0 (socket says 172.21.15.136:60584) 2024-02-17T12:58:07.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.370+0000 7f8790b91640 1 -- 172.21.15.136:0/1131746489 learned_addr learned my addr 172.21.15.136:0/1131746489 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.372+0000 7f8790b91640 1 -- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 msgr2=0x55764c1d8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.372+0000 7f8790b91640 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c1d8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.372+0000 7f8790b91640 1 -- 172.21.15.136:0/1131746489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d6490 msgr2=0x55764c217290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.372+0000 7f8790b91640 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d6490 0x55764c217290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.372+0000 7f8790b91640 1 -- 172.21.15.136:0/1131746489 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55764c0f3f20 con 0x55764c1d7a30 2024-02-17T12:58:07.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.374+0000 7f8790b91640 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c1d7e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8784001e10 tx=0x7f8784007410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec938a5fe2d67f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.378+0000 7f8771ffb640 1 -- 172.21.15.136:0/1131746489 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840133f0 con 0x55764c1d7a30 2024-02-17T12:58:07.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.378+0000 7f8771ffb640 1 -- 172.21.15.136:0/1131746489 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784013550 con 0x55764c1d7a30 2024-02-17T12:58:07.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.378+0000 7f8771ffb640 1 -- 172.21.15.136:0/1131746489 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784013900 con 0x55764c1d7a30 2024-02-17T12:58:07.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 -- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 msgr2=0x55764c1d7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c1d7e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8784001e10 tx=0x7f8784007410 comp rx=0 tx=0).stop 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 -- 172.21.15.136:0/1131746489 shutdown_connections 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d6490 0x55764c217290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c1d8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 --2- 172.21.15.136:0/1131746489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c1d7e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 -- 172.21.15.136:0/1131746489 >> 172.21.15.136:0/1131746489 conn(0x55764c1d41a0 msgr2=0x55764c1d6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 -- 172.21.15.136:0/1131746489 shutdown_connections 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.379+0000 7f87951c7740 1 -- 172.21.15.136:0/1131746489 wait complete. 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.380+0000 7f87951c7740 1 -- start start 2024-02-17T12:58:07.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.380+0000 7f87951c7740 1 Processor -- start 2024-02-17T12:58:07.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c2155a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c21e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c2224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c13ec30 con 0x55764c22c580 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c0e3d30 con 0x55764c2218b0 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764be12310 con 0x55764c1d7a30 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f87951c7740 10 client.0 _ll_register_callbacks cb 0x55764c0ebd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f8790b91640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c2155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f878bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c21e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f8790b91640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c2155a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60600/0 (socket says 172.21.15.136:60600) 2024-02-17T12:58:07.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.381+0000 7f8790b91640 1 -- 172.21.15.136:0/1901528312 learned_addr learned my addr 172.21.15.136:0/1901528312 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8790b91640 1 -- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 msgr2=0x55764c21e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8790b91640 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c21e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8790b91640 1 -- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 msgr2=0x55764c2224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8790b91640 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c2224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8790b91640 1 -- 172.21.15.136:0/1901528312 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8774003520 con 0x55764c1d7a30 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8788ff9640 1 -- 172.21.15.136:0/4278548485 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f877c007560 con 0x7f878c06f4f0 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f8788ff9640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f877806b800 0x7f877806dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.385+0000 7f878bfff640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f877806b800 0x7f877806dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.386+0000 7f878bfff640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f877806b800 0x7f877806dcc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f877c005040 tx=0x7f877c08f1b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.387+0000 7f8790b91640 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c2155a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8784015040 tx=0x7f8784001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8afe2f733fc3ea5b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.387+0000 7f876affd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3301/0 2024-02-17T12:58:07.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.388+0000 7f8788ff9640 1 -- 172.21.15.136:0/4278548485 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f877c05fb20 con 0x7f878c06f4f0 2024-02-17T12:58:07.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.390+0000 7f876affd640 1 -- 172.21.15.136:0/1901528312 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840133f0 con 0x55764c1d7a30 2024-02-17T12:58:07.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.390+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55764be3e6c0 con 0x55764c1d7a30 2024-02-17T12:58:07.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.392+0000 7f876affd640 1 -- 172.21.15.136:0/1901528312 <== mon.2 v2:172.21.15.160:3301/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8784013e10 con 0x55764c1d7a30 2024-02-17T12:58:07.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.396+0000 7f876affd640 1 -- 172.21.15.136:0/1901528312 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f878401d820 con 0x55764c1d7a30 2024-02-17T12:58:07.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.396+0000 7f87951c7740 10 client.4334 fetch_fsmap learned FSMap version 7 2024-02-17T12:58:07.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.396+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55764c13d2b0 con 0x55764c1d7a30 2024-02-17T12:58:07.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f876affd640 1 -- 172.21.15.136:0/1901528312 <== mon.2 v2:172.21.15.160:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55764be3e6c0 con 0x55764c1d7a30 2024-02-17T12:58:07.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f876affd640 1 -- 172.21.15.136:0/1901528312 <== mon.2 v2:172.21.15.160:3301/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f8784012070 con 0x55764c1d7a30 2024-02-17T12:58:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f87951c7740 10 client.4334 fetch_fsmap finished waiting for FSMap version 7 2024-02-17T12:58:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f87951c7740 10 client.4334 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-17T12:58:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f87951c7740 20 client.4334 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f87951c7740 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c229130 0x55764c237210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f87951c7740 4 client.4334 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:58:07.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.412+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 --> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55764be8f270 con 0x55764c229130 2024-02-17T12:58:07.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.420+0000 7f878b7fe640 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c229130 0x55764c237210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.504+0000 7f878b7fe640 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c229130 0x55764c237210 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a016e7847f1a298e server_cookie=de728eb26c260bc3 in_seq=0 out_seq=0 2024-02-17T12:58:07.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.504+0000 7f876affd640 10 client.4334 ms_handle_connect on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:07.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.620+0000 7f876affd640 1 -- 172.21.15.136:0/1901528312 <== mds.0 v2:172.21.15.136:6838/2320874090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55764be8f270 con 0x55764c229130 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.620+0000 7f876affd640 10 client.4334 handle_command_reply: tid=0 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.620+0000 7f87951c7740 1 client.4334 shutdown 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 msgr2=0x55764c2155a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c2155a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8784015040 tx=0x7f8784001250 comp rx=0 tx=0).stop 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 shutdown_connections 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c229130 0x55764c237210 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c2224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c2218b0 0x55764c21e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 --2- 172.21.15.136:0/1901528312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c1d7a30 0x55764c2155a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f876affd640 0 client.4334 ms_handle_reset on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:07.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 >> 172.21.15.136:0/1901528312 conn(0x55764c1d6490 msgr2=0x55764c1d7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 shutdown_connections 2024-02-17T12:58:07.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 1 -- 172.21.15.136:0/1901528312 wait complete. 2024-02-17T12:58:07.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.621+0000 7f87951c7740 20 client.4334 trim_cache size 0 max 16384 2024-02-17T12:58:07.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 Processor -- start 2024-02-17T12:58:07.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 -- start start 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c1d7a30 0x55764c1d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c213b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c214080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c0c4490 con 0x55764c22c580 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c220f10 con 0x55764c1d7a30 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.637+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764c13ddd0 con 0x55764c2218b0 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.638+0000 7f8790b91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c214080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.638+0000 7f878b7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c213b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.638+0000 7f8790b91640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c1d7a30 0x55764c1d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.638+0000 7f8790b91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c214080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33072/0 (socket says 172.21.15.136:33072) 2024-02-17T12:58:07.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.638+0000 7f8790b91640 1 -- 172.21.15.136:0/2782461165 learned_addr learned my addr 172.21.15.136:0/2782461165 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.640+0000 7f8790b91640 1 -- 172.21.15.136:0/2782461165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 msgr2=0x55764c213b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.640+0000 7f8790b91640 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c213b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.640+0000 7f8790b91640 1 -- 172.21.15.136:0/2782461165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c1d7a30 msgr2=0x55764c1d5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.640+0000 7f8790b91640 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c1d7a30 0x55764c1d5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.640+0000 7f8790b91640 1 -- 172.21.15.136:0/2782461165 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55764c0d9a20 con 0x55764c22c580 2024-02-17T12:58:07.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.642+0000 7f8790b91640 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c214080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f878401dc00 tx=0x7f8784020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1761e96bdd797f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.646+0000 7f87717fa640 1 -- 172.21.15.136:0/2782461165 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878401d620 con 0x55764c22c580 2024-02-17T12:58:07.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.646+0000 7f87717fa640 1 -- 172.21.15.136:0/2782461165 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878400b030 con 0x55764c22c580 2024-02-17T12:58:07.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.646+0000 7f87717fa640 1 -- 172.21.15.136:0/2782461165 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878401b3b0 con 0x55764c22c580 2024-02-17T12:58:07.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 -- 172.21.15.136:0/2782461165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 msgr2=0x55764c214080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c214080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f878401dc00 tx=0x7f8784020070 comp rx=0 tx=0).stop 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 -- 172.21.15.136:0/2782461165 shutdown_connections 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c22c580 0x55764c214080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c213b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 --2- 172.21.15.136:0/2782461165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c1d7a30 0x55764c1d5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 -- 172.21.15.136:0/2782461165 >> 172.21.15.136:0/2782461165 conn(0x55764c1d6490 msgr2=0x55764c212150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 -- 172.21.15.136:0/2782461165 shutdown_connections 2024-02-17T12:58:07.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.647+0000 7f87951c7740 1 -- 172.21.15.136:0/2782461165 wait complete. 2024-02-17T12:58:07.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.648+0000 7f87951c7740 1 -- start start 2024-02-17T12:58:07.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.648+0000 7f87951c7740 1 Processor -- start 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 0x55764c23b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c1ff450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c22c580 0x55764c1ff990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c2019f0 con 0x55764c1d7a30 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764c283270 con 0x55764c22c580 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764c21bdf0 con 0x55764c2218b0 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f87951c7740 10 client.0 _ll_register_callbacks cb 0x7f8784006d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f8790b91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 0x55764c23b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f878b7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c1ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.649+0000 7f8790b91640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c22c580 0x55764c1ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.650+0000 7f8790b91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 0x55764c23b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33082/0 (socket says 172.21.15.136:33082) 2024-02-17T12:58:07.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.650+0000 7f8790b91640 1 -- 172.21.15.136:0/1687396563 learned_addr learned my addr 172.21.15.136:0/1687396563 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.653+0000 7f8790b91640 1 -- 172.21.15.136:0/1687396563 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 msgr2=0x55764c1ff450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.653+0000 7f8790b91640 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c1ff450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.653+0000 7f8790b91640 1 -- 172.21.15.136:0/1687396563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c22c580 msgr2=0x55764c1ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.653+0000 7f8790b91640 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c22c580 0x55764c1ff990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.653+0000 7f8790b91640 1 -- 172.21.15.136:0/1687396563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55764c13d2b0 con 0x55764c1d7a30 2024-02-17T12:58:07.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.655+0000 7f8790b91640 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 0x55764c23b940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8784006e90 tx=0x7f8784009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab3b8f78f9ec6c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.655+0000 7f876affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-02-17T12:58:07.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.658+0000 7f876affd640 1 -- 172.21.15.136:0/1687396563 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878401d970 con 0x55764c1d7a30 2024-02-17T12:58:07.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.659+0000 7f876affd640 1 -- 172.21.15.136:0/1687396563 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8784039040 con 0x55764c1d7a30 2024-02-17T12:58:07.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.659+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8784013550 con 0x55764c1d7a30 2024-02-17T12:58:07.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.660+0000 7f876affd640 1 -- 172.21.15.136:0/1687396563 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87840139d0 con 0x55764c1d7a30 2024-02-17T12:58:07.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.660+0000 7f87951c7740 10 client.4359 fetch_fsmap learned FSMap version 7 2024-02-17T12:58:07.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.660+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55764c0ff780 con 0x55764c1d7a30 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f876affd640 1 -- 172.21.15.136:0/1687396563 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784013550 con 0x55764c1d7a30 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f876affd640 1 -- 172.21.15.136:0/1687396563 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f8784012070 con 0x55764c1d7a30 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f87951c7740 10 client.4359 fetch_fsmap finished waiting for FSMap version 7 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f87951c7740 10 client.4359 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f87951c7740 20 client.4359 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f87951c7740 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c22b520 0x55764c22b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f87951c7740 4 client.4359 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:58:07.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.664+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 --> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55764be7b610 con 0x55764c22b520 2024-02-17T12:58:07.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.665+0000 7f878b7fe640 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c22b520 0x55764c22b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.668+0000 7f878b7fe640 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c22b520 0x55764c22b900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd581aba5127f8d2 server_cookie=43fe2c16b8094cc in_seq=0 out_seq=0 2024-02-17T12:58:07.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.668+0000 7f876affd640 10 client.4359 ms_handle_connect on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f876affd640 1 -- 172.21.15.136:0/1687396563 <== mds.0 v2:172.21.15.136:6838/2320874090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55764be7b610 con 0x55764c22b520 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f876affd640 10 client.4359 handle_command_reply: tid=0 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 client.4359 shutdown 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 msgr2=0x55764c23b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 0x55764c23b940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8784006e90 tx=0x7f8784009030 comp rx=0 tx=0).stop 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 shutdown_connections 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55764c22b520 0x55764c22b900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55764c22c580 0x55764c1ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55764c2218b0 0x55764c1ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 --2- 172.21.15.136:0/1687396563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55764c1d7a30 0x55764c23b940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f876affd640 0 client.4359 ms_handle_reset on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 >> 172.21.15.136:0/1687396563 conn(0x55764c1d6490 msgr2=0x55764c1d69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 shutdown_connections 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 1 -- 172.21.15.136:0/1687396563 wait complete. 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.685+0000 7f87951c7740 20 client.4359 trim_cache size 0 max 16384 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "b14cc0e2-9a6d-442e-8d67-bc5380021b88", 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4297, 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-02-17T12:58:07.677 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 9.8786641619999997, 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 7, 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 24, 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 23, 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 19.180283736 2024-02-17T12:58:07.678 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f877806b800 msgr2=0x7f877806dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f877806b800 0x7f877806dcc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f877c005040 tx=0x7f877c08f1b0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 msgr2=0x7f878c1ef430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 0x7f878c1ef430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c3c0 tx=0x7f877c00c880 comp rx=0 tx=0).stop 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 shutdown_connections 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f877806b800 0x7f877806dcc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c0aff30 0x7f878c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c06f8d0 0x7f878c0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 --2- 172.21.15.136:0/4278548485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f878c06f4f0 0x7f878c1ef430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 >> 172.21.15.136:0/4278548485 conn(0x7f878c06b0f0 msgr2=0x7f878c158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 shutdown_connections 2024-02-17T12:58:07.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.686+0000 7f87925f4640 1 -- 172.21.15.136:0/4278548485 wait complete. 2024-02-17T12:58:07.687 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T12:58:07.687 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:07.688 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:58:07.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.798+0000 7f101fc5c640 1 Processor -- start 2024-02-17T12:58:07.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.798+0000 7f101fc5c640 1 -- start start 2024-02-17T12:58:07.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.799+0000 7f101fc5c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10180cbc00 0x7f101806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.799+0000 7f101fc5c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 0x7f10181648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.799+0000 7f101fc5c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10180cb470 con 0x7f10180ca4e0 2024-02-17T12:58:07.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.799+0000 7f101fc5c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180cb750 con 0x7f10180cbc00 2024-02-17T12:58:07.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.799+0000 7f101fc5c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101815d1f0 con 0x7f10181624d0 2024-02-17T12:58:07.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.800+0000 7f101e1f9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 0x7f10181648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.800+0000 7f101d9f8640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10180cbc00 0x7f101806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.800+0000 7f101e1f9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 0x7f10181648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60622/0 (socket says 172.21.15.136:60622) 2024-02-17T12:58:07.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.800+0000 7f101e1f9640 1 -- 172.21.15.136:0/150021314 learned_addr learned my addr 172.21.15.136:0/150021314 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.803+0000 7f101e1f9640 1 -- 172.21.15.136:0/150021314 >> v2:172.21.15.160:3300/0 conn(0x7f10180cbc00 msgr2=0x7f101806acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:07.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.803+0000 7f101e1f9640 1 --2- 172.21.15.136:0/150021314 >> v2:172.21.15.160:3300/0 conn(0x7f10180cbc00 0x7f101806acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.803+0000 7f101e1f9640 1 -- 172.21.15.136:0/150021314 >> v1:172.21.15.160:6789/0 conn(0x7f10180ca4e0 legacy=0x7f10180cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.803+0000 7f101e1f9640 1 -- 172.21.15.136:0/150021314 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101815d4d0 con 0x7f10181624d0 2024-02-17T12:58:07.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.805+0000 7f101e1f9640 1 --2- 172.21.15.136:0/150021314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 0x7f10181648c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1010009e50 tx=0x7f101002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6f429ebd43be7a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.809+0000 7f101c9f6640 1 -- 172.21.15.136:0/150021314 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101002cb00 con 0x7f10181624d0 2024-02-17T12:58:07.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.809+0000 7f101c9f6640 1 -- 172.21.15.136:0/150021314 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101002cc60 con 0x7f10181624d0 2024-02-17T12:58:07.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101c9f6640 1 -- 172.21.15.136:0/150021314 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100343f0 con 0x7f10181624d0 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 -- 172.21.15.136:0/150021314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 msgr2=0x7f10181648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 --2- 172.21.15.136:0/150021314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 0x7f10181648c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1010009e50 tx=0x7f101002bf60 comp rx=0 tx=0).stop 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 -- 172.21.15.136:0/150021314 shutdown_connections 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 --2- 172.21.15.136:0/150021314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10181624d0 0x7f10181648c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 --2- 172.21.15.136:0/150021314 >> v2:172.21.15.160:3300/0 conn(0x7f10180cbc00 0x7f101806acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 -- 172.21.15.136:0/150021314 >> 172.21.15.136:0/150021314 conn(0x7f10180721f0 msgr2=0x7f10180725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:07.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 -- 172.21.15.136:0/150021314 shutdown_connections 2024-02-17T12:58:07.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.810+0000 7f101fc5c640 1 -- 172.21.15.136:0/150021314 wait complete. 2024-02-17T12:58:07.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.811+0000 7f101fc5c640 1 Processor -- start 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.811+0000 7f101fc5c640 1 -- start start 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.812+0000 7f101fc5c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10180ca4e0 0x7f10180cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.812+0000 7f101fc5c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 0x7f10181f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.812+0000 7f101fc5c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10181624d0 0x7f10180c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.812+0000 7f101fc5c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10180c60f0 con 0x7f10180ca4e0 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.812+0000 7f101fc5c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10181efaa0 con 0x7f10181624d0 2024-02-17T12:58:07.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.812+0000 7f101fc5c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10180c5e10 con 0x7f10180cbc00 2024-02-17T12:58:07.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.813+0000 7f101d1f7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 0x7f10181f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.813+0000 7f101e1f9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10181624d0 0x7f10180c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.813+0000 7f101d1f7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 0x7f10181f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60634/0 (socket says 172.21.15.136:60634) 2024-02-17T12:58:07.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.813+0000 7f101d1f7640 1 -- 172.21.15.136:0/1648108492 learned_addr learned my addr 172.21.15.136:0/1648108492 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:07.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.817+0000 7f101d9f8640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10180ca4e0 0x7f10180cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:07.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.817+0000 7f101d1f7640 1 -- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10181624d0 msgr2=0x7f10180c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.817+0000 7f101d1f7640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10181624d0 0x7f10180c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.817+0000 7f101d1f7640 1 -- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10180ca4e0 msgr2=0x7f10180cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:07.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.817+0000 7f101d1f7640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10180ca4e0 0x7f10180cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:07.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.817+0000 7f101d1f7640 1 -- 172.21.15.136:0/1648108492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010009b30 con 0x7f10180cbc00 2024-02-17T12:58:07.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.821+0000 7f101d1f7640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 0x7f10181f0560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f100800c400 tx=0x7f100800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:07.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.825+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080052d0 con 0x7f10180cbc00 2024-02-17T12:58:07.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.825+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008005470 con 0x7f10180cbc00 2024-02-17T12:58:07.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.825+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008006a60 con 0x7f10180cbc00 2024-02-17T12:58:07.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.825+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1018146b20 con 0x7f10180cbc00 2024-02-17T12:58:07.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.825+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10181f0040 con 0x7f10180cbc00 2024-02-17T12:58:07.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:07.826+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101804efc0 con 0x7f10180cbc00 2024-02-17T12:58:08.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.076+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1008006bc0 con 0x7f10180cbc00 2024-02-17T12:58:08.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.077+0000 7f100e7fc640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ffc06b860 0x7f0ffc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.077+0000 7f101d9f8640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ffc06b860 0x7f0ffc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.077+0000 7f101d9f8640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ffc06b860 0x7f0ffc06dd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1014009a10 tx=0x7f1014008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:08.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.080+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f10080585f0 con 0x7f10180cbc00 2024-02-17T12:58:08.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.090+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1008054890 con 0x7f10180cbc00 2024-02-17T12:58:08.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.303+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10180cb9e0 con 0x7f10180cbc00 2024-02-17T12:58:08.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.309+0000 7f100e7fc640 1 -- 172.21.15.136:0/1648108492 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1008057f50 con 0x7f10180cbc00 2024-02-17T12:58:08.299 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ffc06b860 msgr2=0x7f0ffc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ffc06b860 0x7f0ffc06dd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1014009a10 tx=0x7f1014008040 comp rx=0 tx=0).stop 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 msgr2=0x7f10181f0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 0x7f10181f0560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f100800c400 tx=0x7f100800c8c0 comp rx=0 tx=0).stop 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 shutdown_connections 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ffc06b860 0x7f0ffc06dd20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10181624d0 0x7f10180c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10180cbc00 0x7f10181f0560 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 --2- 172.21.15.136:0/1648108492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10180ca4e0 0x7f10180cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 >> 172.21.15.136:0/1648108492 conn(0x7f10180721f0 msgr2=0x7f10180cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 shutdown_connections 2024-02-17T12:58:08.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:08.311+0000 7f101fc5c640 1 -- 172.21.15.136:0/1648108492 wait complete. 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:58:08.312 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-02-17T12:58:08.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.313 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-02-17T12:58:08.327 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T12:58:08.328 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:08.329 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:58:08.329 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:08.329 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-17T12:58:08.329 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42332sec preferred_lft 42332sec 2024-02-17T12:58:08.329 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-02-17T12:58:08.329 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:58:08.329 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T12:58:08.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T12:58:08.330 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:08.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.568 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:58:08.594 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-02-17T12:58:08.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.596 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-02-17T12:58:08.689 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-02-17T12:58:08.689 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:58:08.689 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:58:08.689 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:58:08.689 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:58:08.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.690 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:08.690 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:08.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:58:08.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:58:08.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:58:08.690 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:08.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.901 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-02-17T12:58:08.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.916 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-02-17T12:58:08.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:08.972 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:08.972 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:08.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:08.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-02-17T12:58:08.972 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:09.055 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-02-17T12:58:09.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-02-17T12:58:09.056 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:09.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:09.201 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:09.201 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:09.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-02-17T12:58:09.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T12:58:09.201 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:09.243 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-02-17T12:58:09.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:58:09.243 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:09.298 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-02-17T12:58:09.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:58:09.298 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:09.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:58:09.420 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:58:09.476 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:58:09.476 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:58:09.476 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:58:09.476 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:58:09.477 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:09.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:09.479 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:58:09.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-17T12:58:09.531 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-02-17T12:58:09.573 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:58:09.600 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:58:09.656 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:58:09.657 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:58:09.658 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:09.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:09.659 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:58:09.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:2024-02-17T12:58:09.683+0000 7f4908c36480 -1 init, newargv = 0x56063d4a88b0 newargc=15 2024-02-17T12:58:09.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[44698]: starting ceph client 2024-02-17T12:58:09.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[44698]: starting fuse 2024-02-17T12:58:10.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:58:10.819 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:58:10.875 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:58:10.876 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:10.877 INFO:teuthology.orchestra.run.smithi136.stdout:/home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:10.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:10.878 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:58:10.931 INFO:teuthology.orchestra.run.smithi136.stdout:41 2024-02-17T12:58:10.931 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-02-17T12:58:10.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo stdin-killer -- python3 -c ' 2024-02-17T12:58:10.932 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2024-02-17T12:58:10.932 DEBUG:teuthology.orchestra.run.smithi136:> import re 2024-02-17T12:58:10.932 DEBUG:teuthology.orchestra.run.smithi136:> import os 2024-02-17T12:58:10.932 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2024-02-17T12:58:10.932 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:58:10.933 DEBUG:teuthology.orchestra.run.smithi136:> def _find_admin_socket(client_name): 2024-02-17T12:58:10.933 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-02-17T12:58:10.933 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2024-02-17T12:58:10.933 DEBUG:teuthology.orchestra.run.smithi136:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-02-17T12:58:10.933 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:58:10.933 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-17T12:58:10.934 DEBUG:teuthology.orchestra.run.smithi136:> contents = proc_f.read() 2024-02-17T12:58:10.935 DEBUG:teuthology.orchestra.run.smithi136:> if mountpoint in contents: 2024-02-17T12:58:10.935 DEBUG:teuthology.orchestra.run.smithi136:> return f 2024-02-17T12:58:10.935 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-17T12:58:10.935 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:58:10.935 DEBUG:teuthology.orchestra.run.smithi136:> print(_find_admin_socket("client.admin")) 2024-02-17T12:58:10.935 DEBUG:teuthology.orchestra.run.smithi136:> ' 2024-02-17T12:58:11.050 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.admin.44698.asok 2024-02-17T12:58:11.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-17T12:58:11.060 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44698.asok 2024-02-17T12:58:11.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:11.061 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44698.asok status 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "6822c7b54e949006be7a0802650d01723d834d1d", 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 19.0.0-1515-g6822c7b5 (6822c7b54e949006be7a0802650d01723d834d1d) squid (dev)", 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "admin", 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "44698", 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2024-02-17T12:58:11.209 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4365, 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 4365 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "192.168.0.1:0", 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 145364624 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-02-17T12:58:11.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "192.168.0.1:0", 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 145364624 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.4365 192.168.0.1:0/145364624", 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "192.168.0.1:0/145364624", 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 7, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 24, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "blocklisted": false, 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2024-02-17T12:58:11.211 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:11.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:11.217 DEBUG:teuthology.orchestra.run.smithi136:> stat --file-system '--printf=%T 2024-02-17T12:58:11.217 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:11.243 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2024-02-17T12:58:11.243 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:11.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:11.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:11.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:11.383 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-02-17T12:58:11.585 INFO:teuthology.orchestra.run.smithi136.stdout:# file: . 2024-02-17T12:58:11.585 INFO:teuthology.orchestra.run.smithi136.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-02-17T12:58:11.585 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:11.586 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:58:11.586 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:58:11.601 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:11.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.752+0000 7f2887bd7640 1 Processor -- start 2024-02-17T12:58:11.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.752+0000 7f2887bd7640 1 -- start start 2024-02-17T12:58:11.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2887bd7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f288006f4f0 0x7f288006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2887bd7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f2880156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2887bd7640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f28800aff30 0x7f2880157530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2887bd7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006dbe0 con 0x7f288006f4f0 2024-02-17T12:58:11.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2887bd7640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006c260 con 0x7f28800aff30 2024-02-17T12:58:11.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2887bd7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288015a1a0 con 0x7f288006f8d0 2024-02-17T12:58:11.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.753+0000 7f2885973640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f288006f4f0 0x7f288006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.754+0000 7f2885973640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f288006f4f0 0x7f288006bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60516/0 (socket says 172.21.15.136:60516) 2024-02-17T12:58:11.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.754+0000 7f2885973640 1 -- 172.21.15.136:0/2829871249 learned_addr learned my addr 172.21.15.136:0/2829871249 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:11.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.754+0000 7f2885172640 1 --2- 172.21.15.136:0/2829871249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f2880156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.754+0000 7f2886174640 1 --2- 172.21.15.136:0/2829871249 >> v2:172.21.15.160:3300/0 conn(0x7f28800aff30 0x7f2880157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.756+0000 7f2885973640 1 -- 172.21.15.136:0/2829871249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 msgr2=0x7f2880156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:11.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.756+0000 7f2885973640 1 --2- 172.21.15.136:0/2829871249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f2880156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.756+0000 7f2885973640 1 -- 172.21.15.136:0/2829871249 >> v2:172.21.15.160:3300/0 conn(0x7f28800aff30 msgr2=0x7f2880157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:11.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.756+0000 7f2885973640 1 --2- 172.21.15.136:0/2829871249 >> v2:172.21.15.160:3300/0 conn(0x7f28800aff30 0x7f2880157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.756+0000 7f2885973640 1 -- 172.21.15.136:0/2829871249 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288015a480 con 0x7f288006f4f0 2024-02-17T12:58:11.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.757+0000 7f2885973640 1 --2- 172.21.15.136:0/2829871249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f288006bbd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2880157a70 tx=0x7f287c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6821103704dc87f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:11.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.761+0000 7f2884971640 1 -- 172.21.15.136:0/2829871249 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c030860 con 0x7f288006f4f0 2024-02-17T12:58:11.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.761+0000 7f2884971640 1 -- 172.21.15.136:0/2829871249 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0309c0 con 0x7f288006f4f0 2024-02-17T12:58:11.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.761+0000 7f2884971640 1 -- 172.21.15.136:0/2829871249 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c030d50 con 0x7f288006f4f0 2024-02-17T12:58:11.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 -- 172.21.15.136:0/2829871249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 msgr2=0x7f288006bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:11.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 --2- 172.21.15.136:0/2829871249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f288006bbd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2880157a70 tx=0x7f287c02b9a0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 -- 172.21.15.136:0/2829871249 shutdown_connections 2024-02-17T12:58:11.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 --2- 172.21.15.136:0/2829871249 >> v2:172.21.15.160:3300/0 conn(0x7f28800aff30 0x7f2880157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 --2- 172.21.15.136:0/2829871249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f2880156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 --2- 172.21.15.136:0/2829871249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f288006bbd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 -- 172.21.15.136:0/2829871249 >> 172.21.15.136:0/2829871249 conn(0x7f288006b0f0 msgr2=0x7f28800668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:11.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 -- 172.21.15.136:0/2829871249 shutdown_connections 2024-02-17T12:58:11.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.762+0000 7f2887bd7640 1 -- 172.21.15.136:0/2829871249 wait complete. 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.763+0000 7f2887bd7640 1 Processor -- start 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.763+0000 7f2887bd7640 1 -- start start 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2887bd7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f28801eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2887bd7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f28801552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2887bd7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28800aff30 0x7f2880151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2887bd7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2880154810 con 0x7f288006f4f0 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2887bd7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28800b0470 con 0x7f28800aff30 2024-02-17T12:58:11.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2887bd7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28801f0470 con 0x7f288006f8d0 2024-02-17T12:58:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2885973640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f28801eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2885172640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f28801552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2886174640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28800aff30 0x7f2880151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2885973640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f28801eff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60520/0 (socket says 172.21.15.136:60520) 2024-02-17T12:58:11.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.764+0000 7f2885973640 1 -- 172.21.15.136:0/3300738785 learned_addr learned my addr 172.21.15.136:0/3300738785 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.767+0000 7f2885973640 1 -- 172.21.15.136:0/3300738785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 msgr2=0x7f28801552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.767+0000 7f2885973640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f28801552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.767+0000 7f2885973640 1 -- 172.21.15.136:0/3300738785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28800aff30 msgr2=0x7f2880151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.767+0000 7f2885973640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28800aff30 0x7f2880151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.767+0000 7f2885973640 1 -- 172.21.15.136:0/3300738785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0094d0 con 0x7f288006f4f0 2024-02-17T12:58:11.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.770+0000 7f2885973640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f28801eff30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f287c000c00 tx=0x7f287c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.773+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c039c90 con 0x7f288006f4f0 2024-02-17T12:58:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.773+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c039df0 con 0x7f288006f4f0 2024-02-17T12:58:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.773+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c043640 con 0x7f288006f4f0 2024-02-17T12:58:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.773+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28800b0a10 con 0x7f288006f4f0 2024-02-17T12:58:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.773+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28800b2420 con 0x7f288006f4f0 2024-02-17T12:58:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.774+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28800b2720 con 0x7f288006f4f0 2024-02-17T12:58:11.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.792+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f287c0437a0 con 0x7f288006f4f0 2024-02-17T12:58:11.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.792+0000 7f28767fc640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f286406b810 0x7f286406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.792+0000 7f2885172640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f286406b810 0x7f286406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:11.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.793+0000 7f2885172640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f286406b810 0x7f286406dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2880151ec0 tx=0x7f2870009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:11.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:11.795+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f287c03e070 con 0x7f288006f4f0 2024-02-17T12:58:12.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.046+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f287c078650 con 0x7f288006f4f0 2024-02-17T12:58:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.225+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f288014f8e0 con 0x7f288006f4f0 2024-02-17T12:58:12.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.263+0000 7f28767fc640 1 -- 172.21.15.136:0/3300738785 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f287c034090 con 0x7f288006f4f0 2024-02-17T12:58:12.254 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:12.254 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f286406b810 msgr2=0x7f286406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f286406b810 0x7f286406dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2880151ec0 tx=0x7f2870009190 comp rx=0 tx=0).stop 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 msgr2=0x7f28801eff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f28801eff30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f287c000c00 tx=0x7f287c004730 comp rx=0 tx=0).stop 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 shutdown_connections 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f286406b810 0x7f286406dcd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28800aff30 0x7f2880151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f288006f8d0 0x7f28801552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 --2- 172.21.15.136:0/3300738785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f288006f4f0 0x7f28801eff30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 >> 172.21.15.136:0/3300738785 conn(0x7f288006b0f0 msgr2=0x7f2880158510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:12.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 shutdown_connections 2024-02-17T12:58:12.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.265+0000 7f2887bd7640 1 -- 172.21.15.136:0/3300738785 wait complete. 2024-02-17T12:58:12.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:57:54.504936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:57:56.035257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T12:58:00.288619+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T12:58:12.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:58:12.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.379+0000 7f621070c640 1 Processor -- start 2024-02-17T12:58:12.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.379+0000 7f621070c640 1 -- start start 2024-02-17T12:58:12.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.380+0000 7f621070c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6208153f80 0x7f62080c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.380+0000 7f621070c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f62080c90b0 0x7f620815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.380+0000 7f621070c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6208159ac0 con 0x7f6208153ba0 2024-02-17T12:58:12.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.380+0000 7f621070c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62080c9530 con 0x7f62080c90b0 2024-02-17T12:58:12.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.380+0000 7f621070c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6208159d80 con 0x7f6208153f80 2024-02-17T12:58:12.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.381+0000 7f620e4a8640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6208153ba0 0x7f620806fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:49666/0 (socket says 172.21.15.136:49666) 2024-02-17T12:58:12.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.381+0000 7f620e4a8640 1 -- 172.21.15.136:0/173166446 learned_addr learned my addr 172.21.15.136:0/173166446 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:12.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.381+0000 7f620dca7640 1 --2- 172.21.15.136:0/173166446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6208153f80 0x7f62080c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.381+0000 7f620eca9640 1 --2- 172.21.15.136:0/173166446 >> v2:172.21.15.160:3300/0 conn(0x7f62080c90b0 0x7f620815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.383+0000 7f620d4a6640 1 -- 172.21.15.136:0/173166446 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471936959 0 0) 0x7f6208159ac0 con 0x7f6208153ba0 2024-02-17T12:58:12.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.383+0000 7f620d4a6640 1 -- 172.21.15.136:0/173166446 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f4003520 con 0x7f6208153ba0 2024-02-17T12:58:12.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.384+0000 7f620dca7640 1 -- 172.21.15.136:0/173166446 >> v2:172.21.15.160:3300/0 conn(0x7f62080c90b0 msgr2=0x7f620815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:12.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.384+0000 7f620dca7640 1 --2- 172.21.15.136:0/173166446 >> v2:172.21.15.160:3300/0 conn(0x7f62080c90b0 0x7f620815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.384+0000 7f620dca7640 1 -- 172.21.15.136:0/173166446 >> v1:172.21.15.136:6789/0 conn(0x7f6208153ba0 legacy=0x7f620806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.384+0000 7f620dca7640 1 -- 172.21.15.136:0/173166446 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620815a060 con 0x7f6208153f80 2024-02-17T12:58:12.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.386+0000 7f620dca7640 1 --2- 172.21.15.136:0/173166446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6208153f80 0x7f62080c8b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61f80097a0 tx=0x7f61f802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c232c8ea2250bb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:12.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.391+0000 7f620d4a6640 1 -- 172.21.15.136:0/173166446 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8031830 con 0x7f6208153f80 2024-02-17T12:58:12.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.391+0000 7f620d4a6640 1 -- 172.21.15.136:0/173166446 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f8031990 con 0x7f6208153f80 2024-02-17T12:58:12.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.391+0000 7f620d4a6640 1 -- 172.21.15.136:0/173166446 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8031d20 con 0x7f6208153f80 2024-02-17T12:58:12.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 -- 172.21.15.136:0/173166446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6208153f80 msgr2=0x7f62080c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 --2- 172.21.15.136:0/173166446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6208153f80 0x7f62080c8b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61f80097a0 tx=0x7f61f802b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 -- 172.21.15.136:0/173166446 shutdown_connections 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 --2- 172.21.15.136:0/173166446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6208153f80 0x7f62080c8b70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 --2- 172.21.15.136:0/173166446 >> v2:172.21.15.160:3300/0 conn(0x7f62080c90b0 0x7f620815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 -- 172.21.15.136:0/173166446 >> 172.21.15.136:0/173166446 conn(0x7f620806bbd0 msgr2=0x7f620806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 -- 172.21.15.136:0/173166446 shutdown_connections 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.392+0000 7f621070c640 1 -- 172.21.15.136:0/173166446 wait complete. 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.393+0000 7f621070c640 1 Processor -- start 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.393+0000 7f621070c640 1 -- start start 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f621070c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62080c90b0 0x7f6208140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f621070c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6208153ba0 0x7f62080cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f621070c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 0x7f62080cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f621070c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620815ad10 con 0x7f6208153f80 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f621070c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080c54e0 con 0x7f6208153ba0 2024-02-17T12:58:12.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f621070c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6208141390 con 0x7f62080c90b0 2024-02-17T12:58:12.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.394+0000 7f620eca9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 0x7f62080cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.395+0000 7f620eca9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 0x7f62080cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60536/0 (socket says 172.21.15.136:60536) 2024-02-17T12:58:12.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.395+0000 7f620eca9640 1 -- 172.21.15.136:0/1004149402 learned_addr learned my addr 172.21.15.136:0/1004149402 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:12.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.395+0000 7f620e4a8640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62080c90b0 0x7f6208140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.395+0000 7f620dca7640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6208153ba0 0x7f62080cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.398+0000 7f620eca9640 1 -- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62080c90b0 msgr2=0x7f6208140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.398+0000 7f620eca9640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62080c90b0 0x7f6208140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.398+0000 7f620eca9640 1 -- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6208153ba0 msgr2=0x7f62080cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.398+0000 7f620eca9640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6208153ba0 0x7f62080cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.398+0000 7f620eca9640 1 -- 172.21.15.136:0/1004149402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8009400 con 0x7f6208153f80 2024-02-17T12:58:12.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.400+0000 7f620eca9640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 0x7f62080cb6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f620000e960 tx=0x7f620000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:12.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.405+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200009690 con 0x7f6208153f80 2024-02-17T12:58:12.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.405+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620000c980 con 0x7f6208153f80 2024-02-17T12:58:12.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.405+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6208157b20 con 0x7f6208153f80 2024-02-17T12:58:12.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.405+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000cd30 con 0x7f6208153f80 2024-02-17T12:58:12.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.406+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62080c5a10 con 0x7f6208153f80 2024-02-17T12:58:12.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.406+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62080c8390 con 0x7f6208153f80 2024-02-17T12:58:12.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.424+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6200013470 con 0x7f6208153f80 2024-02-17T12:58:12.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.425+0000 7f61feffd640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f61ec06b840 0x7f61ec06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.425+0000 7f620e4a8640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f61ec06b840 0x7f61ec06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.425+0000 7f620e4a8640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f61ec06b840 0x7f61ec06dd00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6204005c00 tx=0x7f6204009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:12.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.429+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6200059370 con 0x7f6208153f80 2024-02-17T12:58:12.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.667+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6200055610 con 0x7f6208153f80 2024-02-17T12:58:12.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.840+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f620804efc0 con 0x7f6208153f80 2024-02-17T12:58:12.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.846+0000 7f61feffd640 1 -- 172.21.15.136:0/1004149402 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62000210a0 con 0x7f6208153f80 2024-02-17T12:58:12.836 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T12:58:12.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f61ec06b840 msgr2=0x7f61ec06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f61ec06b840 0x7f61ec06dd00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6204005c00 tx=0x7f6204009040 comp rx=0 tx=0).stop 2024-02-17T12:58:12.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 msgr2=0x7f62080cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 0x7f62080cb6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f620000e960 tx=0x7f620000ee20 comp rx=0 tx=0).stop 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 shutdown_connections 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f61ec06b840 0x7f61ec06dd00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6208153f80 0x7f62080cb6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6208153ba0 0x7f62080cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 --2- 172.21.15.136:0/1004149402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62080c90b0 0x7f6208140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 >> 172.21.15.136:0/1004149402 conn(0x7f620806bbd0 msgr2=0x7f62081512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 shutdown_connections 2024-02-17T12:58:12.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.848+0000 7f621070c640 1 -- 172.21.15.136:0/1004149402 wait complete. 2024-02-17T12:58:12.850 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:58:12.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.962+0000 7f918769d640 1 Processor -- start 2024-02-17T12:58:12.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.962+0000 7f918769d640 1 -- start start 2024-02-17T12:58:12.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.963+0000 7f918769d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180153f30 0x7f91800cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.963+0000 7f918769d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9180159f80 0x7f918015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.963+0000 7f918769d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9180154310 con 0x7f91800c44e0 2024-02-17T12:58:12.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.963+0000 7f918769d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918015d2c0 con 0x7f9180159f80 2024-02-17T12:58:12.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.963+0000 7f918769d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918015a910 con 0x7f9180153f30 2024-02-17T12:58:12.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.963+0000 7f9185c3a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9180159f80 0x7f918015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.964+0000 7f9185439640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180153f30 0x7f91800cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.964+0000 7f9185439640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180153f30 0x7f91800cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36498/0 (socket says 172.21.15.136:36498) 2024-02-17T12:58:12.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.964+0000 7f9185439640 1 -- 172.21.15.136:0/4115734376 learned_addr learned my addr 172.21.15.136:0/4115734376 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:12.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.966+0000 7f9185c3a640 1 -- 172.21.15.136:0/4115734376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180153f30 msgr2=0x7f91800cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:12.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.966+0000 7f9185c3a640 1 --2- 172.21.15.136:0/4115734376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180153f30 0x7f91800cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.966+0000 7f9185c3a640 1 -- 172.21.15.136:0/4115734376 >> v1:172.21.15.136:6789/0 conn(0x7f91800c44e0 legacy=0x7f91800ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:12.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.966+0000 7f9185c3a640 1 -- 172.21.15.136:0/4115734376 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918015d560 con 0x7f9180159f80 2024-02-17T12:58:12.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.969+0000 7f9185c3a640 1 --2- 172.21.15.136:0/4115734376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180159f80 0x7f918015a3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f91780097a0 tx=0x7f917802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ba7b83c91da0be server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:12.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.973+0000 7f9177fff640 1 -- 172.21.15.136:0/4115734376 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917802e070 con 0x7f9180159f80 2024-02-17T12:58:12.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f9177fff640 1 -- 172.21.15.136:0/4115734376 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91780315a0 con 0x7f9180159f80 2024-02-17T12:58:12.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f9177fff640 1 -- 172.21.15.136:0/4115734376 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178031930 con 0x7f9180159f80 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 -- 172.21.15.136:0/4115734376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180159f80 msgr2=0x7f918015a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 --2- 172.21.15.136:0/4115734376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180159f80 0x7f918015a3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f91780097a0 tx=0x7f917802b840 comp rx=0 tx=0).stop 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 -- 172.21.15.136:0/4115734376 shutdown_connections 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 --2- 172.21.15.136:0/4115734376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180159f80 0x7f918015a3d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 --2- 172.21.15.136:0/4115734376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180153f30 0x7f91800cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 -- 172.21.15.136:0/4115734376 >> 172.21.15.136:0/4115734376 conn(0x7f91800721f0 msgr2=0x7f9180072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:12.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 -- 172.21.15.136:0/4115734376 shutdown_connections 2024-02-17T12:58:12.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.974+0000 7f918769d640 1 -- 172.21.15.136:0/4115734376 wait complete. 2024-02-17T12:58:12.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 Processor -- start 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 -- start start 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91800c44e0 0x7f91800b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 0x7f91801e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180159f80 0x7f91801e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918014fdb0 con 0x7f9180153f30 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91801502e0 con 0x7f91800c44e0 2024-02-17T12:58:12.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.976+0000 7f918769d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91801e4960 con 0x7f9180159f80 2024-02-17T12:58:12.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.977+0000 7f9184c38640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 0x7f91801e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.977+0000 7f9184c38640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 0x7f91801e4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60566/0 (socket says 172.21.15.136:60566) 2024-02-17T12:58:12.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.977+0000 7f9184c38640 1 -- 172.21.15.136:0/385237453 learned_addr learned my addr 172.21.15.136:0/385237453 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:12.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.977+0000 7f9185c3a640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180159f80 0x7f91801e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.977+0000 7f9185439640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91800c44e0 0x7f91800b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.980+0000 7f9184c38640 1 -- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180159f80 msgr2=0x7f91801e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.980+0000 7f9184c38640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180159f80 0x7f91801e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.980+0000 7f9184c38640 1 -- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91800c44e0 msgr2=0x7f91800b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:12.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.980+0000 7f9184c38640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91800c44e0 0x7f91800b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:12.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.980+0000 7f9184c38640 1 -- 172.21.15.136:0/385237453 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9178009400 con 0x7f9180153f30 2024-02-17T12:58:12.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.983+0000 7f9184c38640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 0x7f91801e4e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f917000c460 tx=0x7f917000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:12.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.986+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012830 con 0x7f9180153f30 2024-02-17T12:58:12.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.986+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700129d0 con 0x7f9180153f30 2024-02-17T12:58:12.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.986+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012d80 con 0x7f9180153f30 2024-02-17T12:58:12.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.987+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9180159980 con 0x7f9180153f30 2024-02-17T12:58:12.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.987+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918015c980 con 0x7f9180153f30 2024-02-17T12:58:12.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:12.988+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918004efc0 con 0x7f9180153f30 2024-02-17T12:58:12.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.005+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9170024430 con 0x7f9180153f30 2024-02-17T12:58:12.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.005+0000 7f9175ffb640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f916406b840 0x7f916406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:12.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.006+0000 7f9185439640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f916406b840 0x7f916406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:12.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.006+0000 7f9185439640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f916406b840 0x7f916406dd00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f917c0113e0 tx=0x7f917c00b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:13.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.010+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9170058c50 con 0x7f9180153f30 2024-02-17T12:58:13.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.246+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9170054ef0 con 0x7f9180153f30 2024-02-17T12:58:13.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.438+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91800cae30 con 0x7f9180153f30 2024-02-17T12:58:13.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.443+0000 7f9175ffb640 1 -- 172.21.15.136:0/385237453 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91700585b0 con 0x7f9180153f30 2024-02-17T12:58:13.434 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:13.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f916406b840 msgr2=0x7f916406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f916406b840 0x7f916406dd00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f917c0113e0 tx=0x7f917c00b040 comp rx=0 tx=0).stop 2024-02-17T12:58:13.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 msgr2=0x7f91801e4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 0x7f91801e4e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f917000c460 tx=0x7f917000c920 comp rx=0 tx=0).stop 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 shutdown_connections 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f916406b840 0x7f916406dd00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9180159f80 0x7f91801e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9180153f30 0x7f91801e4e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 --2- 172.21.15.136:0/385237453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91800c44e0 0x7f91800b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 >> 172.21.15.136:0/385237453 conn(0x7f91800721f0 msgr2=0x7f9180149db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 shutdown_connections 2024-02-17T12:58:13.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.446+0000 7f918769d640 1 -- 172.21.15.136:0/385237453 wait complete. 2024-02-17T12:58:13.448 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:58:13.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.561+0000 7f6bb712c640 1 Processor -- start 2024-02-17T12:58:13.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.561+0000 7f6bb712c640 1 -- start start 2024-02-17T12:58:13.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.562+0000 7f6bb712c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb0153f30 0x7f6bb00cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:13.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.562+0000 7f6bb712c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb0154310 con 0x7f6bb00c44e0 2024-02-17T12:58:13.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.562+0000 7f6bb712c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb015d2c0 con 0x7f6bb0159f80 2024-02-17T12:58:13.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.562+0000 7f6bb712c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015d560 con 0x7f6bb0153f30 2024-02-17T12:58:13.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.562+0000 7f6baffff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6bb00c44e0 0x7f6bb00ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:49678/0 (socket says 172.21.15.136:49678) 2024-02-17T12:58:13.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.562+0000 7f6baffff640 1 -- 172.21.15.136:0/3626947301 learned_addr learned my addr 172.21.15.136:0/3626947301 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:13.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.563+0000 7f6bb4ec8640 1 --2- 172.21.15.136:0/3626947301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb0153f30 0x7f6bb00cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:13.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.564+0000 7f6baf7fe640 1 -- 172.21.15.136:0/3626947301 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831958596 0 0) 0x7f6bb0154310 con 0x7f6bb00c44e0 2024-02-17T12:58:13.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.564+0000 7f6baf7fe640 1 -- 172.21.15.136:0/3626947301 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba0003520 con 0x7f6bb00c44e0 2024-02-17T12:58:13.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.565+0000 7f6baf7fe640 1 -- 172.21.15.136:0/3626947301 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663642821 0 0) 0x7f6bb015d2c0 con 0x7f6bb0159f80 2024-02-17T12:58:13.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.565+0000 7f6bb4ec8640 1 -- 172.21.15.136:0/3626947301 >> v1:172.21.15.160:6789/0 conn(0x7f6bb0159f80 legacy=0x7f6bb015a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.566+0000 7f6bb4ec8640 1 -- 172.21.15.136:0/3626947301 >> v1:172.21.15.136:6789/0 conn(0x7f6bb00c44e0 legacy=0x7f6bb00ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.566+0000 7f6bb4ec8640 1 -- 172.21.15.136:0/3626947301 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb015d840 con 0x7f6bb0153f30 2024-02-17T12:58:13.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.568+0000 7f6bb4ec8640 1 --2- 172.21.15.136:0/3626947301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb0153f30 0x7f6bb00cb660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097d0 tx=0x7f6ba402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ac293d6ade7d961 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:13.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.570+0000 7f6baf7fe640 1 -- 172.21.15.136:0/3626947301 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4031890 con 0x7f6bb0153f30 2024-02-17T12:58:13.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6baf7fe640 1 -- 172.21.15.136:0/3626947301 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba40319f0 con 0x7f6bb0153f30 2024-02-17T12:58:13.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6baf7fe640 1 -- 172.21.15.136:0/3626947301 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4031d60 con 0x7f6bb0153f30 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 -- 172.21.15.136:0/3626947301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb0153f30 msgr2=0x7f6bb00cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 --2- 172.21.15.136:0/3626947301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb0153f30 0x7f6bb00cb660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097d0 tx=0x7f6ba402b930 comp rx=0 tx=0).stop 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 -- 172.21.15.136:0/3626947301 shutdown_connections 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 --2- 172.21.15.136:0/3626947301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb0153f30 0x7f6bb00cb660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 -- 172.21.15.136:0/3626947301 >> 172.21.15.136:0/3626947301 conn(0x7f6bb00721f0 msgr2=0x7f6bb0072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 -- 172.21.15.136:0/3626947301 shutdown_connections 2024-02-17T12:58:13.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.572+0000 7f6bb712c640 1 -- 172.21.15.136:0/3626947301 wait complete. 2024-02-17T12:58:13.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.573+0000 7f6bb712c640 1 Processor -- start 2024-02-17T12:58:13.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 -- start start 2024-02-17T12:58:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb00c44e0 0x7f6bb00b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 0x7f6bb00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bb0159f80 0x7f6bb015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb01efa90 con 0x7f6bb0153f30 2024-02-17T12:58:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb01f3d00 con 0x7f6bb0159f80 2024-02-17T12:58:13.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.574+0000 7f6bb712c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb01f3180 con 0x7f6bb00c44e0 2024-02-17T12:58:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.575+0000 7f6baffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 0x7f6bb00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.575+0000 7f6bb4ec8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb00c44e0 0x7f6bb00b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.575+0000 7f6bb56c9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bb0159f80 0x7f6bb015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.575+0000 7f6bb4ec8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb00c44e0 0x7f6bb00b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36532/0 (socket says 172.21.15.136:36532) 2024-02-17T12:58:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.575+0000 7f6baffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 0x7f6bb00ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60580/0 (socket says 172.21.15.136:60580) 2024-02-17T12:58:13.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.575+0000 7f6bb4ec8640 1 -- 172.21.15.136:0/1957793373 learned_addr learned my addr 172.21.15.136:0/1957793373 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:13.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.579+0000 7f6baffff640 1 -- 172.21.15.136:0/1957793373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb00c44e0 msgr2=0x7f6bb00b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.579+0000 7f6baffff640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb00c44e0 0x7f6bb00b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.579+0000 7f6baffff640 1 -- 172.21.15.136:0/1957793373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bb0159f80 msgr2=0x7f6bb015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:13.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.579+0000 7f6baffff640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bb0159f80 0x7f6bb015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:13.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.579+0000 7f6baffff640 1 -- 172.21.15.136:0/1957793373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009400 con 0x7f6bb0153f30 2024-02-17T12:58:13.571 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.581+0000 7f6baffff640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 0x7f6bb00ce530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c400 tx=0x7f6b9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:13.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.584+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c005ce0 con 0x7f6bb0153f30 2024-02-17T12:58:13.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.584+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c005e40 con 0x7f6bb0153f30 2024-02-17T12:58:13.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.584+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0072f0 con 0x7f6bb0153f30 2024-02-17T12:58:13.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.585+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb01f3460 con 0x7f6bb0153f30 2024-02-17T12:58:13.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.585+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb01f3a20 con 0x7f6bb0153f30 2024-02-17T12:58:13.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.586+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb01efc40 con 0x7f6bb0153f30 2024-02-17T12:58:13.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.604+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6b9c007450 con 0x7f6bb0153f30 2024-02-17T12:58:13.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.604+0000 7f6bad7fa640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6b9406b890 0x7f6b9406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:13.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.604+0000 7f6bb4ec8640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6b9406b890 0x7f6b9406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:13.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.605+0000 7f6bb4ec8640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6b9406b890 0x7f6b9406dd50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba403d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:13.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.607+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6b9c007e20 con 0x7f6bb0153f30 2024-02-17T12:58:13.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:13.845+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b9c054750 con 0x7f6bb0153f30 2024-02-17T12:58:14.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.031+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6bb01efbd0 con 0x7f6bb0153f30 2024-02-17T12:58:14.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.036+0000 7f6bad7fa640 1 -- 172.21.15.136:0/1957793373 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b9c017070 con 0x7f6bb0153f30 2024-02-17T12:58:14.026 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6b9406b890 msgr2=0x7f6b9406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6b9406b890 0x7f6b9406dd50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba403d040 comp rx=0 tx=0).stop 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 msgr2=0x7f6bb00ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 0x7f6bb00ce530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c400 tx=0x7f6b9c00c8c0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 shutdown_connections 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6b9406b890 0x7f6b9406dd50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bb0159f80 0x7f6bb015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bb0153f30 0x7f6bb00ce530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 --2- 172.21.15.136:0/1957793373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bb00c44e0 0x7f6bb00b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 >> 172.21.15.136:0/1957793373 conn(0x7f6bb00721f0 msgr2=0x7f6bb0151540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:14.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 shutdown_connections 2024-02-17T12:58:14.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.038+0000 7f6bb712c640 1 -- 172.21.15.136:0/1957793373 wait complete. 2024-02-17T12:58:14.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T12:58:14.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.152+0000 7f8296d02640 1 Processor -- start 2024-02-17T12:58:14.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.153+0000 7f8296d02640 1 -- start start 2024-02-17T12:58:14.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.153+0000 7f8296d02640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82900c8a00 0x7f8290158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.153+0000 7f8296d02640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f82900c5a20 0x7f82900c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.153+0000 7f8296d02640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8290158ba0 con 0x7f8290151f10 2024-02-17T12:58:14.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.153+0000 7f8296d02640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900c3590 con 0x7f82900c8a00 2024-02-17T12:58:14.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.153+0000 7f8296d02640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829006adb0 con 0x7f82900c5a20 2024-02-17T12:58:14.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.154+0000 7f828ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82900c8a00 0x7f8290158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.154+0000 7f829529f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f82900c5a20 0x7f82900c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.154+0000 7f828ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82900c8a00 0x7f8290158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60596/0 (socket says 172.21.15.136:60596) 2024-02-17T12:58:14.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.154+0000 7f828ffff640 1 -- 172.21.15.136:0/3237820415 learned_addr learned my addr 172.21.15.136:0/3237820415 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:14.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.157+0000 7f828ffff640 1 -- 172.21.15.136:0/3237820415 >> v2:172.21.15.160:3300/0 conn(0x7f82900c5a20 msgr2=0x7f82900c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:14.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.157+0000 7f828ffff640 1 --2- 172.21.15.136:0/3237820415 >> v2:172.21.15.160:3300/0 conn(0x7f82900c5a20 0x7f82900c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.157+0000 7f828ffff640 1 -- 172.21.15.136:0/3237820415 >> v1:172.21.15.160:6789/0 conn(0x7f8290151f10 legacy=0x7f829015b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.157+0000 7f828ffff640 1 -- 172.21.15.136:0/3237820415 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900c6db0 con 0x7f82900c8a00 2024-02-17T12:58:14.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.158+0000 7f828ffff640 1 --2- 172.21.15.136:0/3237820415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c8a00 0x7f8290158660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82900c6540 tx=0x7f827c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d01ffa9c868f915 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:14.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.162+0000 7f828f7fe640 1 -- 172.21.15.136:0/3237820415 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c030860 con 0x7f82900c8a00 2024-02-17T12:58:14.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.162+0000 7f828f7fe640 1 -- 172.21.15.136:0/3237820415 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0309c0 con 0x7f82900c8a00 2024-02-17T12:58:14.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.162+0000 7f828f7fe640 1 -- 172.21.15.136:0/3237820415 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c030d50 con 0x7f82900c8a00 2024-02-17T12:58:14.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 -- 172.21.15.136:0/3237820415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c8a00 msgr2=0x7f8290158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 --2- 172.21.15.136:0/3237820415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c8a00 0x7f8290158660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82900c6540 tx=0x7f827c02b9a0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 -- 172.21.15.136:0/3237820415 shutdown_connections 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 --2- 172.21.15.136:0/3237820415 >> v2:172.21.15.160:3300/0 conn(0x7f82900c5a20 0x7f82900c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 --2- 172.21.15.136:0/3237820415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c8a00 0x7f8290158660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 -- 172.21.15.136:0/3237820415 >> 172.21.15.136:0/3237820415 conn(0x7f829006bbd0 msgr2=0x7f829006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 -- 172.21.15.136:0/3237820415 shutdown_connections 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.163+0000 7f8296d02640 1 -- 172.21.15.136:0/3237820415 wait complete. 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.164+0000 7f8296d02640 1 Processor -- start 2024-02-17T12:58:14.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.164+0000 7f8296d02640 1 -- start start 2024-02-17T12:58:14.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8296d02640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 0x7f82900c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8296d02640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900c8a00 0x7f82900c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8296d02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8290151f10 0x7f8290144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8296d02640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c2f10 con 0x7f82900c5a20 2024-02-17T12:58:14.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8296d02640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c25f0 con 0x7f82900c8a00 2024-02-17T12:58:14.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8296d02640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c0b10 con 0x7f8290151f10 2024-02-17T12:58:14.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.165+0000 7f8294a9e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 0x7f82900c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.166+0000 7f8294a9e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 0x7f82900c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60598/0 (socket says 172.21.15.136:60598) 2024-02-17T12:58:14.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.166+0000 7f8294a9e640 1 -- 172.21.15.136:0/3428444634 learned_addr learned my addr 172.21.15.136:0/3428444634 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:14.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.166+0000 7f829529f640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8290151f10 0x7f8290144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.166+0000 7f828ffff640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900c8a00 0x7f82900c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.169+0000 7f8294a9e640 1 -- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8290151f10 msgr2=0x7f8290144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.169+0000 7f8294a9e640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8290151f10 0x7f8290144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.169+0000 7f8294a9e640 1 -- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900c8a00 msgr2=0x7f82900c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.169+0000 7f8294a9e640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900c8a00 0x7f82900c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.169+0000 7f8294a9e640 1 -- 172.21.15.136:0/3428444634 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0094d0 con 0x7f82900c5a20 2024-02-17T12:58:14.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.172+0000 7f8294a9e640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 0x7f82900c20b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f828400c400 tx=0x7f828400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:14.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.175+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840052d0 con 0x7f82900c5a20 2024-02-17T12:58:14.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.175+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284005450 con 0x7f82900c5a20 2024-02-17T12:58:14.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.175+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284007260 con 0x7f82900c5a20 2024-02-17T12:58:14.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.176+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82900c10b0 con 0x7f82900c5a20 2024-02-17T12:58:14.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.176+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82901f0e30 con 0x7f82900c5a20 2024-02-17T12:58:14.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.176+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829004efc0 con 0x7f82900c5a20 2024-02-17T12:58:14.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.196+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f82840073c0 con 0x7f82900c5a20 2024-02-17T12:58:14.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.196+0000 7f828d7fa640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f827406b860 0x7f827406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.196+0000 7f828ffff640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f827406b860 0x7f827406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.197+0000 7f828ffff640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f827406b860 0x7f827406dd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f827c036000 tx=0x7f827c008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:14.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.434+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8284007670 con 0x7f82900c5a20 2024-02-17T12:58:14.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.434+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f82840543a0 con 0x7f82900c5a20 2024-02-17T12:58:14.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.620+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f829006ab90 con 0x7f82900c5a20 2024-02-17T12:58:14.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.625+0000 7f828d7fa640 1 -- 172.21.15.136:0/3428444634 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8284020020 con 0x7f82900c5a20 2024-02-17T12:58:14.615 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:14.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f827406b860 msgr2=0x7f827406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f827406b860 0x7f827406dd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f827c036000 tx=0x7f827c008030 comp rx=0 tx=0).stop 2024-02-17T12:58:14.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 msgr2=0x7f82900c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 0x7f82900c20b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f828400c400 tx=0x7f828400c8c0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 shutdown_connections 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f827406b860 0x7f827406dd20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.627+0000 7f8296d02640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8290151f10 0x7f8290144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.628+0000 7f8296d02640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900c8a00 0x7f82900c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.628+0000 7f8296d02640 1 --2- 172.21.15.136:0/3428444634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82900c5a20 0x7f82900c20b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.628+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 >> 172.21.15.136:0/3428444634 conn(0x7f829006bbd0 msgr2=0x7f8290150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.628+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 shutdown_connections 2024-02-17T12:58:14.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.628+0000 7f8296d02640 1 -- 172.21.15.136:0/3428444634 wait complete. 2024-02-17T12:58:14.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:58:14.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.741+0000 7fd4efad4640 1 Processor -- start 2024-02-17T12:58:14.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.741+0000 7fd4efad4640 1 -- start start 2024-02-17T12:58:14.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4efad4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd4e806f6d0 0x7fd4e806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4efad4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e8072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4efad4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80c65a0 con 0x7fd4e8153fb0 2024-02-17T12:58:14.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4efad4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e8072d50 con 0x7fd4e806f6d0 2024-02-17T12:58:14.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4efad4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e806af20 con 0x7fd4e80723e0 2024-02-17T12:58:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4ee071640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e8072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.742+0000 7fd4ed06f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd4e806f6d0 0x7fd4e806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.743+0000 7fd4ee071640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e8072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36556/0 (socket says 172.21.15.136:36556) 2024-02-17T12:58:14.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.743+0000 7fd4ee071640 1 -- 172.21.15.136:0/1891943145 learned_addr learned my addr 172.21.15.136:0/1891943145 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.745+0000 7fd4ee071640 1 -- 172.21.15.136:0/1891943145 >> v2:172.21.15.136:3300/0 conn(0x7fd4e806f6d0 msgr2=0x7fd4e806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.745+0000 7fd4ee071640 1 --2- 172.21.15.136:0/1891943145 >> v2:172.21.15.136:3300/0 conn(0x7fd4e806f6d0 0x7fd4e806fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.745+0000 7fd4ee071640 1 -- 172.21.15.136:0/1891943145 >> v1:172.21.15.136:6789/0 conn(0x7fd4e8153fb0 legacy=0x7fd4e8159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.745+0000 7fd4ee071640 1 -- 172.21.15.136:0/1891943145 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e806b1c0 con 0x7fd4e80723e0 2024-02-17T12:58:14.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.747+0000 7fd4ee071640 1 --2- 172.21.15.136:0/1891943145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e8072810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009e50 tx=0x7fd4e002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3726cb00cb4d3d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:14.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.751+0000 7fd4ec86e640 1 -- 172.21.15.136:0/1891943145 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e002cb00 con 0x7fd4e80723e0 2024-02-17T12:58:14.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.751+0000 7fd4ec86e640 1 -- 172.21.15.136:0/1891943145 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e002cc60 con 0x7fd4e80723e0 2024-02-17T12:58:14.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.751+0000 7fd4ec86e640 1 -- 172.21.15.136:0/1891943145 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00343f0 con 0x7fd4e80723e0 2024-02-17T12:58:14.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 -- 172.21.15.136:0/1891943145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 msgr2=0x7fd4e8072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 --2- 172.21.15.136:0/1891943145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e8072810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009e50 tx=0x7fd4e002bf60 comp rx=0 tx=0).stop 2024-02-17T12:58:14.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 -- 172.21.15.136:0/1891943145 shutdown_connections 2024-02-17T12:58:14.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 --2- 172.21.15.136:0/1891943145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e8072810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 --2- 172.21.15.136:0/1891943145 >> v2:172.21.15.136:3300/0 conn(0x7fd4e806f6d0 0x7fd4e806fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 -- 172.21.15.136:0/1891943145 >> 172.21.15.136:0/1891943145 conn(0x7fd4e806bbd0 msgr2=0x7fd4e806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:14.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 -- 172.21.15.136:0/1891943145 shutdown_connections 2024-02-17T12:58:14.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.752+0000 7fd4efad4640 1 -- 172.21.15.136:0/1891943145 wait complete. 2024-02-17T12:58:14.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.753+0000 7fd4efad4640 1 Processor -- start 2024-02-17T12:58:14.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.753+0000 7fd4efad4640 1 -- start start 2024-02-17T12:58:14.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4efad4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 0x7fd4e8145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4efad4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e80c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4efad4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e8153fb0 0x7fd4e80c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:14.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4efad4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81f01c0 con 0x7fd4e806f6d0 2024-02-17T12:58:14.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4efad4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81f06f0 con 0x7fd4e8153fb0 2024-02-17T12:58:14.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4efad4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c74f0 con 0x7fd4e80723e0 2024-02-17T12:58:14.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4ed870640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 0x7fd4e8145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4ed870640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 0x7fd4e8145590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60604/0 (socket says 172.21.15.136:60604) 2024-02-17T12:58:14.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4ed06f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e80c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.754+0000 7fd4ed870640 1 -- 172.21.15.136:0/731757049 learned_addr learned my addr 172.21.15.136:0/731757049 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:14.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.755+0000 7fd4ee071640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e8153fb0 0x7fd4e80c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:14.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.758+0000 7fd4ed870640 1 -- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 msgr2=0x7fd4e80c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.758+0000 7fd4ed870640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e80c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.758+0000 7fd4ed870640 1 -- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e8153fb0 msgr2=0x7fd4e80c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:14.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.758+0000 7fd4ed870640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e8153fb0 0x7fd4e80c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:14.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.758+0000 7fd4ed870640 1 -- 172.21.15.136:0/731757049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009b30 con 0x7fd4e806f6d0 2024-02-17T12:58:14.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.760+0000 7fd4ed870640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 0x7fd4e8145590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400c3c0 tx=0x7fd4e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:14.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.764+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40052d0 con 0x7fd4e806f6d0 2024-02-17T12:58:14.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.764+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e4005450 con 0x7fd4e806f6d0 2024-02-17T12:58:14.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.764+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4007260 con 0x7fd4e806f6d0 2024-02-17T12:58:14.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.764+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e81f0410 con 0x7fd4e806f6d0 2024-02-17T12:58:14.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.764+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80c6ea0 con 0x7fd4e806f6d0 2024-02-17T12:58:14.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:14.765+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e8067cb0 con 0x7fd4e806f6d0 2024-02-17T12:58:15.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.011+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd4e40073c0 con 0x7fd4e806f6d0 2024-02-17T12:58:15.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.012+0000 7fd4de7fc640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd4cc06b890 0x7fd4cc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:15.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.012+0000 7fd4ed06f640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd4cc06b890 0x7fd4cc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:15.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.012+0000 7fd4ed06f640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd4cc06b890 0x7fd4cc06dd50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80ca790 tx=0x7fd4d8009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:15.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.023+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd4e40584c0 con 0x7fd4e806f6d0 2024-02-17T12:58:15.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.024+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd4e4054760 con 0x7fd4e806f6d0 2024-02-17T12:58:15.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.206+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd4e804efc0 con 0x7fd4e806f6d0 2024-02-17T12:58:15.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.211+0000 7fd4de7fc640 1 -- 172.21.15.136:0/731757049 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd4e4020070 con 0x7fd4e806f6d0 2024-02-17T12:58:15.201 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-02-17T12:58:15.203 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd4cc06b890 msgr2=0x7fd4cc06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd4cc06b890 0x7fd4cc06dd50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80ca790 tx=0x7fd4d8009190 comp rx=0 tx=0).stop 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 msgr2=0x7fd4e8145590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 0x7fd4e8145590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400c3c0 tx=0x7fd4e400c880 comp rx=0 tx=0).stop 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 shutdown_connections 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd4cc06b890 0x7fd4cc06dd50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4e8153fb0 0x7fd4e80c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4e80723e0 0x7fd4e80c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 --2- 172.21.15.136:0/731757049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4e806f6d0 0x7fd4e8145590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 >> 172.21.15.136:0/731757049 conn(0x7fd4e806bbd0 msgr2=0x7fd4e8151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 shutdown_connections 2024-02-17T12:58:15.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.213+0000 7fd4efad4640 1 -- 172.21.15.136:0/731757049 wait complete. 2024-02-17T12:58:15.214 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:58:15.214 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:58:15.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:15.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.382+0000 7f526970d640 1 Processor -- start 2024-02-17T12:58:15.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.382+0000 7f526970d640 1 -- start start 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.383+0000 7f526970d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5264150ae0 0x7f52640c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.383+0000 7f526970d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5264072da0 con 0x7f5264071dd0 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.383+0000 7f526970d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526406f450 con 0x7f526406fff0 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.383+0000 7f526970d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5264159de0 con 0x7f5264150ae0 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.384+0000 7f5262ffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5264150ae0 0x7f52640c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.384+0000 7f52637fe640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f526406fff0 0x7f5264161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:33848/0 (socket says 172.21.15.136:33848) 2024-02-17T12:58:15.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.384+0000 7f52637fe640 1 -- 172.21.15.136:0/4245699033 learned_addr learned my addr 172.21.15.136:0/4245699033 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:15.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.387+0000 7f5261ffb640 1 -- 172.21.15.136:0/4245699033 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211523340 0 0) 0x7f526406f450 con 0x7f526406fff0 2024-02-17T12:58:15.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.387+0000 7f5261ffb640 1 -- 172.21.15.136:0/4245699033 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c005730 con 0x7f526406fff0 2024-02-17T12:58:15.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.387+0000 7f5262ffd640 1 -- 172.21.15.136:0/4245699033 >> v1:172.21.15.160:6789/0 conn(0x7f526406fff0 legacy=0x7f5264161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.387+0000 7f5262ffd640 1 -- 172.21.15.136:0/4245699033 >> v1:172.21.15.136:6789/0 conn(0x7f5264071dd0 legacy=0x7f526406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.387+0000 7f5262ffd640 1 -- 172.21.15.136:0/4245699033 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526415a0a0 con 0x7f5264150ae0 2024-02-17T12:58:15.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.390+0000 7f5262ffd640 1 --2- 172.21.15.136:0/4245699033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264150ae0 0x7f52640c3730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5254009dc0 tx=0x7f525402bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cee6e387f537738 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:15.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f5261ffb640 1 -- 172.21.15.136:0/4245699033 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525402cd60 con 0x7f5264150ae0 2024-02-17T12:58:15.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f5261ffb640 1 -- 172.21.15.136:0/4245699033 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254034440 con 0x7f5264150ae0 2024-02-17T12:58:15.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f5261ffb640 1 -- 172.21.15.136:0/4245699033 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540347d0 con 0x7f5264150ae0 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 -- 172.21.15.136:0/4245699033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264150ae0 msgr2=0x7f52640c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 --2- 172.21.15.136:0/4245699033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264150ae0 0x7f52640c3730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5254009dc0 tx=0x7f525402bfb0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 -- 172.21.15.136:0/4245699033 shutdown_connections 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 --2- 172.21.15.136:0/4245699033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264150ae0 0x7f52640c3730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 -- 172.21.15.136:0/4245699033 >> 172.21.15.136:0/4245699033 conn(0x7f526406bbd0 msgr2=0x7f526406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 -- 172.21.15.136:0/4245699033 shutdown_connections 2024-02-17T12:58:15.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.394+0000 7f526970d640 1 -- 172.21.15.136:0/4245699033 wait complete. 2024-02-17T12:58:15.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 Processor -- start 2024-02-17T12:58:15.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 -- start start 2024-02-17T12:58:15.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f526406fff0 0x7f52640cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:15.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 0x7f5264158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:15.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5264150ae0 0x7f5264145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:15.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640cc000 con 0x7f5264071dd0 2024-02-17T12:58:15.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52641552d0 con 0x7f526406fff0 2024-02-17T12:58:15.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.396+0000 7f526970d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52641461e0 con 0x7f5264150ae0 2024-02-17T12:58:15.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.397+0000 7f52627fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 0x7f5264158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:15.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.397+0000 7f52637fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5264150ae0 0x7f5264145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:15.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.397+0000 7f5262ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f526406fff0 0x7f52640cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:15.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.397+0000 7f52627fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 0x7f5264158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60614/0 (socket says 172.21.15.136:60614) 2024-02-17T12:58:15.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.397+0000 7f52627fc640 1 -- 172.21.15.136:0/2259601815 learned_addr learned my addr 172.21.15.136:0/2259601815 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:15.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.400+0000 7f52627fc640 1 -- 172.21.15.136:0/2259601815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5264150ae0 msgr2=0x7f5264145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.400+0000 7f52627fc640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5264150ae0 0x7f5264145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.400+0000 7f52627fc640 1 -- 172.21.15.136:0/2259601815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f526406fff0 msgr2=0x7f52640cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.400+0000 7f52627fc640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f526406fff0 0x7f52640cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.400+0000 7f52627fc640 1 -- 172.21.15.136:0/2259601815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5254009a70 con 0x7f5264071dd0 2024-02-17T12:58:15.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.403+0000 7f52627fc640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 0x7f5264158510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f525800c450 tx=0x7f525800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:15.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.406+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580052d0 con 0x7f5264071dd0 2024-02-17T12:58:15.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.406+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258005430 con 0x7f5264071dd0 2024-02-17T12:58:15.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.406+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5264158080 con 0x7f5264071dd0 2024-02-17T12:58:15.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.406+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258003830 con 0x7f5264071dd0 2024-02-17T12:58:15.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.406+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5264154630 con 0x7f5264071dd0 2024-02-17T12:58:15.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.407+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5264157e50 con 0x7f5264071dd0 2024-02-17T12:58:15.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.425+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5258003990 con 0x7f5264071dd0 2024-02-17T12:58:15.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.426+0000 7f524b7fe640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f525006b890 0x7f525006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:15.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.426+0000 7f5262ffd640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f525006b890 0x7f525006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:15.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.426+0000 7f5262ffd640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f525006b890 0x7f525006dd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5254036000 tx=0x7f5254030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:15.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.428+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5258058270 con 0x7f5264071dd0 2024-02-17T12:58:15.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.665+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5258054510 con 0x7f5264071dd0 2024-02-17T12:58:15.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.860+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f526406e780 con 0x7f5264071dd0 2024-02-17T12:58:15.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.903+0000 7f524b7fe640 1 -- 172.21.15.136:0/2259601815 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f526406e780 con 0x7f5264071dd0 2024-02-17T12:58:15.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:15.895 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:15.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f525006b890 msgr2=0x7f525006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f525006b890 0x7f525006dd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5254036000 tx=0x7f5254030000 comp rx=0 tx=0).stop 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 msgr2=0x7f5264158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 0x7f5264158510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f525800c450 tx=0x7f525800c910 comp rx=0 tx=0).stop 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 shutdown_connections 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f525006b890 0x7f525006dd50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5264150ae0 0x7f5264145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5264071dd0 0x7f5264158510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 --2- 172.21.15.136:0/2259601815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f526406fff0 0x7f52640cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 >> 172.21.15.136:0/2259601815 conn(0x7f526406bbd0 msgr2=0x7f52640c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 shutdown_connections 2024-02-17T12:58:15.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:15.906+0000 7f526970d640 1 -- 172.21.15.136:0/2259601815 wait complete. 2024-02-17T12:58:15.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:57:54.504936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:57:56.035257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T12:58:00.288619+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T12:58:15.908 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:58:16.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.021+0000 7f2f874eb640 1 Processor -- start 2024-02-17T12:58:16.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.022+0000 7f2f874eb640 1 -- start start 2024-02-17T12:58:16.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.022+0000 7f2f874eb640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2f800ca090 0x7f2f800726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.022+0000 7f2f874eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f8015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.022+0000 7f2f874eb640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800c3690 con 0x7f2f80150b50 2024-02-17T12:58:16.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.022+0000 7f2f874eb640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f80159f50 con 0x7f2f800ca090 2024-02-17T12:58:16.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.022+0000 7f2f874eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80157890 con 0x7f2f801573e0 2024-02-17T12:58:16.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.023+0000 7f2f85287640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2f80150b50 0x7f2f800c51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:49710/0 (socket says 172.21.15.136:49710) 2024-02-17T12:58:16.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.023+0000 7f2f85287640 1 -- 172.21.15.136:0/2031654285 learned_addr learned my addr 172.21.15.136:0/2031654285 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:16.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.023+0000 7f2f85a88640 1 --2- 172.21.15.136:0/2031654285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f8015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.023+0000 7f2f84a86640 1 --2- 172.21.15.136:0/2031654285 >> v2:172.21.15.160:3300/0 conn(0x7f2f800ca090 0x7f2f800726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.025+0000 7f2f77fff640 1 -- 172.21.15.136:0/2031654285 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098796943 0 0) 0x7f2f800c3690 con 0x7f2f80150b50 2024-02-17T12:58:16.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.025+0000 7f2f77fff640 1 -- 172.21.15.136:0/2031654285 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6c003520 con 0x7f2f80150b50 2024-02-17T12:58:16.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.027+0000 7f2f85a88640 1 -- 172.21.15.136:0/2031654285 >> v2:172.21.15.160:3300/0 conn(0x7f2f800ca090 msgr2=0x7f2f800726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:16.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.027+0000 7f2f85a88640 1 --2- 172.21.15.136:0/2031654285 >> v2:172.21.15.160:3300/0 conn(0x7f2f800ca090 0x7f2f800726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.027+0000 7f2f85a88640 1 -- 172.21.15.136:0/2031654285 >> v1:172.21.15.136:6789/0 conn(0x7f2f80150b50 legacy=0x7f2f800c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.027+0000 7f2f85a88640 1 -- 172.21.15.136:0/2031654285 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800c38e0 con 0x7f2f801573e0 2024-02-17T12:58:16.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.030+0000 7f2f85a88640 1 --2- 172.21.15.136:0/2031654285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f8015a3e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f780097a0 tx=0x7f2f7802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53622a2ed5f79ab7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:16.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.034+0000 7f2f77fff640 1 -- 172.21.15.136:0/2031654285 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78031830 con 0x7f2f801573e0 2024-02-17T12:58:16.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.034+0000 7f2f77fff640 1 -- 172.21.15.136:0/2031654285 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78031990 con 0x7f2f801573e0 2024-02-17T12:58:16.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.034+0000 7f2f77fff640 1 -- 172.21.15.136:0/2031654285 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78031d20 con 0x7f2f801573e0 2024-02-17T12:58:16.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 -- 172.21.15.136:0/2031654285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 msgr2=0x7f2f8015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2031654285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f8015a3e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f780097a0 tx=0x7f2f7802b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 -- 172.21.15.136:0/2031654285 shutdown_connections 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2031654285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f8015a3e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2031654285 >> v2:172.21.15.160:3300/0 conn(0x7f2f800ca090 0x7f2f800726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 -- 172.21.15.136:0/2031654285 >> 172.21.15.136:0/2031654285 conn(0x7f2f8006bbd0 msgr2=0x7f2f8006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 -- 172.21.15.136:0/2031654285 shutdown_connections 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.035+0000 7f2f874eb640 1 -- 172.21.15.136:0/2031654285 wait complete. 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.036+0000 7f2f874eb640 1 Processor -- start 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.036+0000 7f2f874eb640 1 -- start start 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f874eb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 0x7f2f80159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f874eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f80150b50 0x7f2f80158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f874eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f80142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f874eb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80164300 con 0x7f2f800ca090 2024-02-17T12:58:16.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f874eb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80163d40 con 0x7f2f80150b50 2024-02-17T12:58:16.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f874eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80164020 con 0x7f2f801573e0 2024-02-17T12:58:16.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.037+0000 7f2f85287640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 0x7f2f80159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.038+0000 7f2f85287640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 0x7f2f80159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60630/0 (socket says 172.21.15.136:60630) 2024-02-17T12:58:16.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.038+0000 7f2f85287640 1 -- 172.21.15.136:0/2780317701 learned_addr learned my addr 172.21.15.136:0/2780317701 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:16.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.038+0000 7f2f85a88640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f80142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.038+0000 7f2f84a86640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f80150b50 0x7f2f80158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.041+0000 7f2f85287640 1 -- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 msgr2=0x7f2f80142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.041+0000 7f2f85287640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f80142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.041+0000 7f2f85287640 1 -- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f80150b50 msgr2=0x7f2f80158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.041+0000 7f2f85287640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f80150b50 0x7f2f80158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.041+0000 7f2f85287640 1 -- 172.21.15.136:0/2780317701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78009400 con 0x7f2f800ca090 2024-02-17T12:58:16.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.043+0000 7f2f85287640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 0x7f2f80159550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00cb40 tx=0x7f2f7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.047+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00aca0 con 0x7f2f800ca090 2024-02-17T12:58:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.047+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00ae00 con 0x7f2f800ca090 2024-02-17T12:58:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.047+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800c7c10 con 0x7f2f800ca090 2024-02-17T12:58:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.047+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c012620 con 0x7f2f800ca090 2024-02-17T12:58:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.047+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f800c81d0 con 0x7f2f800ca090 2024-02-17T12:58:16.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.048+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f80072d70 con 0x7f2f800ca090 2024-02-17T12:58:16.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.288+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2f7c007070 con 0x7f2f800ca090 2024-02-17T12:58:16.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.289+0000 7f2f75ffb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2f6406b890 0x7f2f6406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.289+0000 7f2f84a86640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2f6406b890 0x7f2f6406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.289+0000 7f2f84a86640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2f6406b890 0x7f2f6406dd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f80162230 tx=0x7f2f70009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:16.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.301+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2f7c058e80 con 0x7f2f800ca090 2024-02-17T12:58:16.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.302+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f7c055120 con 0x7f2f800ca090 2024-02-17T12:58:16.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.473+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f80067cb0 con 0x7f2f800ca090 2024-02-17T12:58:16.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.479+0000 7f2f75ffb640 1 -- 172.21.15.136:0/2780317701 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f7c017020 con 0x7f2f800ca090 2024-02-17T12:58:16.469 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T12:58:16.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2f6406b890 msgr2=0x7f2f6406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2f6406b890 0x7f2f6406dd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f80162230 tx=0x7f2f70009190 comp rx=0 tx=0).stop 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 msgr2=0x7f2f80159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 0x7f2f80159550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00cb40 tx=0x7f2f7c00a060 comp rx=0 tx=0).stop 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 shutdown_connections 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2f6406b890 0x7f2f6406dd50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f801573e0 0x7f2f80142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f80150b50 0x7f2f80158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 --2- 172.21.15.136:0/2780317701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f800ca090 0x7f2f80159550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 >> 172.21.15.136:0/2780317701 conn(0x7f2f8006bbd0 msgr2=0x7f2f8014d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 shutdown_connections 2024-02-17T12:58:16.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.481+0000 7f2f874eb640 1 -- 172.21.15.136:0/2780317701 wait complete. 2024-02-17T12:58:16.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:58:16.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.595+0000 7f692a6eb640 1 Processor -- start 2024-02-17T12:58:16.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.595+0000 7f692a6eb640 1 -- start start 2024-02-17T12:58:16.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.596+0000 7f692a6eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 0x7f69240c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.596+0000 7f692a6eb640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f692415a6e0 0x7f692406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.596+0000 7f692a6eb640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240cadc0 con 0x7f692406b830 2024-02-17T12:58:16.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.596+0000 7f692a6eb640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692415d610 con 0x7f692415a6e0 2024-02-17T12:58:16.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.596+0000 7f692a6eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692415d8f0 con 0x7f6924153be0 2024-02-17T12:58:16.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.597+0000 7f6923fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 0x7f69240c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.597+0000 7f69237fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f692415a6e0 0x7f692406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.597+0000 7f6923fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 0x7f69240c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36600/0 (socket says 172.21.15.136:36600) 2024-02-17T12:58:16.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.597+0000 7f6923fff640 1 -- 172.21.15.136:0/2642282334 learned_addr learned my addr 172.21.15.136:0/2642282334 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:16.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.601+0000 7f6923fff640 1 -- 172.21.15.136:0/2642282334 >> v2:172.21.15.160:3300/0 conn(0x7f692415a6e0 msgr2=0x7f692406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:16.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.601+0000 7f6923fff640 1 --2- 172.21.15.136:0/2642282334 >> v2:172.21.15.160:3300/0 conn(0x7f692415a6e0 0x7f692406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.601+0000 7f6923fff640 1 -- 172.21.15.136:0/2642282334 >> v1:172.21.15.160:6789/0 conn(0x7f692406b830 legacy=0x7f69240cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:16.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.601+0000 7f6923fff640 1 -- 172.21.15.136:0/2642282334 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692415dbd0 con 0x7f6924153be0 2024-02-17T12:58:16.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.604+0000 7f6923fff640 1 --2- 172.21.15.136:0/2642282334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 0x7f69240c9f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6914009870 tx=0x7f691402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d1c9fe1f07799 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:16.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.608+0000 7f6922ffd640 1 -- 172.21.15.136:0/2642282334 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914030840 con 0x7f6924153be0 2024-02-17T12:58:16.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.608+0000 7f6922ffd640 1 -- 172.21.15.136:0/2642282334 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69140309a0 con 0x7f6924153be0 2024-02-17T12:58:16.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.608+0000 7f6922ffd640 1 -- 172.21.15.136:0/2642282334 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914030d30 con 0x7f6924153be0 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 -- 172.21.15.136:0/2642282334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 msgr2=0x7f69240c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2642282334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 0x7f69240c9f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6914009870 tx=0x7f691402b980 comp rx=0 tx=0).stop 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 -- 172.21.15.136:0/2642282334 shutdown_connections 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2642282334 >> v2:172.21.15.160:3300/0 conn(0x7f692415a6e0 0x7f692406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2642282334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6924153be0 0x7f69240c9f10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 -- 172.21.15.136:0/2642282334 >> 172.21.15.136:0/2642282334 conn(0x7f692406ca00 msgr2=0x7f692406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 -- 172.21.15.136:0/2642282334 shutdown_connections 2024-02-17T12:58:16.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.609+0000 7f692a6eb640 1 -- 172.21.15.136:0/2642282334 wait complete. 2024-02-17T12:58:16.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.610+0000 7f692a6eb640 1 Processor -- start 2024-02-17T12:58:16.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.610+0000 7f692a6eb640 1 -- start start 2024-02-17T12:58:16.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.611+0000 7f692a6eb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 0x7f69241f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.611+0000 7f692a6eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6924153be0 0x7f69240b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.611+0000 7f692a6eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f692415a6e0 0x7f6924151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.611+0000 7f692a6eb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692414e410 con 0x7f692406b830 2024-02-17T12:58:16.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.611+0000 7f692a6eb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241f0ce0 con 0x7f6924153be0 2024-02-17T12:58:16.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.611+0000 7f692a6eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69241f4260 con 0x7f692415a6e0 2024-02-17T12:58:16.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.612+0000 7f6923fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 0x7f69241f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.612+0000 7f6928c88640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f692415a6e0 0x7f6924151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.612+0000 7f69237fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6924153be0 0x7f69240b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.612+0000 7f6923fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 0x7f69241f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60632/0 (socket says 172.21.15.136:60632) 2024-02-17T12:58:16.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.612+0000 7f6923fff640 1 -- 172.21.15.136:0/2100742744 learned_addr learned my addr 172.21.15.136:0/2100742744 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:16.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.616+0000 7f6923fff640 1 -- 172.21.15.136:0/2100742744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f692415a6e0 msgr2=0x7f6924151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.616+0000 7f6923fff640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f692415a6e0 0x7f6924151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.616+0000 7f6923fff640 1 -- 172.21.15.136:0/2100742744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6924153be0 msgr2=0x7f69240b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:16.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.616+0000 7f6923fff640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6924153be0 0x7f69240b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:16.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.616+0000 7f6923fff640 1 -- 172.21.15.136:0/2100742744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140094d0 con 0x7f692406b830 2024-02-17T12:58:16.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.618+0000 7f6923fff640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 0x7f69241f3d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6914000c00 tx=0x7f6914004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:16.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.621+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914039c90 con 0x7f692406b830 2024-02-17T12:58:16.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.622+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914039df0 con 0x7f692406b830 2024-02-17T12:58:16.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.622+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240b4810 con 0x7f692406b830 2024-02-17T12:58:16.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.622+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914043640 con 0x7f692406b830 2024-02-17T12:58:16.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.622+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69241efda0 con 0x7f692406b830 2024-02-17T12:58:16.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.623+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240cf3a0 con 0x7f692406b830 2024-02-17T12:58:16.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.640+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f69140437a0 con 0x7f692406b830 2024-02-17T12:58:16.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.641+0000 7f6920ff9640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f691006b890 0x7f691006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:16.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.641+0000 7f69237fe640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f691006b890 0x7f691006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:16.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.641+0000 7f69237fe640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f691006b890 0x7f691006dd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f69240b4260 tx=0x7f6918009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:16.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.644+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f691403e070 con 0x7f692406b830 2024-02-17T12:58:16.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:16.883+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6914078560 con 0x7f692406b830 2024-02-17T12:58:17.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.068+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69240b21a0 con 0x7f692406b830 2024-02-17T12:58:17.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.073+0000 7f6920ff9640 1 -- 172.21.15.136:0/2100742744 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69140340a0 con 0x7f692406b830 2024-02-17T12:58:17.064 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f691006b890 msgr2=0x7f691006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f691006b890 0x7f691006dd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f69240b4260 tx=0x7f6918009190 comp rx=0 tx=0).stop 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 msgr2=0x7f69241f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 0x7f69241f3d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6914000c00 tx=0x7f6914004730 comp rx=0 tx=0).stop 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 shutdown_connections 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f691006b890 0x7f691006dd50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f692415a6e0 0x7f6924151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6924153be0 0x7f69240b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 --2- 172.21.15.136:0/2100742744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f692406b830 0x7f69241f3d20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.075+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 >> 172.21.15.136:0/2100742744 conn(0x7f692406ca00 msgr2=0x7f6924159590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:17.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.076+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 shutdown_connections 2024-02-17T12:58:17.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.076+0000 7f692a6eb640 1 -- 172.21.15.136:0/2100742744 wait complete. 2024-02-17T12:58:17.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:58:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.190+0000 7f9829a81640 1 Processor -- start 2024-02-17T12:58:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.190+0000 7f9829a81640 1 -- start start 2024-02-17T12:58:17.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f9829a81640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98241634e0 0x7f98241658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f9829a81640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982406b3e0 con 0x7f98240cbc00 2024-02-17T12:58:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f9829a81640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240cb470 con 0x7f98240ca4e0 2024-02-17T12:58:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f9829a81640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cb750 con 0x7f98241634e0 2024-02-17T12:58:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f98237fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f98240cbc00 0x7f982406acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:49722/0 (socket says 172.21.15.136:49722) 2024-02-17T12:58:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f98237fe640 1 -- 172.21.15.136:0/3923055632 learned_addr learned my addr 172.21.15.136:0/3923055632 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:17.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.191+0000 7f9823fff640 1 --2- 172.21.15.136:0/3923055632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98241634e0 0x7f98241658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.194+0000 7f98227fc640 1 -- 172.21.15.136:0/3923055632 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287878958 0 0) 0x7f982406b3e0 con 0x7f98240cbc00 2024-02-17T12:58:17.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.194+0000 7f98227fc640 1 -- 172.21.15.136:0/3923055632 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f980c003520 con 0x7f98240cbc00 2024-02-17T12:58:17.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.194+0000 7f9823fff640 1 -- 172.21.15.136:0/3923055632 >> v1:172.21.15.160:6789/0 conn(0x7f98240ca4e0 legacy=0x7f98240cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.194+0000 7f9823fff640 1 -- 172.21.15.136:0/3923055632 >> v1:172.21.15.136:6789/0 conn(0x7f98240cbc00 legacy=0x7f982406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.194+0000 7f9823fff640 1 -- 172.21.15.136:0/3923055632 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982415d1f0 con 0x7f98241634e0 2024-02-17T12:58:17.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.196+0000 7f9823fff640 1 --2- 172.21.15.136:0/3923055632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98241634e0 0x7f98241658d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f981c009dc0 tx=0x7f981c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c9362a38e42e6b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:17.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.200+0000 7f98227fc640 1 -- 172.21.15.136:0/3923055632 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c02ccd0 con 0x7f98241634e0 2024-02-17T12:58:17.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.200+0000 7f98227fc640 1 -- 172.21.15.136:0/3923055632 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c02ce30 con 0x7f98241634e0 2024-02-17T12:58:17.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.200+0000 7f98227fc640 1 -- 172.21.15.136:0/3923055632 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c034660 con 0x7f98241634e0 2024-02-17T12:58:17.191 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 -- 172.21.15.136:0/3923055632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98241634e0 msgr2=0x7f98241658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.191 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 --2- 172.21.15.136:0/3923055632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98241634e0 0x7f98241658d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f981c009dc0 tx=0x7f981c02bf20 comp rx=0 tx=0).stop 2024-02-17T12:58:17.191 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 -- 172.21.15.136:0/3923055632 shutdown_connections 2024-02-17T12:58:17.191 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 --2- 172.21.15.136:0/3923055632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98241634e0 0x7f98241658d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 -- 172.21.15.136:0/3923055632 >> 172.21.15.136:0/3923055632 conn(0x7f98240721f0 msgr2=0x7f98240725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:17.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 -- 172.21.15.136:0/3923055632 shutdown_connections 2024-02-17T12:58:17.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.201+0000 7f9829a81640 1 -- 172.21.15.136:0/3923055632 wait complete. 2024-02-17T12:58:17.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.202+0000 7f9829a81640 1 Processor -- start 2024-02-17T12:58:17.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.202+0000 7f9829a81640 1 -- start start 2024-02-17T12:58:17.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9829a81640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98240ca4e0 0x7f982414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9829a81640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 0x7f9824154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9829a81640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98241634e0 0x7f98241f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9829a81640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240c2e20 con 0x7f98241634e0 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9829a81640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240c3d30 con 0x7f98240ca4e0 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9829a81640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9824155230 con 0x7f98240cbc00 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9823fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98241634e0 0x7f98241f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9822ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 0x7f9824154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f98237fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98240ca4e0 0x7f982414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9822ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 0x7f9824154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36630/0 (socket says 172.21.15.136:36630) 2024-02-17T12:58:17.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.203+0000 7f9822ffd640 1 -- 172.21.15.136:0/1683580836 learned_addr learned my addr 172.21.15.136:0/1683580836 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:17.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.207+0000 7f9822ffd640 1 -- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98240ca4e0 msgr2=0x7f982414d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.207+0000 7f9822ffd640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98240ca4e0 0x7f982414d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.207+0000 7f9822ffd640 1 -- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98241634e0 msgr2=0x7f98241f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.207+0000 7f9822ffd640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98241634e0 0x7f98241f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.207+0000 7f9822ffd640 1 -- 172.21.15.136:0/1683580836 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009a70 con 0x7f98240cbc00 2024-02-17T12:58:17.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.207+0000 7f9823fff640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98241634e0 0x7f98241f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:58:17.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.209+0000 7f9822ffd640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 0x7f9824154930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f981800c430 tx=0x7f981800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:17.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.212+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180052d0 con 0x7f98240cbc00 2024-02-17T12:58:17.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.212+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240c3120 con 0x7f98240cbc00 2024-02-17T12:58:17.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.212+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98240c36e0 con 0x7f98240cbc00 2024-02-17T12:58:17.203 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.213+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9824151ff0 con 0x7f98240cbc00 2024-02-17T12:58:17.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.459+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9818005430 con 0x7f98240cbc00 2024-02-17T12:58:17.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.459+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818006a20 con 0x7f98240cbc00 2024-02-17T12:58:17.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.459+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9818006c40 con 0x7f98240cbc00 2024-02-17T12:58:17.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.460+0000 7f980bfff640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f981006b810 0x7f981006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.460+0000 7f98237fe640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f981006b810 0x7f981006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.460+0000 7f98237fe640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f981006b810 0x7f981006dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9814005880 tx=0x7f9814009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:17.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.462+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9818058610 con 0x7f98240cbc00 2024-02-17T12:58:17.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.473+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98180548b0 con 0x7f98240cbc00 2024-02-17T12:58:17.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.644+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98240c78d0 con 0x7f98240cbc00 2024-02-17T12:58:17.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.665+0000 7f980bfff640 1 -- 172.21.15.136:0/1683580836 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9818020020 con 0x7f98240cbc00 2024-02-17T12:58:17.655 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-02-17T12:58:17.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f981006b810 msgr2=0x7f981006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f981006b810 0x7f981006dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9814005880 tx=0x7f9814009040 comp rx=0 tx=0).stop 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 msgr2=0x7f9824154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 0x7f9824154930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f981800c430 tx=0x7f981800c8f0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 shutdown_connections 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f981006b810 0x7f981006dcd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98241634e0 0x7f98241f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98240cbc00 0x7f9824154930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 --2- 172.21.15.136:0/1683580836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98240ca4e0 0x7f982414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 >> 172.21.15.136:0/1683580836 conn(0x7f98240721f0 msgr2=0x7f98240725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 shutdown_connections 2024-02-17T12:58:17.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.667+0000 7f9829a81640 1 -- 172.21.15.136:0/1683580836 wait complete. 2024-02-17T12:58:17.669 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T12:58:17.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.783+0000 7fa4c9fe9640 1 Processor -- start 2024-02-17T12:58:17.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.783+0000 7fa4c9fe9640 1 -- start start 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.783+0000 7fa4c9fe9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 0x7fa4c40c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.783+0000 7fa4c9fe9640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa4c4071940 0x7fa4c406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.784+0000 7fa4c9fe9640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c4159580 con 0x7fa4c415a2b0 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.784+0000 7fa4c9fe9640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c406d4b0 con 0x7fa4c4071940 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.784+0000 7fa4c9fe9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4156ab0 con 0x7fa4c4150140 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.784+0000 7fa4c37fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 0x7fa4c40c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.784+0000 7fa4c3fff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa4c4071940 0x7fa4c406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.785+0000 7fa4c37fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 0x7fa4c40c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36646/0 (socket says 172.21.15.136:36646) 2024-02-17T12:58:17.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.785+0000 7fa4c37fe640 1 -- 172.21.15.136:0/399097194 learned_addr learned my addr 172.21.15.136:0/399097194 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:17.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.787+0000 7fa4c37fe640 1 -- 172.21.15.136:0/399097194 >> v2:172.21.15.160:3300/0 conn(0x7fa4c4071940 msgr2=0x7fa4c406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:17.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.787+0000 7fa4c37fe640 1 --2- 172.21.15.136:0/399097194 >> v2:172.21.15.160:3300/0 conn(0x7fa4c4071940 0x7fa4c406cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.787+0000 7fa4c37fe640 1 -- 172.21.15.136:0/399097194 >> v1:172.21.15.160:6789/0 conn(0x7fa4c415a2b0 legacy=0x7fa4c406c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.787+0000 7fa4c37fe640 1 -- 172.21.15.136:0/399097194 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4156d70 con 0x7fa4c4150140 2024-02-17T12:58:17.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.790+0000 7fa4c37fe640 1 --2- 172.21.15.136:0/399097194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 0x7fa4c40c3c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400bb10 tx=0x7fa4b402e030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c74fb410e6321cd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:17.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.792+0000 7fa4c27fc640 1 -- 172.21.15.136:0/399097194 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b402ede0 con 0x7fa4c4150140 2024-02-17T12:58:17.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.794+0000 7fa4c27fc640 1 -- 172.21.15.136:0/399097194 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4036440 con 0x7fa4c4150140 2024-02-17T12:58:17.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.794+0000 7fa4c27fc640 1 -- 172.21.15.136:0/399097194 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40367d0 con 0x7fa4c4150140 2024-02-17T12:58:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.794+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/399097194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 msgr2=0x7fa4c40c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.794+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/399097194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 0x7fa4c40c3c90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400bb10 tx=0x7fa4b402e030 comp rx=0 tx=0).stop 2024-02-17T12:58:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.795+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/399097194 shutdown_connections 2024-02-17T12:58:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.795+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/399097194 >> v2:172.21.15.160:3300/0 conn(0x7fa4c4071940 0x7fa4c406cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.795+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/399097194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c4150140 0x7fa4c40c3c90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.795+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/399097194 >> 172.21.15.136:0/399097194 conn(0x7fa4c40c7e90 msgr2=0x7fa4c40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:17.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.795+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/399097194 shutdown_connections 2024-02-17T12:58:17.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.795+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/399097194 wait complete. 2024-02-17T12:58:17.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.796+0000 7fa4c9fe9640 1 Processor -- start 2024-02-17T12:58:17.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.796+0000 7fa4c9fe9640 1 -- start start 2024-02-17T12:58:17.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c9fe9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4c4071940 0x7fa4c4152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c9fe9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4c4150140 0x7fa4c406c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c9fe9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c415a2b0 0x7fa4c4149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:17.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c9fe9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4150f30 con 0x7fa4c4071940 2024-02-17T12:58:17.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c9fe9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c414cb80 con 0x7fa4c4150140 2024-02-17T12:58:17.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c9fe9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c41509b0 con 0x7fa4c415a2b0 2024-02-17T12:58:17.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4c4150140 0x7fa4c406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c3fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c415a2b0 0x7fa4c4149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.797+0000 7fa4c37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4c4071940 0x7fa4c4152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:17.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.798+0000 7fa4c2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4c4150140 0x7fa4c406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:49764/0 (socket says 172.21.15.136:49764) 2024-02-17T12:58:17.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.798+0000 7fa4c3fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c415a2b0 0x7fa4c4149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36656/0 (socket says 172.21.15.136:36656) 2024-02-17T12:58:17.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.798+0000 7fa4c2ffd640 1 -- 172.21.15.136:0/665129664 learned_addr learned my addr 172.21.15.136:0/665129664 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:17.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.801+0000 7fa4c37fe640 1 -- 172.21.15.136:0/665129664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c415a2b0 msgr2=0x7fa4c4149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.801+0000 7fa4c37fe640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c415a2b0 0x7fa4c4149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.801+0000 7fa4c37fe640 1 -- 172.21.15.136:0/665129664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4c4150140 msgr2=0x7fa4c406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:17.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.801+0000 7fa4c37fe640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4c4150140 0x7fa4c406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:17.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.801+0000 7fa4c37fe640 1 -- 172.21.15.136:0/665129664 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b400b770 con 0x7fa4c4071940 2024-02-17T12:58:17.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.803+0000 7fa4c37fe640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4c4071940 0x7fa4c4152ef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4035000 tx=0x7fa4b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:17.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.807+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4034750 con 0x7fa4c4071940 2024-02-17T12:58:17.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.807+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40348f0 con 0x7fa4c4071940 2024-02-17T12:58:17.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.807+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c4150c50 con 0x7fa4c4071940 2024-02-17T12:58:17.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.807+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4034ca0 con 0x7fa4c4071940 2024-02-17T12:58:17.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.807+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4154050 con 0x7fa4c4071940 2024-02-17T12:58:17.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:17.808+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4153bd0 con 0x7fa4c4071940 2024-02-17T12:58:18.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.051+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa4b4041460 con 0x7fa4c4071940 2024-02-17T12:58:18.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.051+0000 7fa4abfff640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa4b006b860 0x7fa4b006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.051+0000 7fa4c2ffd640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa4b006b860 0x7fa4b006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.052+0000 7fa4c2ffd640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa4b006b860 0x7fa4b006dd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4159320 tx=0x7fa4b8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:18.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.065+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa4b407ae90 con 0x7fa4c4071940 2024-02-17T12:58:18.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.065+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4b4077130 con 0x7fa4c4071940 2024-02-17T12:58:18.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.251+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4c4153bd0 con 0x7fa4c4071940 2024-02-17T12:58:18.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.256+0000 7fa4abfff640 1 -- 172.21.15.136:0/665129664 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4b403b020 con 0x7fa4c4071940 2024-02-17T12:58:18.247 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa4b006b860 msgr2=0x7fa4b006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa4b006b860 0x7fa4b006dd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4159320 tx=0x7fa4b8009040 comp rx=0 tx=0).stop 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4c4071940 msgr2=0x7fa4c4152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4c4071940 0x7fa4c4152ef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4035000 tx=0x7fa4b40046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 shutdown_connections 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa4b006b860 0x7fa4b006dd20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4c415a2b0 0x7fa4c4149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4c4150140 0x7fa4c406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 --2- 172.21.15.136:0/665129664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4c4071940 0x7fa4c4152ef0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 >> 172.21.15.136:0/665129664 conn(0x7fa4c40c7e90 msgr2=0x7fa4c40c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 shutdown_connections 2024-02-17T12:58:18.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.259+0000 7fa4c9fe9640 1 -- 172.21.15.136:0/665129664 wait complete. 2024-02-17T12:58:18.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 Processor -- start 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 -- start start 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7d4c153d00 0x7f7d4c0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c15dbe0 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c15dea0 con 0x7f7d4c153d00 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.372+0000 7f7d525a0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c159e80 con 0x7f7d4c0ca8b0 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.373+0000 7f7d5159e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7d4c153d00 0x7f7d4c0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.373+0000 7f7d50d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.374+0000 7f7d50d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c15d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36666/0 (socket says 172.21.15.136:36666) 2024-02-17T12:58:18.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.374+0000 7f7d50d9d640 1 -- 172.21.15.136:0/4224985001 learned_addr learned my addr 172.21.15.136:0/4224985001 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:18.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.376+0000 7f7d50d9d640 1 -- 172.21.15.136:0/4224985001 >> v2:172.21.15.136:3300/0 conn(0x7f7d4c153d00 msgr2=0x7f7d4c0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:18.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.376+0000 7f7d50d9d640 1 --2- 172.21.15.136:0/4224985001 >> v2:172.21.15.136:3300/0 conn(0x7f7d4c153d00 0x7f7d4c0ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.376+0000 7f7d50d9d640 1 -- 172.21.15.136:0/4224985001 >> v1:172.21.15.136:6789/0 conn(0x7f7d4c15d5e0 legacy=0x7f7d4c0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.376+0000 7f7d50d9d640 1 -- 172.21.15.136:0/4224985001 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c15a160 con 0x7f7d4c0ca8b0 2024-02-17T12:58:18.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.378+0000 7f7d50d9d640 1 --2- 172.21.15.136:0/4224985001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c15d0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009870 tx=0x7f7d4802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a742c68184e45eb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:18.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.381+0000 7f7d3ffff640 1 -- 172.21.15.136:0/4224985001 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48030840 con 0x7f7d4c0ca8b0 2024-02-17T12:58:18.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.381+0000 7f7d3ffff640 1 -- 172.21.15.136:0/4224985001 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480309a0 con 0x7f7d4c0ca8b0 2024-02-17T12:58:18.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.381+0000 7f7d3ffff640 1 -- 172.21.15.136:0/4224985001 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48030d30 con 0x7f7d4c0ca8b0 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 -- 172.21.15.136:0/4224985001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 msgr2=0x7f7d4c15d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 --2- 172.21.15.136:0/4224985001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c15d0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009870 tx=0x7f7d4802b980 comp rx=0 tx=0).stop 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 -- 172.21.15.136:0/4224985001 shutdown_connections 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 --2- 172.21.15.136:0/4224985001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c15d0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 --2- 172.21.15.136:0/4224985001 >> v2:172.21.15.136:3300/0 conn(0x7f7d4c153d00 0x7f7d4c0ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 -- 172.21.15.136:0/4224985001 >> 172.21.15.136:0/4224985001 conn(0x7f7d4c06b7b0 msgr2=0x7f7d4c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 -- 172.21.15.136:0/4224985001 shutdown_connections 2024-02-17T12:58:18.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.382+0000 7f7d525a0640 1 -- 172.21.15.136:0/4224985001 wait complete. 2024-02-17T12:58:18.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.383+0000 7f7d525a0640 1 Processor -- start 2024-02-17T12:58:18.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.383+0000 7f7d525a0640 1 -- start start 2024-02-17T12:58:18.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d525a0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d525a0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d4c153d00 0x7f7d4c1ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d525a0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d4c15d5e0 0x7f7d4c149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d525a0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cf910 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d525a0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cfbf0 con 0x7f7d4c153d00 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d525a0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cfed0 con 0x7f7d4c0ca8b0 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d51d9f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d4c15d5e0 0x7f7d4c149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.384+0000 7f7d5159e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.385+0000 7f7d50d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d4c153d00 0x7f7d4c1ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.385+0000 7f7d5159e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c14f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:36680/0 (socket says 172.21.15.136:36680) 2024-02-17T12:58:18.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.385+0000 7f7d5159e640 1 -- 172.21.15.136:0/1466670817 learned_addr learned my addr 172.21.15.136:0/1466670817 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:18.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.388+0000 7f7d51d9f640 1 -- 172.21.15.136:0/1466670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 msgr2=0x7f7d4c14f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.388+0000 7f7d51d9f640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c14f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.388+0000 7f7d51d9f640 1 -- 172.21.15.136:0/1466670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d4c153d00 msgr2=0x7f7d4c1ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.388+0000 7f7d51d9f640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d4c153d00 0x7f7d4c1ef3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.388+0000 7f7d51d9f640 1 -- 172.21.15.136:0/1466670817 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480094d0 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.390+0000 7f7d51d9f640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d4c15d5e0 0x7f7d4c149b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c730 tx=0x7f7d4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:18.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.393+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44006d50 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.393+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44003970 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.393+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44003d60 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.393+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c0cdf80 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.394+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0ce540 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.395+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c1540e0 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.413+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7d440050d0 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.414+0000 7f7d3dffb640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d3006b860 0x7f7d3006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:18.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.414+0000 7f7d5159e640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d3006b860 0x7f7d3006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:18.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.414+0000 7f7d5159e640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d3006b860 0x7f7d3006dd20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009c00 tx=0x7f7d40009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:18.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.651+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7d44059170 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.651+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d44055410 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.837+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d4c069c80 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.842+0000 7f7d3dffb640 1 -- 172.21.15.136:0/1466670817 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7d44058ad0 con 0x7f7d4c15d5e0 2024-02-17T12:58:18.833 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-02-17T12:58:18.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d3006b860 msgr2=0x7f7d3006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d3006b860 0x7f7d3006dd20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009c00 tx=0x7f7d40009190 comp rx=0 tx=0).stop 2024-02-17T12:58:18.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d4c15d5e0 msgr2=0x7f7d4c149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:18.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d4c15d5e0 0x7f7d4c149b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c730 tx=0x7f7d4400cbf0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 shutdown_connections 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7d3006b860 0x7f7d3006dd20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d4c15d5e0 0x7f7d4c149b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d4c153d00 0x7f7d4c1ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 --2- 172.21.15.136:0/1466670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d4c0ca8b0 0x7f7d4c14f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.844+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 >> 172.21.15.136:0/1466670817 conn(0x7f7d4c06b7b0 msgr2=0x7f7d4c0c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.845+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 shutdown_connections 2024-02-17T12:58:18.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:18.845+0000 7f7d525a0640 1 -- 172.21.15.136:0/1466670817 wait complete. 2024-02-17T12:58:18.846 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2024-02-17T12:58:18.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:18.846 DEBUG:teuthology.orchestra.run.smithi136:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-02-17T12:58:18.872 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[44698]: fuse finished with error 0 and tester_r 0 2024-02-17T12:58:18.874 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:58:24.975 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T12:58:24.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:24.976 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-02-17T12:58:25.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:25.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.171+0000 7fddf9935640 1 Processor -- start 2024-02-17T12:58:25.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.171+0000 7fddf9935640 1 -- start start 2024-02-17T12:58:25.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.172+0000 7fddf9935640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fddf414e3b0 0x7fddf40c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.172+0000 7fddf9935640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 0x7fddf40c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.172+0000 7fddf9935640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf406df40 con 0x7fddf40c7940 2024-02-17T12:58:25.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.172+0000 7fddf9935640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf4071b40 con 0x7fddf414e3b0 2024-02-17T12:58:25.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.172+0000 7fddf9935640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c6420 con 0x7fddf40708f0 2024-02-17T12:58:25.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.172+0000 7fddf37fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 0x7fddf40c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.173+0000 7fddf2ffd640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fddf414e3b0 0x7fddf40c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.173+0000 7fddf37fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 0x7fddf40c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:49276/0 (socket says 172.21.15.136:49276) 2024-02-17T12:58:25.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.173+0000 7fddf37fe640 1 -- 172.21.15.136:0/2920955592 learned_addr learned my addr 172.21.15.136:0/2920955592 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:25.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.175+0000 7fddf37fe640 1 -- 172.21.15.136:0/2920955592 >> v2:172.21.15.160:3300/0 conn(0x7fddf414e3b0 msgr2=0x7fddf40c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:25.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.175+0000 7fddf37fe640 1 --2- 172.21.15.136:0/2920955592 >> v2:172.21.15.160:3300/0 conn(0x7fddf414e3b0 0x7fddf40c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.175+0000 7fddf37fe640 1 -- 172.21.15.136:0/2920955592 >> v1:172.21.15.160:6789/0 conn(0x7fddf40c7940 legacy=0x7fddf4157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.175+0000 7fddf37fe640 1 -- 172.21.15.136:0/2920955592 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf414e790 con 0x7fddf40708f0 2024-02-17T12:58:25.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.178+0000 7fddf37fe640 1 --2- 172.21.15.136:0/2920955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 0x7fddf40c4aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11615a73d7a5fe1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:25.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.182+0000 7fddf27fc640 1 -- 172.21.15.136:0/2920955592 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec02ca70 con 0x7fddf40708f0 2024-02-17T12:58:25.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.182+0000 7fddf27fc640 1 -- 172.21.15.136:0/2920955592 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec02cbd0 con 0x7fddf40708f0 2024-02-17T12:58:25.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.182+0000 7fddf27fc640 1 -- 172.21.15.136:0/2920955592 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0343f0 con 0x7fddf40708f0 2024-02-17T12:58:25.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 -- 172.21.15.136:0/2920955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 msgr2=0x7fddf40c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 --2- 172.21.15.136:0/2920955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 0x7fddf40c4aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec02bed0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 -- 172.21.15.136:0/2920955592 shutdown_connections 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 --2- 172.21.15.136:0/2920955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40708f0 0x7fddf40c4aa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 --2- 172.21.15.136:0/2920955592 >> v2:172.21.15.160:3300/0 conn(0x7fddf414e3b0 0x7fddf40c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 -- 172.21.15.136:0/2920955592 >> 172.21.15.136:0/2920955592 conn(0x7fddf40c7e90 msgr2=0x7fddf40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 -- 172.21.15.136:0/2920955592 shutdown_connections 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.183+0000 7fddf9935640 1 -- 172.21.15.136:0/2920955592 wait complete. 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.184+0000 7fddf9935640 1 Processor -- start 2024-02-17T12:58:25.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.184+0000 7fddf9935640 1 -- start start 2024-02-17T12:58:25.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf9935640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf40708f0 0x7fddf41476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf9935640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40c7940 0x7fddf40c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf9935640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 0x7fddf4157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf9935640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf41ed230 con 0x7fddf414e3b0 2024-02-17T12:58:25.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf9935640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4157770 con 0x7fddf40708f0 2024-02-17T12:58:25.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf9935640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf41455f0 con 0x7fddf40c7940 2024-02-17T12:58:25.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 0x7fddf4157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddf2ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf40708f0 0x7fddf41476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.185+0000 7fddebfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40c7940 0x7fddf40c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.186+0000 7fddf37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 0x7fddf4157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54848/0 (socket says 172.21.15.136:54848) 2024-02-17T12:58:25.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.186+0000 7fddf37fe640 1 -- 172.21.15.136:0/4174124219 learned_addr learned my addr 172.21.15.136:0/4174124219 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:25.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.189+0000 7fddf37fe640 1 -- 172.21.15.136:0/4174124219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40c7940 msgr2=0x7fddf40c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.189+0000 7fddf37fe640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40c7940 0x7fddf40c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.189+0000 7fddf37fe640 1 -- 172.21.15.136:0/4174124219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf40708f0 msgr2=0x7fddf41476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.189+0000 7fddf37fe640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf40708f0 0x7fddf41476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.189+0000 7fddf37fe640 1 -- 172.21.15.136:0/4174124219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec009b30 con 0x7fddf414e3b0 2024-02-17T12:58:25.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.191+0000 7fddf37fe640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 0x7fddf4157ea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:25.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.195+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec03e450 con 0x7fddf414e3b0 2024-02-17T12:58:25.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.195+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec03e5b0 con 0x7fddf414e3b0 2024-02-17T12:58:25.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.195+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf4145790 con 0x7fddf414e3b0 2024-02-17T12:58:25.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.195+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec03e960 con 0x7fddf414e3b0 2024-02-17T12:58:25.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.195+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf4157a10 con 0x7fddf414e3b0 2024-02-17T12:58:25.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.196+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf4154e60 con 0x7fddf414e3b0 2024-02-17T12:58:25.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.215+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fddec03eac0 con 0x7fddf414e3b0 2024-02-17T12:58:25.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.215+0000 7fddf0ff9640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fddd406b890 0x7fddd406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.215+0000 7fddf2ffd640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fddd406b890 0x7fddd406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.216+0000 7fddf2ffd640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fddd406b890 0x7fddd406dd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009aa0 tx=0x7fdde4009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:25.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.453+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fddec052e20 con 0x7fddf414e3b0 2024-02-17T12:58:25.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.453+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fddec077da0 con 0x7fddf414e3b0 2024-02-17T12:58:25.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.626+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddf4157ba0 con 0x7fddf414e3b0 2024-02-17T12:58:25.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.664+0000 7fddf0ff9640 1 -- 172.21.15.136:0/4174124219 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7fddec07b460 con 0x7fddf414e3b0 2024-02-17T12:58:25.655 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:25.655 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:25.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fddd406b890 msgr2=0x7fddd406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fddd406b890 0x7fddd406dd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009aa0 tx=0x7fdde4009190 comp rx=0 tx=0).stop 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 msgr2=0x7fddf4157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 0x7fddf4157ea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 shutdown_connections 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fddd406b890 0x7fddd406dd50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddf414e3b0 0x7fddf4157ea0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf40c7940 0x7fddf40c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 --2- 172.21.15.136:0/4174124219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf40708f0 0x7fddf41476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 >> 172.21.15.136:0/4174124219 conn(0x7fddf40c7e90 msgr2=0x7fddf40c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 shutdown_connections 2024-02-17T12:58:25.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.667+0000 7fddf9935640 1 -- 172.21.15.136:0/4174124219 wait complete. 2024-02-17T12:58:25.669 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:25.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.779+0000 7f3b1f4a3640 1 Processor -- start 2024-02-17T12:58:25.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.779+0000 7f3b1f4a3640 1 -- start start 2024-02-17T12:58:25.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1f4a3640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3b1806f4f0 0x7f3b1806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1f4a3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b1806f8d0 0x7f3b18156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1f4a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b18157530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1f4a3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1806dbe0 con 0x7f3b1806f8d0 2024-02-17T12:58:25.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1f4a3640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1806c260 con 0x7f3b1806f4f0 2024-02-17T12:58:25.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1f4a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1815a1a0 con 0x7f3b180aff30 2024-02-17T12:58:25.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.780+0000 7f3b1ca3e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b1806f8d0 0x7f3b18156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.781+0000 7f3b1da40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b18157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.781+0000 7f3b1ca3e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b1806f8d0 0x7f3b18156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54862/0 (socket says 172.21.15.136:54862) 2024-02-17T12:58:25.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.781+0000 7f3b1ca3e640 1 -- 172.21.15.136:0/295734272 learned_addr learned my addr 172.21.15.136:0/295734272 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:25.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.781+0000 7f3b1d23f640 1 --2- 172.21.15.136:0/295734272 >> v2:172.21.15.160:3300/0 conn(0x7f3b1806f4f0 0x7f3b1806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.783+0000 7f3b1ca3e640 1 -- 172.21.15.136:0/295734272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 msgr2=0x7f3b18157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:25.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.783+0000 7f3b1ca3e640 1 --2- 172.21.15.136:0/295734272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b18157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.783+0000 7f3b1ca3e640 1 -- 172.21.15.136:0/295734272 >> v2:172.21.15.160:3300/0 conn(0x7f3b1806f4f0 msgr2=0x7f3b1806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:25.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.783+0000 7f3b1ca3e640 1 --2- 172.21.15.136:0/295734272 >> v2:172.21.15.160:3300/0 conn(0x7f3b1806f4f0 0x7f3b1806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.783+0000 7f3b1ca3e640 1 -- 172.21.15.136:0/295734272 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1815a480 con 0x7f3b1806f8d0 2024-02-17T12:58:25.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.785+0000 7f3b1ca3e640 1 --2- 172.21.15.136:0/295734272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f8d0 0x7f3b18156ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b18067790 tx=0x7f3b0802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b8b5d44271064e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:25.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.788+0000 7f3b0ffff640 1 -- 172.21.15.136:0/295734272 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08030860 con 0x7f3b1806f8d0 2024-02-17T12:58:25.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.788+0000 7f3b0ffff640 1 -- 172.21.15.136:0/295734272 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b080309c0 con 0x7f3b1806f8d0 2024-02-17T12:58:25.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.788+0000 7f3b0ffff640 1 -- 172.21.15.136:0/295734272 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08030d50 con 0x7f3b1806f8d0 2024-02-17T12:58:25.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/295734272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f8d0 msgr2=0x7f3b18156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/295734272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f8d0 0x7f3b18156ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b18067790 tx=0x7f3b0802b9a0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/295734272 shutdown_connections 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/295734272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b18157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/295734272 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f8d0 0x7f3b18156ff0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/295734272 >> v2:172.21.15.160:3300/0 conn(0x7f3b1806f4f0 0x7f3b1806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/295734272 >> 172.21.15.136:0/295734272 conn(0x7f3b1806b0f0 msgr2=0x7f3b180668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/295734272 shutdown_connections 2024-02-17T12:58:25.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.789+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/295734272 wait complete. 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.790+0000 7f3b1f4a3640 1 Processor -- start 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.790+0000 7f3b1f4a3640 1 -- start start 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1f4a3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 0x7f3b181ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1f4a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b1806f8d0 0x7f3b180cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1f4a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b180b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1f4a3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180b2b00 con 0x7f3b1806f4f0 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1f4a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180cb360 con 0x7f3b1806f8d0 2024-02-17T12:58:25.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1f4a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180cb850 con 0x7f3b180aff30 2024-02-17T12:58:25.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.791+0000 7f3b1d23f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 0x7f3b181ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.792+0000 7f3b1d23f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 0x7f3b181ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54876/0 (socket says 172.21.15.136:54876) 2024-02-17T12:58:25.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.792+0000 7f3b1da40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b180b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.792+0000 7f3b1d23f640 1 -- 172.21.15.136:0/939959696 learned_addr learned my addr 172.21.15.136:0/939959696 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:25.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.792+0000 7f3b1ca3e640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b1806f8d0 0x7f3b180cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.795+0000 7f3b1d23f640 1 -- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 msgr2=0x7f3b180b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.795+0000 7f3b1d23f640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b180b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.795+0000 7f3b1d23f640 1 -- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b1806f8d0 msgr2=0x7f3b180cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:25.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.795+0000 7f3b1d23f640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b1806f8d0 0x7f3b180cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:25.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.795+0000 7f3b1d23f640 1 -- 172.21.15.136:0/939959696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080094d0 con 0x7f3b1806f4f0 2024-02-17T12:58:25.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.797+0000 7f3b1d23f640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 0x7f3b181ef6f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e890 tx=0x7f3b1400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:25.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.801+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1400c940 con 0x7f3b1806f4f0 2024-02-17T12:58:25.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.801+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1400caa0 con 0x7f3b1806f4f0 2024-02-17T12:58:25.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.801+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1400ce30 con 0x7f3b1806f4f0 2024-02-17T12:58:25.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.801+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b181f0090 con 0x7f3b1806f4f0 2024-02-17T12:58:25.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.801+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b180b2720 con 0x7f3b1806f4f0 2024-02-17T12:58:25.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.802+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1806cb80 con 0x7f3b1806f4f0 2024-02-17T12:58:25.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.821+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3b14013470 con 0x7f3b1806f4f0 2024-02-17T12:58:25.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.821+0000 7f3b0dffb640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3afc06b810 0x7f3afc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:25.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.821+0000 7f3b1ca3e640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3afc06b810 0x7f3afc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:25.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.821+0000 7f3b1ca3e640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3afc06b810 0x7f3afc06dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b08036000 tx=0x7f3b08008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:25.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:25.824+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3b14059340 con 0x7f3b1806f4f0 2024-02-17T12:58:26.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.067+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b140555e0 con 0x7f3b1806f4f0 2024-02-17T12:58:26.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.249+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b1804efc0 con 0x7f3b1806f4f0 2024-02-17T12:58:26.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.287+0000 7f3b0dffb640 1 -- 172.21.15.136:0/939959696 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f3b14017090 con 0x7f3b1806f4f0 2024-02-17T12:58:26.278 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:26.278 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:26.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3afc06b810 msgr2=0x7f3afc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:26.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3afc06b810 0x7f3afc06dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b08036000 tx=0x7f3b08008030 comp rx=0 tx=0).stop 2024-02-17T12:58:26.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 msgr2=0x7f3b181ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:26.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 0x7f3b181ef6f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e890 tx=0x7f3b1400ed50 comp rx=0 tx=0).stop 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 shutdown_connections 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3afc06b810 0x7f3afc06dcd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b180aff30 0x7f3b180b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b1806f8d0 0x7f3b180cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 --2- 172.21.15.136:0/939959696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b1806f4f0 0x7f3b181ef6f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 >> 172.21.15.136:0/939959696 conn(0x7f3b1806b0f0 msgr2=0x7f3b180668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 shutdown_connections 2024-02-17T12:58:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.290+0000 7f3b1f4a3640 1 -- 172.21.15.136:0/939959696 wait complete. 2024-02-17T12:58:26.292 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T12:58:26.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.405+0000 7f2180815640 1 Processor -- start 2024-02-17T12:58:26.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.405+0000 7f2180815640 1 -- start start 2024-02-17T12:58:26.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.406+0000 7f2180815640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0cbc00 0x7f217c06acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:26.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.406+0000 7f2180815640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f217c0ca4e0 0x7f217c0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:26.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.406+0000 7f2180815640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c0cb470 con 0x7f217c0cc520 2024-02-17T12:58:26.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.406+0000 7f2180815640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217c0cc930 con 0x7f217c0ca4e0 2024-02-17T12:58:26.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.406+0000 7f2180815640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0cb750 con 0x7f217c0cbc00 2024-02-17T12:58:26.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.407+0000 7f217ad9d640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f217c0cc520 0x7f217c159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54496/0 (socket says 172.21.15.136:54496) 2024-02-17T12:58:26.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.407+0000 7f217ad9d640 1 -- 172.21.15.136:0/4034474705 learned_addr learned my addr 172.21.15.136:0/4034474705 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:26.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.407+0000 7f217a59c640 1 --2- 172.21.15.136:0/4034474705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0cbc00 0x7f217c06acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:26.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.407+0000 7f2179d9b640 1 --2- 172.21.15.136:0/4034474705 >> v2:172.21.15.160:3300/0 conn(0x7f217c0ca4e0 0x7f217c0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:26.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.409+0000 7f217959a640 1 -- 172.21.15.136:0/4034474705 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517307937 0 0) 0x7f217c0cb470 con 0x7f217c0cc520 2024-02-17T12:58:26.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.409+0000 7f217959a640 1 -- 172.21.15.136:0/4034474705 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2168003520 con 0x7f217c0cc520 2024-02-17T12:58:26.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.409+0000 7f217a59c640 1 -- 172.21.15.136:0/4034474705 >> v2:172.21.15.160:3300/0 conn(0x7f217c0ca4e0 msgr2=0x7f217c0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:26.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.409+0000 7f217a59c640 1 --2- 172.21.15.136:0/4034474705 >> v2:172.21.15.160:3300/0 conn(0x7f217c0ca4e0 0x7f217c0cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.409+0000 7f217a59c640 1 -- 172.21.15.136:0/4034474705 >> v1:172.21.15.136:6789/0 conn(0x7f217c0cc520 legacy=0x7f217c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:26.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.409+0000 7f217a59c640 1 -- 172.21.15.136:0/4034474705 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c15d1f0 con 0x7f217c0cbc00 2024-02-17T12:58:26.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.411+0000 7f217a59c640 1 --2- 172.21.15.136:0/4034474705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0cbc00 0x7f217c06acd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2174009d90 tx=0x7f217402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43144db247a1d6db server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:26.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.415+0000 7f217959a640 1 -- 172.21.15.136:0/4034474705 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217402cce0 con 0x7f217c0cbc00 2024-02-17T12:58:26.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.415+0000 7f217959a640 1 -- 172.21.15.136:0/4034474705 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217402ce40 con 0x7f217c0cbc00 2024-02-17T12:58:26.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.415+0000 7f217959a640 1 -- 172.21.15.136:0/4034474705 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174034660 con 0x7f217c0cbc00 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 -- 172.21.15.136:0/4034474705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0cbc00 msgr2=0x7f217c06acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 --2- 172.21.15.136:0/4034474705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0cbc00 0x7f217c06acd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2174009d90 tx=0x7f217402bf30 comp rx=0 tx=0).stop 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 -- 172.21.15.136:0/4034474705 shutdown_connections 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 --2- 172.21.15.136:0/4034474705 >> v2:172.21.15.160:3300/0 conn(0x7f217c0ca4e0 0x7f217c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 --2- 172.21.15.136:0/4034474705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0cbc00 0x7f217c06acd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 -- 172.21.15.136:0/4034474705 >> 172.21.15.136:0/4034474705 conn(0x7f217c0721f0 msgr2=0x7f217c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 -- 172.21.15.136:0/4034474705 shutdown_connections 2024-02-17T12:58:26.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.416+0000 7f2180815640 1 -- 172.21.15.136:0/4034474705 wait complete. 2024-02-17T12:58:26.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.417+0000 7f2180815640 1 Processor -- start 2024-02-17T12:58:26.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.417+0000 7f2180815640 1 -- start start 2024-02-17T12:58:26.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.418+0000 7f2180815640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0ca4e0 0x7f217c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:26.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.418+0000 7f2180815640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217c0cbc00 0x7f217c1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:26.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.418+0000 7f2180815640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 0x7f217c1f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:26.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.418+0000 7f2180815640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c06b820 con 0x7f217c0cc520 2024-02-17T12:58:26.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.418+0000 7f2180815640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1e49e0 con 0x7f217c0cbc00 2024-02-17T12:58:26.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.418+0000 7f2180815640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1e4fe0 con 0x7f217c0ca4e0 2024-02-17T12:58:26.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.419+0000 7f217ad9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 0x7f217c1f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:26.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.419+0000 7f217a59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0ca4e0 0x7f217c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:26.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.419+0000 7f2179d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217c0cbc00 0x7f217c1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:26.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.419+0000 7f217ad9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 0x7f217c1f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54892/0 (socket says 172.21.15.136:54892) 2024-02-17T12:58:26.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.419+0000 7f217ad9d640 1 -- 172.21.15.136:0/2774490397 learned_addr learned my addr 172.21.15.136:0/2774490397 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:26.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.422+0000 7f217ad9d640 1 -- 172.21.15.136:0/2774490397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0ca4e0 msgr2=0x7f217c14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:26.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.422+0000 7f217ad9d640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0ca4e0 0x7f217c14f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.422+0000 7f217ad9d640 1 -- 172.21.15.136:0/2774490397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217c0cbc00 msgr2=0x7f217c1f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:26.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.422+0000 7f217ad9d640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217c0cbc00 0x7f217c1f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:26.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.422+0000 7f217ad9d640 1 -- 172.21.15.136:0/2774490397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009a70 con 0x7f217c0cc520 2024-02-17T12:58:26.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.424+0000 7f217ad9d640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 0x7f217c1f3670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c390 tx=0x7f216c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:26.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.428+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c005ce0 con 0x7f217c0cc520 2024-02-17T12:58:26.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.428+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c005e40 con 0x7f217c0cc520 2024-02-17T12:58:26.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.428+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c007310 con 0x7f217c0cc520 2024-02-17T12:58:26.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.428+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c1e3c50 con 0x7f217c0cc520 2024-02-17T12:58:26.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.428+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c1e33b0 con 0x7f217c0cc520 2024-02-17T12:58:26.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.429+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c1f2e50 con 0x7f217c0cc520 2024-02-17T12:58:26.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.448+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f216c007470 con 0x7f217c0cc520 2024-02-17T12:58:26.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.448+0000 7f2172ffd640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f215c06b860 0x7f215c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:26.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.448+0000 7f217a59c640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f215c06b860 0x7f215c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:26.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.448+0000 7f217a59c640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f215c06b860 0x7f215c06dd20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2174036000 tx=0x7f2174030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:26.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.689+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f216c058270 con 0x7f217c0cc520 2024-02-17T12:58:26.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.689+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f216c054510 con 0x7f217c0cc520 2024-02-17T12:58:26.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:26.897+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f217c1f2e50 con 0x7f217c0cc520 2024-02-17T12:58:27.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.321+0000 7f2172ffd640 1 -- 172.21.15.136:0/2774490397 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f217c1f2e50 con 0x7f217c0cc520 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f215c06b860 msgr2=0x7f215c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f215c06b860 0x7f215c06dd20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2174036000 tx=0x7f2174030000 comp rx=0 tx=0).stop 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 msgr2=0x7f217c1f3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 0x7f217c1f3670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c390 tx=0x7f216c00c850 comp rx=0 tx=0).stop 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 shutdown_connections 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f215c06b860 0x7f215c06dd20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f217c0cc520 0x7f217c1f3670 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217c0cbc00 0x7f217c1f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 --2- 172.21.15.136:0/2774490397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f217c0ca4e0 0x7f217c14f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 >> 172.21.15.136:0/2774490397 conn(0x7f217c0721f0 msgr2=0x7f217c06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 shutdown_connections 2024-02-17T12:58:27.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.323+0000 7f2180815640 1 -- 172.21.15.136:0/2774490397 wait complete. 2024-02-17T12:58:27.324 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-02-17T12:58:27.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-02-17T12:58:27.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.438+0000 7fb7aba3b640 1 Processor -- start 2024-02-17T12:58:27.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.439+0000 7fb7aba3b640 1 -- start start 2024-02-17T12:58:27.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.439+0000 7fb7aba3b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a4151cf0 0x7fb7a406fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:27.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.439+0000 7fb7aba3b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb7a40c9fb0 0x7fb7a40c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:27.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.439+0000 7fb7aba3b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a4072010 con 0x7fb7a40c5de0 2024-02-17T12:58:27.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.439+0000 7fb7aba3b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a4071a90 con 0x7fb7a40c9fb0 2024-02-17T12:58:27.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.439+0000 7fb7aba3b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4071d30 con 0x7fb7a4151cf0 2024-02-17T12:58:27.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.440+0000 7fb7a8fd6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb7a40c9fb0 0x7fb7a40c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:27.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.440+0000 7fb7a97d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a4151cf0 0x7fb7a406fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:27.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.440+0000 7fb7a9fd8640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb7a40c5de0 0x7fb7a415b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54502/0 (socket says 172.21.15.136:54502) 2024-02-17T12:58:27.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.440+0000 7fb7a9fd8640 1 -- 172.21.15.136:0/2489592363 learned_addr learned my addr 172.21.15.136:0/2489592363 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:27.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.443+0000 7fb7a97d7640 1 -- 172.21.15.136:0/2489592363 >> v2:172.21.15.136:3300/0 conn(0x7fb7a40c9fb0 msgr2=0x7fb7a40c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:27.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.443+0000 7fb7a97d7640 1 --2- 172.21.15.136:0/2489592363 >> v2:172.21.15.136:3300/0 conn(0x7fb7a40c9fb0 0x7fb7a40c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.443+0000 7fb7a97d7640 1 -- 172.21.15.136:0/2489592363 >> v1:172.21.15.136:6789/0 conn(0x7fb7a40c5de0 legacy=0x7fb7a415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:27.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.443+0000 7fb7a97d7640 1 -- 172.21.15.136:0/2489592363 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40724c0 con 0x7fb7a4151cf0 2024-02-17T12:58:27.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.445+0000 7fb7a97d7640 1 --2- 172.21.15.136:0/2489592363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a4151cf0 0x7fb7a406fdf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009d90 tx=0x7fb7a002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e60533e92971ec server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:27.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.448+0000 7fb79bfff640 1 -- 172.21.15.136:0/2489592363 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a002cbc0 con 0x7fb7a4151cf0 2024-02-17T12:58:27.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.448+0000 7fb79bfff640 1 -- 172.21.15.136:0/2489592363 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a002cd20 con 0x7fb7a4151cf0 2024-02-17T12:58:27.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.448+0000 7fb79bfff640 1 -- 172.21.15.136:0/2489592363 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0034660 con 0x7fb7a4151cf0 2024-02-17T12:58:27.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2489592363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a4151cf0 msgr2=0x7fb7a406fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2489592363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a4151cf0 0x7fb7a406fdf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009d90 tx=0x7fb7a002be10 comp rx=0 tx=0).stop 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2489592363 shutdown_connections 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2489592363 >> v2:172.21.15.136:3300/0 conn(0x7fb7a40c9fb0 0x7fb7a40c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2489592363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a4151cf0 0x7fb7a406fdf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2489592363 >> 172.21.15.136:0/2489592363 conn(0x7fb7a406bbd0 msgr2=0x7fb7a406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2489592363 shutdown_connections 2024-02-17T12:58:27.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.449+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2489592363 wait complete. 2024-02-17T12:58:27.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.450+0000 7fb7aba3b640 1 Processor -- start 2024-02-17T12:58:27.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.450+0000 7fb7aba3b640 1 -- start start 2024-02-17T12:58:27.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.451+0000 7fb7aba3b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a40c5de0 0x7fb7a4148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:27.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.451+0000 7fb7aba3b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a40c9fb0 0x7fb7a414f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:27.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.451+0000 7fb7aba3b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7a4151cf0 0x7fb7a4149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:27.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.451+0000 7fb7aba3b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4149720 con 0x7fb7a40c9fb0 2024-02-17T12:58:27.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.451+0000 7fb7aba3b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4155e70 con 0x7fb7a4151cf0 2024-02-17T12:58:27.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.451+0000 7fb7aba3b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4146980 con 0x7fb7a40c5de0 2024-02-17T12:58:27.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.452+0000 7fb7a8fd6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a40c9fb0 0x7fb7a414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:27.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.452+0000 7fb7a97d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a40c5de0 0x7fb7a4148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:27.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.452+0000 7fb7a9fd8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7a4151cf0 0x7fb7a4149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:27.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.452+0000 7fb7a8fd6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a40c9fb0 0x7fb7a414f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54920/0 (socket says 172.21.15.136:54920) 2024-02-17T12:58:27.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.452+0000 7fb7a8fd6640 1 -- 172.21.15.136:0/2769549249 learned_addr learned my addr 172.21.15.136:0/2769549249 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:27.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.455+0000 7fb7a97d7640 1 -- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7a4151cf0 msgr2=0x7fb7a4149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:27.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.455+0000 7fb7a97d7640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7a4151cf0 0x7fb7a4149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.455+0000 7fb7a97d7640 1 -- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a40c9fb0 msgr2=0x7fb7a414f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:27.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.455+0000 7fb7a97d7640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a40c9fb0 0x7fb7a414f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:27.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.455+0000 7fb7a97d7640 1 -- 172.21.15.136:0/2769549249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0009a70 con 0x7fb7a40c5de0 2024-02-17T12:58:27.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.458+0000 7fb7a97d7640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a40c5de0 0x7fb7a4148a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0033000 tx=0x7fb7a0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:27.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.461+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0040650 con 0x7fb7a40c5de0 2024-02-17T12:58:27.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.461+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a002ce90 con 0x7fb7a40c5de0 2024-02-17T12:58:27.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.461+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0040a10 con 0x7fb7a40c5de0 2024-02-17T12:58:27.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.461+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a40cbf50 con 0x7fb7a40c5de0 2024-02-17T12:58:27.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.462+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a4146f20 con 0x7fb7a40c5de0 2024-02-17T12:58:27.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.463+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a41520d0 con 0x7fb7a40c5de0 2024-02-17T12:58:27.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.480+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb7a0040b70 con 0x7fb7a40c5de0 2024-02-17T12:58:27.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.481+0000 7fb799ffb640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb78806b890 0x7fb78806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:27.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.481+0000 7fb7a8fd6640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb78806b890 0x7fb78806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:27.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.481+0000 7fb7a8fd6640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb78806b890 0x7fb78806dd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7a414d710 tx=0x7fb794009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:27.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.716+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb7a0053e20 con 0x7fb7a40c5de0 2024-02-17T12:58:27.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.727+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7a0077f90 con 0x7fb7a40c5de0 2024-02-17T12:58:27.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:27.936+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fb7a4067cb0 con 0x7fb7a40c5de0 2024-02-17T12:58:28.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.511+0000 7fb799ffb640 1 -- 172.21.15.136:0/2769549249 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb7a007b650 con 0x7fb7a40c5de0 2024-02-17T12:58:28.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb78806b890 msgr2=0x7fb78806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:28.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb78806b890 0x7fb78806dd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7a414d710 tx=0x7fb794009190 comp rx=0 tx=0).stop 2024-02-17T12:58:28.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a40c5de0 msgr2=0x7fb7a4148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:28.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a40c5de0 0x7fb7a4148a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0033000 tx=0x7fb7a0004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:28.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 shutdown_connections 2024-02-17T12:58:28.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb78806b890 0x7fb78806dd50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7a4151cf0 0x7fb7a4149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a40c9fb0 0x7fb7a414f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 --2- 172.21.15.136:0/2769549249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7a40c5de0 0x7fb7a4148a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 >> 172.21.15.136:0/2769549249 conn(0x7fb7a406bbd0 msgr2=0x7fb7a414dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 shutdown_connections 2024-02-17T12:58:28.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.513+0000 7fb7aba3b640 1 -- 172.21.15.136:0/2769549249 wait complete. 2024-02-17T12:58:28.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T12:58:28.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.629+0000 7f484630f640 1 Processor -- start 2024-02-17T12:58:28.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.629+0000 7f484630f640 1 -- start start 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.630+0000 7f484630f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4840153d30 0x7f4840159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.630+0000 7f484630f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f48400c5e20 0x7f48400c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.630+0000 7f484630f640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48400c67b0 con 0x7f4840154110 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.630+0000 7f484630f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4840070e00 con 0x7f4840153d30 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.630+0000 7f484630f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400710e0 con 0x7f48400c5e20 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.631+0000 7f483ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4840153d30 0x7f4840159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.631+0000 7f483ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4840153d30 0x7f4840159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54922/0 (socket says 172.21.15.136:54922) 2024-02-17T12:58:28.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.631+0000 7f483ffff640 1 -- 172.21.15.136:0/4109739962 learned_addr learned my addr 172.21.15.136:0/4109739962 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:28.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.633+0000 7f483ffff640 1 -- 172.21.15.136:0/4109739962 >> v2:172.21.15.160:3300/0 conn(0x7f48400c5e20 msgr2=0x7f48400c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:28.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.633+0000 7f483ffff640 1 --2- 172.21.15.136:0/4109739962 >> v2:172.21.15.160:3300/0 conn(0x7f48400c5e20 0x7f48400c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.633+0000 7f483ffff640 1 -- 172.21.15.136:0/4109739962 >> v1:172.21.15.160:6789/0 conn(0x7f4840154110 legacy=0x7f484006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:28.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.633+0000 7f483ffff640 1 -- 172.21.15.136:0/4109739962 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400c6a50 con 0x7f4840153d30 2024-02-17T12:58:28.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.635+0000 7f483ffff640 1 --2- 172.21.15.136:0/4109739962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f4840159b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48400c7db0 tx=0x7f483002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cb8952561dadf0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:28.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.638+0000 7f483effd640 1 -- 172.21.15.136:0/4109739962 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830031870 con 0x7f4840153d30 2024-02-17T12:58:28.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.638+0000 7f483effd640 1 -- 172.21.15.136:0/4109739962 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300319d0 con 0x7f4840153d30 2024-02-17T12:58:28.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.638+0000 7f483effd640 1 -- 172.21.15.136:0/4109739962 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830031d60 con 0x7f4840153d30 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 -- 172.21.15.136:0/4109739962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 msgr2=0x7f4840159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 --2- 172.21.15.136:0/4109739962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f4840159b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48400c7db0 tx=0x7f483002b910 comp rx=0 tx=0).stop 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 -- 172.21.15.136:0/4109739962 shutdown_connections 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 --2- 172.21.15.136:0/4109739962 >> v2:172.21.15.160:3300/0 conn(0x7f48400c5e20 0x7f48400c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 --2- 172.21.15.136:0/4109739962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f4840159b90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 -- 172.21.15.136:0/4109739962 >> 172.21.15.136:0/4109739962 conn(0x7f48400c7e90 msgr2=0x7f48400c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 -- 172.21.15.136:0/4109739962 shutdown_connections 2024-02-17T12:58:28.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.639+0000 7f484630f640 1 -- 172.21.15.136:0/4109739962 wait complete. 2024-02-17T12:58:28.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.640+0000 7f484630f640 1 Processor -- start 2024-02-17T12:58:28.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.640+0000 7f484630f640 1 -- start start 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.641+0000 7f484630f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48400c5e20 0x7f48401464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.641+0000 7f484630f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f48400c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.641+0000 7f484630f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48400ca160 0x7f48401f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.641+0000 7f484630f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484014a4a0 con 0x7f4840153d30 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.641+0000 7f484630f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484014f2e0 con 0x7f48400ca160 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.641+0000 7f484630f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484014f920 con 0x7f48400c5e20 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.642+0000 7f483f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f48400c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.642+0000 7f483ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48400c5e20 0x7f48401464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.642+0000 7f483f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f48400c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54930/0 (socket says 172.21.15.136:54930) 2024-02-17T12:58:28.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.642+0000 7f483f7fe640 1 -- 172.21.15.136:0/3465185993 learned_addr learned my addr 172.21.15.136:0/3465185993 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:28.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.646+0000 7f483ffff640 1 -- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48400ca160 msgr2=0x7f48401f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:28.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.646+0000 7f483ffff640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48400ca160 0x7f48401f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.646+0000 7f483ffff640 1 -- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 msgr2=0x7f48400c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:28.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.646+0000 7f483ffff640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f48400c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:28.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.646+0000 7f483ffff640 1 -- 172.21.15.136:0/3465185993 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300094d0 con 0x7f48400c5e20 2024-02-17T12:58:28.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.648+0000 7f483ffff640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48400c5e20 0x7f48401464f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4830033000 tx=0x7f48300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:28.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.652+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483003adf0 con 0x7f48400c5e20 2024-02-17T12:58:28.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.652+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300443f0 con 0x7f48400c5e20 2024-02-17T12:58:28.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.652+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300447a0 con 0x7f48400c5e20 2024-02-17T12:58:28.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.652+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484014a680 con 0x7f48400c5e20 2024-02-17T12:58:28.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.652+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48401f39e0 con 0x7f48400c5e20 2024-02-17T12:58:28.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.653+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484004efc0 con 0x7f48400c5e20 2024-02-17T12:58:28.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.671+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f483004d450 con 0x7f48400c5e20 2024-02-17T12:58:28.662 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.672+0000 7f483cff9640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f482c06b860 0x7f482c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:28.662 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.672+0000 7f483f7fe640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f482c06b860 0x7f482c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:28.662 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.672+0000 7f483f7fe640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f482c06b860 0x7f482c06dd20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f484014c6b0 tx=0x7f48340090e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:28.665 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.674+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f483002d040 con 0x7f48400c5e20 2024-02-17T12:58:28.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:28.924+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48300776f0 con 0x7f48400c5e20 2024-02-17T12:58:29.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.133+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f48401585a0 con 0x7f48400c5e20 2024-02-17T12:58:29.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:58:29.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:58:29.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.648+0000 7f483cff9640 1 -- 172.21.15.136:0/3465185993 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f483007adb0 con 0x7f48400c5e20 2024-02-17T12:58:29.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f482c06b860 msgr2=0x7f482c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:29.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f482c06b860 0x7f482c06dd20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f484014c6b0 tx=0x7f48340090e0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48400c5e20 msgr2=0x7f48401464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48400c5e20 0x7f48401464f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4830033000 tx=0x7f48300046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 shutdown_connections 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f482c06b860 0x7f482c06dd20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48400ca160 0x7f48401f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840153d30 0x7f48400c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 --2- 172.21.15.136:0/3465185993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48400c5e20 0x7f48401464f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 >> 172.21.15.136:0/3465185993 conn(0x7f48400c7e90 msgr2=0x7f48400c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 shutdown_connections 2024-02-17T12:58:29.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.651+0000 7f484630f640 1 -- 172.21.15.136:0/3465185993 wait complete. 2024-02-17T12:58:29.653 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-02-17T12:58:29.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.773+0000 7f79a8565640 1 Processor -- start 2024-02-17T12:58:29.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.773+0000 7f79a8565640 1 -- start start 2024-02-17T12:58:29.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a8565640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f79a014e3b0 0x7f79a00c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:29.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a8565640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f79a00708f0 0x7f79a00c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:29.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a8565640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a006df40 con 0x7f79a00c7940 2024-02-17T12:58:29.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a8565640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a0071b40 con 0x7f79a00708f0 2024-02-17T12:58:29.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a8565640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00c6420 con 0x7f79a014e3b0 2024-02-17T12:58:29.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a6301640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f79a014e3b0 0x7f79a00c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:29.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.774+0000 7f79a6b02640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f79a00708f0 0x7f79a00c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:29.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.775+0000 7f79a5b00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f79a00c7940 0x7f79a0157910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54506/0 (socket says 172.21.15.136:54506) 2024-02-17T12:58:29.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.775+0000 7f79a5b00640 1 -- 172.21.15.136:0/2307846452 learned_addr learned my addr 172.21.15.136:0/2307846452 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:29.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.777+0000 7f79a6301640 1 -- 172.21.15.136:0/2307846452 >> v2:172.21.15.136:3300/0 conn(0x7f79a00708f0 msgr2=0x7f79a00c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:29.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.777+0000 7f79a6301640 1 --2- 172.21.15.136:0/2307846452 >> v2:172.21.15.136:3300/0 conn(0x7f79a00708f0 0x7f79a00c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.777+0000 7f79a6301640 1 -- 172.21.15.136:0/2307846452 >> v1:172.21.15.136:6789/0 conn(0x7f79a00c7940 legacy=0x7f79a0157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:29.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.777+0000 7f79a6301640 1 -- 172.21.15.136:0/2307846452 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a014e790 con 0x7f79a014e3b0 2024-02-17T12:58:29.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.779+0000 7f79a6301640 1 --2- 172.21.15.136:0/2307846452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a014e3b0 0x7f79a00c5d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f79a006f460 tx=0x7f799c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f5e0c2bd16bc333 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:29.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.783+0000 7f79a52ff640 1 -- 172.21.15.136:0/2307846452 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c02e070 con 0x7f79a014e3b0 2024-02-17T12:58:29.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.783+0000 7f79a52ff640 1 -- 172.21.15.136:0/2307846452 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c0315a0 con 0x7f79a014e3b0 2024-02-17T12:58:29.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.783+0000 7f79a52ff640 1 -- 172.21.15.136:0/2307846452 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c031930 con 0x7f79a014e3b0 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 -- 172.21.15.136:0/2307846452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a014e3b0 msgr2=0x7f79a00c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 --2- 172.21.15.136:0/2307846452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a014e3b0 0x7f79a00c5d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f79a006f460 tx=0x7f799c02b840 comp rx=0 tx=0).stop 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 -- 172.21.15.136:0/2307846452 shutdown_connections 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 --2- 172.21.15.136:0/2307846452 >> v2:172.21.15.136:3300/0 conn(0x7f79a00708f0 0x7f79a00c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 --2- 172.21.15.136:0/2307846452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a014e3b0 0x7f79a00c5d90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 -- 172.21.15.136:0/2307846452 >> 172.21.15.136:0/2307846452 conn(0x7f79a00c7e90 msgr2=0x7f79a00c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 -- 172.21.15.136:0/2307846452 shutdown_connections 2024-02-17T12:58:29.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.784+0000 7f79a8565640 1 -- 172.21.15.136:0/2307846452 wait complete. 2024-02-17T12:58:29.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.785+0000 7f79a8565640 1 Processor -- start 2024-02-17T12:58:29.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 -- start start 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00708f0 0x7f79a01f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79a00c7940 0x7f79a014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 0x7f79a0140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0144a70 con 0x7f79a00c7940 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0157760 con 0x7f79a00708f0 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.786+0000 7f79a8565640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01428b0 con 0x7f79a014e3b0 2024-02-17T12:58:29.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.787+0000 7f79a6b02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 0x7f79a0140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:29.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.787+0000 7f79a6b02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 0x7f79a0140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:49360/0 (socket says 172.21.15.136:49360) 2024-02-17T12:58:29.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.787+0000 7f79a6b02640 1 -- 172.21.15.136:0/4103055783 learned_addr learned my addr 172.21.15.136:0/4103055783 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:29.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.788+0000 7f79a6301640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00708f0 0x7f79a01f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:29.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.791+0000 7f79a6b02640 1 -- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00708f0 msgr2=0x7f79a01f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:29.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.791+0000 7f79a6b02640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00708f0 0x7f79a01f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.791+0000 7f79a6b02640 1 -- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79a00c7940 msgr2=0x7f79a014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:29.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.791+0000 7f79a6b02640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79a00c7940 0x7f79a014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:29.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.791+0000 7f79a6b02640 1 -- 172.21.15.136:0/4103055783 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009400 con 0x7f79a014e3b0 2024-02-17T12:58:29.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.793+0000 7f79a6b02640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 0x7f79a0140e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f799800efc0 tx=0x7f799800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:29.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.797+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998014480 con 0x7f79a014e3b0 2024-02-17T12:58:29.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.797+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800f040 con 0x7f79a014e3b0 2024-02-17T12:58:29.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.797+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a0142df0 con 0x7f79a014e3b0 2024-02-17T12:58:29.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.797+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998014820 con 0x7f79a014e3b0 2024-02-17T12:58:29.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.797+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a01583c0 con 0x7f79a014e3b0 2024-02-17T12:58:29.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:29.798+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0071fb0 con 0x7f79a014e3b0 2024-02-17T12:58:30.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.050+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7998014980 con 0x7f79a014e3b0 2024-02-17T12:58:30.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.050+0000 7f7996ffd640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f798406b860 0x7f798406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.050+0000 7f79a6301640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f798406b860 0x7f798406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.051+0000 7f79a6301640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f798406b860 0x7f798406dd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f799c036000 tx=0x7f799c03d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:30.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.053+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f799805a180 con 0x7f79a014e3b0 2024-02-17T12:58:30.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.064+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7998055d20 con 0x7f79a014e3b0 2024-02-17T12:58:30.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.292+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f79a0071fb0 con 0x7f79a014e3b0 2024-02-17T12:58:30.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.733+0000 7f7996ffd640 1 -- 172.21.15.136:0/4103055783 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f79a0071fb0 con 0x7f79a014e3b0 2024-02-17T12:58:30.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f798406b860 msgr2=0x7f798406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:30.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f798406b860 0x7f798406dd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f799c036000 tx=0x7f799c03d040 comp rx=0 tx=0).stop 2024-02-17T12:58:30.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 msgr2=0x7f79a0140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:30.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 0x7f79a0140e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f799800efc0 tx=0x7f799800c490 comp rx=0 tx=0).stop 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 shutdown_connections 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f798406b860 0x7f798406dd20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a014e3b0 0x7f79a0140e50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79a00c7940 0x7f79a014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 --2- 172.21.15.136:0/4103055783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00708f0 0x7f79a01f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 >> 172.21.15.136:0/4103055783 conn(0x7f79a00c7e90 msgr2=0x7f79a014cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 shutdown_connections 2024-02-17T12:58:30.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.735+0000 7f79a8565640 1 -- 172.21.15.136:0/4103055783 wait complete. 2024-02-17T12:58:30.736 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T12:58:30.737 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.851+0000 7f3c720df640 1 Processor -- start 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.851+0000 7f3c720df640 1 -- start start 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c720df640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cbc00 0x7f3c6c06acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c720df640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3c6c0ca4e0 0x7f3c6c0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c720df640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c0cb470 con 0x7f3c6c0cc520 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c720df640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c0cc930 con 0x7f3c6c0ca4e0 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c720df640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0cb750 con 0x7f3c6c0cbc00 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c6bfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3c6c0cc520 0x7f3c6c159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54520/0 (socket says 172.21.15.136:54520) 2024-02-17T12:58:30.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c6bfff640 1 -- 172.21.15.136:0/2192760463 learned_addr learned my addr 172.21.15.136:0/2192760463 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:30.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c6affd640 1 --2- 172.21.15.136:0/2192760463 >> v2:172.21.15.160:3300/0 conn(0x7f3c6c0ca4e0 0x7f3c6c0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.852+0000 7f3c6b7fe640 1 --2- 172.21.15.136:0/2192760463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cbc00 0x7f3c6c06acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.855+0000 7f3c6a7fc640 1 -- 172.21.15.136:0/2192760463 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352153196 0 0) 0x7f3c6c0cb470 con 0x7f3c6c0cc520 2024-02-17T12:58:30.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.855+0000 7f3c6b7fe640 1 -- 172.21.15.136:0/2192760463 >> v2:172.21.15.160:3300/0 conn(0x7f3c6c0ca4e0 msgr2=0x7f3c6c0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:30.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.855+0000 7f3c6b7fe640 1 --2- 172.21.15.136:0/2192760463 >> v2:172.21.15.160:3300/0 conn(0x7f3c6c0ca4e0 0x7f3c6c0cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.855+0000 7f3c6b7fe640 1 -- 172.21.15.136:0/2192760463 >> v1:172.21.15.136:6789/0 conn(0x7f3c6c0cc520 legacy=0x7f3c6c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:30.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.855+0000 7f3c6b7fe640 1 -- 172.21.15.136:0/2192760463 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c15d1f0 con 0x7f3c6c0cbc00 2024-02-17T12:58:30.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.857+0000 7f3c6b7fe640 1 --2- 172.21.15.136:0/2192760463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cbc00 0x7f3c6c06acd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009d90 tx=0x7f3c5c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29971b14d889ff62 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:30.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.860+0000 7f3c6a7fc640 1 -- 172.21.15.136:0/2192760463 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c02cce0 con 0x7f3c6c0cbc00 2024-02-17T12:58:30.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.860+0000 7f3c6a7fc640 1 -- 172.21.15.136:0/2192760463 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c02ce40 con 0x7f3c6c0cbc00 2024-02-17T12:58:30.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.860+0000 7f3c6a7fc640 1 -- 172.21.15.136:0/2192760463 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c034660 con 0x7f3c6c0cbc00 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.861+0000 7f3c720df640 1 -- 172.21.15.136:0/2192760463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cbc00 msgr2=0x7f3c6c06acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.861+0000 7f3c720df640 1 --2- 172.21.15.136:0/2192760463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cbc00 0x7f3c6c06acd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009d90 tx=0x7f3c5c02bf30 comp rx=0 tx=0).stop 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.861+0000 7f3c720df640 1 -- 172.21.15.136:0/2192760463 shutdown_connections 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.861+0000 7f3c720df640 1 --2- 172.21.15.136:0/2192760463 >> v2:172.21.15.160:3300/0 conn(0x7f3c6c0ca4e0 0x7f3c6c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.861+0000 7f3c720df640 1 --2- 172.21.15.136:0/2192760463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cbc00 0x7f3c6c06acd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.861+0000 7f3c720df640 1 -- 172.21.15.136:0/2192760463 >> 172.21.15.136:0/2192760463 conn(0x7f3c6c0721f0 msgr2=0x7f3c6c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:30.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.862+0000 7f3c720df640 1 -- 172.21.15.136:0/2192760463 shutdown_connections 2024-02-17T12:58:30.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.862+0000 7f3c720df640 1 -- 172.21.15.136:0/2192760463 wait complete. 2024-02-17T12:58:30.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.863+0000 7f3c720df640 1 Processor -- start 2024-02-17T12:58:30.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.863+0000 7f3c720df640 1 -- start start 2024-02-17T12:58:30.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.863+0000 7f3c720df640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6c0ca4e0 0x7f3c6c1e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.863+0000 7f3c720df640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c6c0cbc00 0x7f3c6c1efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.863+0000 7f3c720df640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 0x7f3c6c14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c720df640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1f2b30 con 0x7f3c6c0cbc00 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c720df640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1f2dd0 con 0x7f3c6c0ca4e0 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c720df640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1f3090 con 0x7f3c6c0cc520 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 0x7f3c6c14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c6affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c6c0cbc00 0x7f3c6c1efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c6b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6c0ca4e0 0x7f3c6c1e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 0x7f3c6c14d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:49380/0 (socket says 172.21.15.136:49380) 2024-02-17T12:58:30.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.864+0000 7f3c6bfff640 1 -- 172.21.15.136:0/3929866509 learned_addr learned my addr 172.21.15.136:0/3929866509 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:30.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.867+0000 7f3c6bfff640 1 -- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6c0ca4e0 msgr2=0x7f3c6c1e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:30.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.867+0000 7f3c6bfff640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6c0ca4e0 0x7f3c6c1e6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.867+0000 7f3c6bfff640 1 -- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c6c0cbc00 msgr2=0x7f3c6c1efe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:30.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.867+0000 7f3c6bfff640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c6c0cbc00 0x7f3c6c1efe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:30.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.867+0000 7f3c6bfff640 1 -- 172.21.15.136:0/3929866509 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009a70 con 0x7f3c6c0cc520 2024-02-17T12:58:30.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.870+0000 7f3c6bfff640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 0x7f3c6c14d640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c410 tx=0x7f3c6400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:30.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.873+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c640074e0 con 0x7f3c6c0cc520 2024-02-17T12:58:30.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.873+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c64007640 con 0x7f3c6c0cc520 2024-02-17T12:58:30.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.873+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64004a20 con 0x7f3c6c0cc520 2024-02-17T12:58:30.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.873+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c1f3370 con 0x7f3c6c0cc520 2024-02-17T12:58:30.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.873+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c1f3930 con 0x7f3c6c0cc520 2024-02-17T12:58:30.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.874+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c04efc0 con 0x7f3c6c0cc520 2024-02-17T12:58:30.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.894+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3c64004b80 con 0x7f3c6c0cc520 2024-02-17T12:58:30.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.894+0000 7f3c63fff640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3c4c06b890 0x7f3c4c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:30.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.894+0000 7f3c6b7fe640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3c4c06b890 0x7f3c4c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:30.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.895+0000 7f3c6b7fe640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3c4c06b890 0x7f3c4c06dd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c036000 tx=0x7f3c5c030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:30.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:30.895+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3c64058c60 con 0x7f3c6c0cc520 2024-02-17T12:58:31.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.146+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c64054f00 con 0x7f3c6c0cc520 2024-02-17T12:58:31.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.359+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c6c0caea0 con 0x7f3c6c0cc520 2024-02-17T12:58:31.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.386+0000 7f3c63fff640 1 -- 172.21.15.136:0/3929866509 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6568 (secure 0 0 0) 0x7f3c640585c0 con 0x7f3c6c0cc520 2024-02-17T12:58:31.377 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:31.377 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:30.674281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4288,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:58:31.377 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 13 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3c4c06b890 msgr2=0x7f3c4c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3c4c06b890 0x7f3c4c06dd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c036000 tx=0x7f3c5c030000 comp rx=0 tx=0).stop 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 msgr2=0x7f3c6c14d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 0x7f3c6c14d640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c410 tx=0x7f3c6400c8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 shutdown_connections 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3c4c06b890 0x7f3c4c06dd50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6c0cc520 0x7f3c6c14d640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c6c0cbc00 0x7f3c6c1efe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 --2- 172.21.15.136:0/3929866509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6c0ca4e0 0x7f3c6c1e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.388+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 >> 172.21.15.136:0/3929866509 conn(0x7f3c6c0721f0 msgr2=0x7f3c6c152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:31.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.389+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 shutdown_connections 2024-02-17T12:58:31.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.389+0000 7f3c720df640 1 -- 172.21.15.136:0/3929866509 wait complete. 2024-02-17T12:58:31.391 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:31.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.502+0000 7f2da2e64640 1 Processor -- start 2024-02-17T12:58:31.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.502+0000 7f2da2e64640 1 -- start start 2024-02-17T12:58:31.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2da2e64640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 0x7f2d9c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2da2e64640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2d9c06b420 0x7f2d9c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2da2e64640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c15d280 con 0x7f2d9c153f90 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2da2e64640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c06c3b0 con 0x7f2d9c06b420 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2da2e64640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c06bdf0 con 0x7f2d9c15dd20 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2da1401640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2d9c06b420 0x7f2d9c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.503+0000 7f2d9bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 0x7f2d9c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.504+0000 7f2d9bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 0x7f2d9c0c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39678/0 (socket says 172.21.15.136:39678) 2024-02-17T12:58:31.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.504+0000 7f2da1401640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2d9c06b420 0x7f2d9c0ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:58984/0 (socket says 172.21.15.136:58984) 2024-02-17T12:58:31.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.504+0000 7f2d9bfff640 1 -- 172.21.15.136:0/2983449193 learned_addr learned my addr 172.21.15.136:0/2983449193 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:31.496 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.506+0000 7f2d9bfff640 1 -- 172.21.15.136:0/2983449193 >> v2:172.21.15.160:3300/0 conn(0x7f2d9c06b420 msgr2=0x7f2d9c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:31.496 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.506+0000 7f2d9bfff640 1 --2- 172.21.15.136:0/2983449193 >> v2:172.21.15.160:3300/0 conn(0x7f2d9c06b420 0x7f2d9c0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.496 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.506+0000 7f2d9bfff640 1 -- 172.21.15.136:0/2983449193 >> v1:172.21.15.160:6789/0 conn(0x7f2d9c153f90 legacy=0x7f2d9c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:31.496 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.506+0000 7f2d9bfff640 1 -- 172.21.15.136:0/2983449193 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c06c0d0 con 0x7f2d9c15dd20 2024-02-17T12:58:31.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.508+0000 7f2d9bfff640 1 --2- 172.21.15.136:0/2983449193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 0x7f2d9c0c4340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009870 tx=0x7f2d8802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17eca64a83808b3a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:31.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.511+0000 7f2d9b7fe640 1 -- 172.21.15.136:0/2983449193 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88031640 con 0x7f2d9c15dd20 2024-02-17T12:58:31.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2d9b7fe640 1 -- 172.21.15.136:0/2983449193 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d880317a0 con 0x7f2d9c15dd20 2024-02-17T12:58:31.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2d9b7fe640 1 -- 172.21.15.136:0/2983449193 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88031b30 con 0x7f2d9c15dd20 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 -- 172.21.15.136:0/2983449193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 msgr2=0x7f2d9c0c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 --2- 172.21.15.136:0/2983449193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 0x7f2d9c0c4340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009870 tx=0x7f2d8802b8f0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 -- 172.21.15.136:0/2983449193 shutdown_connections 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 --2- 172.21.15.136:0/2983449193 >> v2:172.21.15.160:3300/0 conn(0x7f2d9c06b420 0x7f2d9c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 --2- 172.21.15.136:0/2983449193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c15dd20 0x7f2d9c0c4340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 -- 172.21.15.136:0/2983449193 >> 172.21.15.136:0/2983449193 conn(0x7f2d9c0723d0 msgr2=0x7f2d9c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 -- 172.21.15.136:0/2983449193 shutdown_connections 2024-02-17T12:58:31.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.512+0000 7f2da2e64640 1 -- 172.21.15.136:0/2983449193 wait complete. 2024-02-17T12:58:31.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.513+0000 7f2da2e64640 1 Processor -- start 2024-02-17T12:58:31.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 -- start start 2024-02-17T12:58:31.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c06b420 0x7f2d9c1e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:31.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 0x7f2d9c1ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:31.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d9c15dd20 0x7f2d9c140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:31.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c146c80 con 0x7f2d9c153f90 2024-02-17T12:58:31.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c1f2e90 con 0x7f2d9c15dd20 2024-02-17T12:58:31.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.514+0000 7f2da2e64640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c1f3170 con 0x7f2d9c06b420 2024-02-17T12:58:31.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.515+0000 7f2d9bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 0x7f2d9c1ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:31.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.515+0000 7f2da0c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c06b420 0x7f2d9c1e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:31.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.515+0000 7f2da1401640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d9c15dd20 0x7f2d9c140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:31.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.515+0000 7f2d9bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 0x7f2d9c1ef880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50150/0 (socket says 172.21.15.136:50150) 2024-02-17T12:58:31.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.515+0000 7f2d9bfff640 1 -- 172.21.15.136:0/3785181684 learned_addr learned my addr 172.21.15.136:0/3785181684 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:31.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.518+0000 7f2d9bfff640 1 -- 172.21.15.136:0/3785181684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c06b420 msgr2=0x7f2d9c1e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:31.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.518+0000 7f2d9bfff640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c06b420 0x7f2d9c1e63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.518+0000 7f2d9bfff640 1 -- 172.21.15.136:0/3785181684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d9c15dd20 msgr2=0x7f2d9c140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:31.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.518+0000 7f2d9bfff640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d9c15dd20 0x7f2d9c140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:31.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.518+0000 7f2d9bfff640 1 -- 172.21.15.136:0/3785181684 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880094d0 con 0x7f2d9c153f90 2024-02-17T12:58:31.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.521+0000 7f2d9bfff640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 0x7f2d9c1ef880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000c00 tx=0x7f2d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:31.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.524+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8803a930 con 0x7f2d9c153f90 2024-02-17T12:58:31.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.524+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8803aa90 con 0x7f2d9c153f90 2024-02-17T12:58:31.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.524+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8803ae40 con 0x7f2d9c153f90 2024-02-17T12:58:31.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.524+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c1f3450 con 0x7f2d9c153f90 2024-02-17T12:58:31.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.525+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0c5c70 con 0x7f2d9c153f90 2024-02-17T12:58:31.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.526+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c067e00 con 0x7f2d9c153f90 2024-02-17T12:58:31.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.779+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2d8802f050 con 0x7f2d9c153f90 2024-02-17T12:58:31.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.779+0000 7f2d997fa640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2d8006b840 0x7f2d8006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:31.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.780+0000 7f2da0c00640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2d8006b840 0x7f2d8006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:31.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.780+0000 7f2da0c00640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2d8006b840 0x7f2d8006dd00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d90005660 tx=0x7f2d90003d90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:31.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.802+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2d8807aad0 con 0x7f2d9c153f90 2024-02-17T12:58:31.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.802+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d88076d70 con 0x7f2d9c153f90 2024-02-17T12:58:31.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:31.980+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d9c1f32b0 con 0x7f2d9c153f90 2024-02-17T12:58:32.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.020+0000 7f2d997fa640 1 -- 172.21.15.136:0/3785181684 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f2d9c1f32b0 con 0x7f2d9c153f90 2024-02-17T12:58:32.012 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:32.012 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:32.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.023+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2d8006b840 msgr2=0x7f2d8006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.023+0000 7f2da2e64640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2d8006b840 0x7f2d8006dd00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d90005660 tx=0x7f2d90003d90 comp rx=0 tx=0).stop 2024-02-17T12:58:32.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.023+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 msgr2=0x7f2d9c1ef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.023+0000 7f2da2e64640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 0x7f2d9c1ef880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d88000c00 tx=0x7f2d880046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 shutdown_connections 2024-02-17T12:58:32.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2d8006b840 0x7f2d8006dd00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d9c15dd20 0x7f2d9c140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d9c153f90 0x7f2d9c1ef880 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 --2- 172.21.15.136:0/3785181684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d9c06b420 0x7f2d9c1e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 >> 172.21.15.136:0/3785181684 conn(0x7f2d9c0723d0 msgr2=0x7f2d9c0cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:32.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 shutdown_connections 2024-02-17T12:58:32.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.024+0000 7f2da2e64640 1 -- 172.21.15.136:0/3785181684 wait complete. 2024-02-17T12:58:32.029 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:58:32.029 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:32.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.143+0000 7f7a309bc640 1 Processor -- start 2024-02-17T12:58:32.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.143+0000 7f7a309bc640 1 -- start start 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a309bc640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a2c0cbc00 0x7f7a2c06acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a309bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c1648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a309bc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0cb470 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a309bc640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0cb750 con 0x7f7a2c0cbc00 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a309bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c15d1f0 con 0x7f7a2c1624d0 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a2ad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c1648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.144+0000 7f7a2a59c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a2c0cbc00 0x7f7a2c06acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.145+0000 7f7a2ad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c1648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39682/0 (socket says 172.21.15.136:39682) 2024-02-17T12:58:32.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.145+0000 7f7a2ad9d640 1 -- 172.21.15.136:0/1227044501 learned_addr learned my addr 172.21.15.136:0/1227044501 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.147+0000 7f7a2ad9d640 1 -- 172.21.15.136:0/1227044501 >> v2:172.21.15.160:3300/0 conn(0x7f7a2c0cbc00 msgr2=0x7f7a2c06acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.147+0000 7f7a2ad9d640 1 --2- 172.21.15.136:0/1227044501 >> v2:172.21.15.160:3300/0 conn(0x7f7a2c0cbc00 0x7f7a2c06acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.147+0000 7f7a2ad9d640 1 -- 172.21.15.136:0/1227044501 >> v1:172.21.15.160:6789/0 conn(0x7f7a2c0ca4e0 legacy=0x7f7a2c0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.147+0000 7f7a2ad9d640 1 -- 172.21.15.136:0/1227044501 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c15d4d0 con 0x7f7a2c1624d0 2024-02-17T12:58:32.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.150+0000 7f7a2ad9d640 1 --2- 172.21.15.136:0/1227044501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c1648c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009e50 tx=0x7f7a2402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f1468f64d9dd278 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:32.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.154+0000 7f7a2959a640 1 -- 172.21.15.136:0/1227044501 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2402cb00 con 0x7f7a2c1624d0 2024-02-17T12:58:32.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a2959a640 1 -- 172.21.15.136:0/1227044501 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2402cc60 con 0x7f7a2c1624d0 2024-02-17T12:58:32.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a2959a640 1 -- 172.21.15.136:0/1227044501 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240343f0 con 0x7f7a2c1624d0 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 -- 172.21.15.136:0/1227044501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 msgr2=0x7f7a2c1648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 --2- 172.21.15.136:0/1227044501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c1648c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009e50 tx=0x7f7a2402bf60 comp rx=0 tx=0).stop 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 -- 172.21.15.136:0/1227044501 shutdown_connections 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 --2- 172.21.15.136:0/1227044501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c1648c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 --2- 172.21.15.136:0/1227044501 >> v2:172.21.15.160:3300/0 conn(0x7f7a2c0cbc00 0x7f7a2c06acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 -- 172.21.15.136:0/1227044501 >> 172.21.15.136:0/1227044501 conn(0x7f7a2c0721f0 msgr2=0x7f7a2c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 -- 172.21.15.136:0/1227044501 shutdown_connections 2024-02-17T12:58:32.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.155+0000 7f7a309bc640 1 -- 172.21.15.136:0/1227044501 wait complete. 2024-02-17T12:58:32.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 Processor -- start 2024-02-17T12:58:32.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 -- start start 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 0x7f7a2c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c0cbc00 0x7f7a2c1f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0c60f0 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1efaa0 con 0x7f7a2c0cbc00 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.157+0000 7f7a309bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0c5e10 con 0x7f7a2c1624d0 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.158+0000 7f7a2a59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 0x7f7a2c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.158+0000 7f7a2ad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.158+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c0cbc00 0x7f7a2c1f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.158+0000 7f7a2ad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c0c1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39686/0 (socket says 172.21.15.136:39686) 2024-02-17T12:58:32.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.158+0000 7f7a2a59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 0x7f7a2c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50154/0 (socket says 172.21.15.136:50154) 2024-02-17T12:58:32.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.158+0000 7f7a2ad9d640 1 -- 172.21.15.136:0/3753204765 learned_addr learned my addr 172.21.15.136:0/3753204765 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:32.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.162+0000 7f7a2a59c640 1 -- 172.21.15.136:0/3753204765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 msgr2=0x7f7a2c0c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.162+0000 7f7a2a59c640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c0c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.162+0000 7f7a2a59c640 1 -- 172.21.15.136:0/3753204765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c0cbc00 msgr2=0x7f7a2c1f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.162+0000 7f7a2a59c640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c0cbc00 0x7f7a2c1f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.162+0000 7f7a2a59c640 1 -- 172.21.15.136:0/3753204765 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24009b30 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.165+0000 7f7a2a59c640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 0x7f7a2c0cd570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e850 tx=0x7f7a2000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.169+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a200095b0 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.169+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2000c940 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.169+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c146b20 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.169+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2000ccd0 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.169+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c1f0040 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.170+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c04efc0 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.193+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7a20013470 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.193+0000 7f7a1affd640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7a0c06b860 0x7f7a0c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.194+0000 7f7a29d9b640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7a0c06b860 0x7f7a0c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.194+0000 7f7a29d9b640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7a0c06b860 0x7f7a0c06dd20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0ccc00 tx=0x7f7a1c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:32.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.444+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7a2000ce30 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.444+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a200555c0 con 0x7f7a2c0ca4e0 2024-02-17T12:58:32.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.617+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a2c15dfb0 con 0x7f7a0c06b860 2024-02-17T12:58:32.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.626+0000 7f7a1affd640 1 -- 172.21.15.136:0/3753204765 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345197 (secure 0 0 0) 0x7f7a1c001490 con 0x7f7a0c06b860 2024-02-17T12:58:32.622 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:32.624 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:32.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7a0c06b860 msgr2=0x7f7a0c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7a0c06b860 0x7f7a0c06dd20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0ccc00 tx=0x7f7a1c009040 comp rx=0 tx=0).stop 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 msgr2=0x7f7a2c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 0x7f7a2c0cd570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e850 tx=0x7f7a2000ed10 comp rx=0 tx=0).stop 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 shutdown_connections 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7a0c06b860 0x7f7a0c06dd20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a2c1624d0 0x7f7a2c0c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c0cbc00 0x7f7a2c1f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 --2- 172.21.15.136:0/3753204765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a2c0ca4e0 0x7f7a2c0cd570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 >> 172.21.15.136:0/3753204765 conn(0x7f7a2c0721f0 msgr2=0x7f7a2c0cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 shutdown_connections 2024-02-17T12:58:32.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.630+0000 7f7a309bc640 1 -- 172.21.15.136:0/3753204765 wait complete. 2024-02-17T12:58:32.631 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-02-17T12:58:31.989577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595098,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219416,"kb_used_data":3224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755304,"statfs":{"total":773094113280,"available":772869431296,"internally_reserved":0,"allocated":3301376,"data_stored":1992912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002964"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435958+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:03.435958+0000","last_peered":"2024-02-17T12:58:03.435958+0000","last_clean":"2024-02-17T12:58:03.435958+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:03.435958+0000","last_undegraded":"2024-02-17T12:58:03.435958+0000","last_fullsized":"2024-02-17T12:58:03.435958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499978+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:03.499978+0000","last_peered":"2024-02-17T12:58:03.499978+0000","last_clean":"2024-02-17T12:58:03.499978+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:03.499978+0000","last_undegraded":"2024-02-17T12:58:03.499978+0000","last_fullsized":"2024-02-17T12:58:03.499978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498917+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:03.498917+0000","last_peered":"2024-02-17T12:58:03.498917+0000","last_clean":"2024-02-17T12:58:03.498917+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:03.498917+0000","last_undegraded":"2024-02-17T12:58:03.498917+0000","last_fullsized":"2024-02-17T12:58:03.498917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500086+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:03.500086+0000","last_peered":"2024-02-17T12:58:03.500086+0000","last_clean":"2024-02-17T12:58:03.500086+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:03.500086+0000","last_undegraded":"2024-02-17T12:58:03.500086+0000","last_fullsized":"2024-02-17T12:58:03.500086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499709+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:03.499709+0000","last_peered":"2024-02-17T12:58:03.499709+0000","last_clean":"2024-02-17T12:58:03.499709+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:03.499709+0000","last_undegraded":"2024-02-17T12:58:03.499709+0000","last_fullsized":"2024-02-17T12:58:03.499709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437354+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:03.437354+0000","last_peered":"2024-02-17T12:58:03.437354+0000","last_clean":"2024-02-17T12:58:03.437354+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:03.437354+0000","last_undegraded":"2024-02-17T12:58:03.437354+0000","last_fullsized":"2024-02-17T12:58:03.437354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500781+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:03.500781+0000","last_peered":"2024-02-17T12:58:03.500781+0000","last_clean":"2024-02-17T12:58:03.500781+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:03.500781+0000","last_undegraded":"2024-02-17T12:58:03.500781+0000","last_fullsized":"2024-02-17T12:58:03.500781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500058+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:03.500058+0000","last_peered":"2024-02-17T12:58:03.500058+0000","last_clean":"2024-02-17T12:58:03.500058+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:03.500058+0000","last_undegraded":"2024-02-17T12:58:03.500058+0000","last_fullsized":"2024-02-17T12:58:03.500058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437167+0000","last_change":"2024-02-17T12:58:02.530056+0000","last_active":"2024-02-17T12:58:03.437167+0000","last_peered":"2024-02-17T12:58:03.437167+0000","last_clean":"2024-02-17T12:58:03.437167+0000","last_became_active":"2024-02-17T12:58:02.529672+0000","last_became_peered":"2024-02-17T12:58:02.529672+0000","last_unstale":"2024-02-17T12:58:03.437167+0000","last_undegraded":"2024-02-17T12:58:03.437167+0000","last_fullsized":"2024-02-17T12:58:03.437167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501030+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:03.501030+0000","last_peered":"2024-02-17T12:58:03.501030+0000","last_clean":"2024-02-17T12:58:03.501030+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:03.501030+0000","last_undegraded":"2024-02-17T12:58:03.501030+0000","last_fullsized":"2024-02-17T12:58:03.501030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501815+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:03.501815+0000","last_peered":"2024-02-17T12:58:03.501815+0000","last_clean":"2024-02-17T12:58:03.501815+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:03.501815+0000","last_undegraded":"2024-02-17T12:58:03.501815+0000","last_fullsized":"2024-02-17T12:58:03.501815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436985+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:03.436985+0000","last_peered":"2024-02-17T12:58:03.436985+0000","last_clean":"2024-02-17T12:58:03.436985+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:03.436985+0000","last_undegraded":"2024-02-17T12:58:03.436985+0000","last_fullsized":"2024-02-17T12:58:03.436985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501021+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:03.501021+0000","last_peered":"2024-02-17T12:58:03.501021+0000","last_clean":"2024-02-17T12:58:03.501021+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:03.501021+0000","last_undegraded":"2024-02-17T12:58:03.501021+0000","last_fullsized":"2024-02-17T12:58:03.501021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501474+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:03.501474+0000","last_peered":"2024-02-17T12:58:03.501474+0000","last_clean":"2024-02-17T12:58:03.501474+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:03.501474+0000","last_undegraded":"2024-02-17T12:58:03.501474+0000","last_fullsized":"2024-02-17T12:58:03.501474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501650+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:03.501650+0000","last_peered":"2024-02-17T12:58:03.501650+0000","last_clean":"2024-02-17T12:58:03.501650+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:03.501650+0000","last_undegraded":"2024-02-17T12:58:03.501650+0000","last_fullsized":"2024-02-17T12:58:03.501650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499773+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:03.499773+0000","last_peered":"2024-02-17T12:58:03.499773+0000","last_clean":"2024-02-17T12:58:03.499773+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:03.499773+0000","last_undegraded":"2024-02-17T12:58:03.499773+0000","last_fullsized":"2024-02-17T12:58:03.499773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484009+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:03.484009+0000","last_peered":"2024-02-17T12:58:03.484009+0000","last_clean":"2024-02-17T12:58:03.484009+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:03.484009+0000","last_undegraded":"2024-02-17T12:58:03.484009+0000","last_fullsized":"2024-02-17T12:58:03.484009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499965+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:03.499965+0000","last_peered":"2024-02-17T12:58:03.499965+0000","last_clean":"2024-02-17T12:58:03.499965+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:03.499965+0000","last_undegraded":"2024-02-17T12:58:03.499965+0000","last_fullsized":"2024-02-17T12:58:03.499965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435201+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:03.435201+0000","last_peered":"2024-02-17T12:58:03.435201+0000","last_clean":"2024-02-17T12:58:03.435201+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:03.435201+0000","last_undegraded":"2024-02-17T12:58:03.435201+0000","last_fullsized":"2024-02-17T12:58:03.435201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:29.720679+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:29.720679+0000","last_peered":"2024-02-17T12:58:29.720679+0000","last_clean":"2024-02-17T12:58:29.720679+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:29.720679+0000","last_undegraded":"2024-02-17T12:58:29.720679+0000","last_fullsized":"2024-02-17T12:58:29.720679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499608+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:03.499608+0000","last_peered":"2024-02-17T12:58:03.499608+0000","last_clean":"2024-02-17T12:58:03.499608+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:03.499608+0000","last_undegraded":"2024-02-17T12:58:03.499608+0000","last_fullsized":"2024-02-17T12:58:03.499608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501760+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:03.501760+0000","last_peered":"2024-02-17T12:58:03.501760+0000","last_clean":"2024-02-17T12:58:03.501760+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:03.501760+0000","last_undegraded":"2024-02-17T12:58:03.501760+0000","last_fullsized":"2024-02-17T12:58:03.501760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499292+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:03.499292+0000","last_peered":"2024-02-17T12:58:03.499292+0000","last_clean":"2024-02-17T12:58:03.499292+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:03.499292+0000","last_undegraded":"2024-02-17T12:58:03.499292+0000","last_fullsized":"2024-02-17T12:58:03.499292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437414+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:03.437414+0000","last_peered":"2024-02-17T12:58:03.437414+0000","last_clean":"2024-02-17T12:58:03.437414+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:03.437414+0000","last_undegraded":"2024-02-17T12:58:03.437414+0000","last_fullsized":"2024-02-17T12:58:03.437414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435676+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:03.435676+0000","last_peered":"2024-02-17T12:58:03.435676+0000","last_clean":"2024-02-17T12:58:03.435676+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:03.435676+0000","last_undegraded":"2024-02-17T12:58:03.435676+0000","last_fullsized":"2024-02-17T12:58:03.435676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502023+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:03.502023+0000","last_peered":"2024-02-17T12:58:03.502023+0000","last_clean":"2024-02-17T12:58:03.502023+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:03.502023+0000","last_undegraded":"2024-02-17T12:58:03.502023+0000","last_fullsized":"2024-02-17T12:58:03.502023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436919+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:03.436919+0000","last_peered":"2024-02-17T12:58:03.436919+0000","last_clean":"2024-02-17T12:58:03.436919+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:03.436919+0000","last_undegraded":"2024-02-17T12:58:03.436919+0000","last_fullsized":"2024-02-17T12:58:03.436919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435894+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:03.435894+0000","last_peered":"2024-02-17T12:58:03.435894+0000","last_clean":"2024-02-17T12:58:03.435894+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:03.435894+0000","last_undegraded":"2024-02-17T12:58:03.435894+0000","last_fullsized":"2024-02-17T12:58:03.435894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435863+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:03.435863+0000","last_peered":"2024-02-17T12:58:03.435863+0000","last_clean":"2024-02-17T12:58:03.435863+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:03.435863+0000","last_undegraded":"2024-02-17T12:58:03.435863+0000","last_fullsized":"2024-02-17T12:58:03.435863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435266+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:03.435266+0000","last_peered":"2024-02-17T12:58:03.435266+0000","last_clean":"2024-02-17T12:58:03.435266+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:03.435266+0000","last_undegraded":"2024-02-17T12:58:03.435266+0000","last_fullsized":"2024-02-17T12:58:03.435266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484291+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:03.484291+0000","last_peered":"2024-02-17T12:58:03.484291+0000","last_clean":"2024-02-17T12:58:03.484291+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:03.484291+0000","last_undegraded":"2024-02-17T12:58:03.484291+0000","last_fullsized":"2024-02-17T12:58:03.484291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502079+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:03.502079+0000","last_peered":"2024-02-17T12:58:03.502079+0000","last_clean":"2024-02-17T12:58:03.502079+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:03.502079+0000","last_undegraded":"2024-02-17T12:58:03.502079+0000","last_fullsized":"2024-02-17T12:58:03.502079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483806+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:03.483806+0000","last_peered":"2024-02-17T12:58:03.483806+0000","last_clean":"2024-02-17T12:58:03.483806+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:03.483806+0000","last_undegraded":"2024-02-17T12:58:03.483806+0000","last_fullsized":"2024-02-17T12:58:03.483806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437184+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:03.437184+0000","last_peered":"2024-02-17T12:58:03.437184+0000","last_clean":"2024-02-17T12:58:03.437184+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:03.437184+0000","last_undegraded":"2024-02-17T12:58:03.437184+0000","last_fullsized":"2024-02-17T12:58:03.437184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499359+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:03.499359+0000","last_peered":"2024-02-17T12:58:03.499359+0000","last_clean":"2024-02-17T12:58:03.499359+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:03.499359+0000","last_undegraded":"2024-02-17T12:58:03.499359+0000","last_fullsized":"2024-02-17T12:58:03.499359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483778+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:03.483778+0000","last_peered":"2024-02-17T12:58:03.483778+0000","last_clean":"2024-02-17T12:58:03.483778+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:03.483778+0000","last_undegraded":"2024-02-17T12:58:03.483778+0000","last_fullsized":"2024-02-17T12:58:03.483778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499666+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:03.499666+0000","last_peered":"2024-02-17T12:58:03.499666+0000","last_clean":"2024-02-17T12:58:03.499666+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:03.499666+0000","last_undegraded":"2024-02-17T12:58:03.499666+0000","last_fullsized":"2024-02-17T12:58:03.499666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501191+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:03.501191+0000","last_peered":"2024-02-17T12:58:03.501191+0000","last_clean":"2024-02-17T12:58:03.501191+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:03.501191+0000","last_undegraded":"2024-02-17T12:58:03.501191+0000","last_fullsized":"2024-02-17T12:58:03.501191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484214+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:03.484214+0000","last_peered":"2024-02-17T12:58:03.484214+0000","last_clean":"2024-02-17T12:58:03.484214+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:03.484214+0000","last_undegraded":"2024-02-17T12:58:03.484214+0000","last_fullsized":"2024-02-17T12:58:03.484214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498931+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:03.498931+0000","last_peered":"2024-02-17T12:58:03.498931+0000","last_clean":"2024-02-17T12:58:03.498931+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:03.498931+0000","last_undegraded":"2024-02-17T12:58:03.498931+0000","last_fullsized":"2024-02-17T12:58:03.498931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499103+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:03.499103+0000","last_peered":"2024-02-17T12:58:03.499103+0000","last_clean":"2024-02-17T12:58:03.499103+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:03.499103+0000","last_undegraded":"2024-02-17T12:58:03.499103+0000","last_fullsized":"2024-02-17T12:58:03.499103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484172+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:03.484172+0000","last_peered":"2024-02-17T12:58:03.484172+0000","last_clean":"2024-02-17T12:58:03.484172+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:03.484172+0000","last_undegraded":"2024-02-17T12:58:03.484172+0000","last_fullsized":"2024-02-17T12:58:03.484172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483632+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:03.483632+0000","last_peered":"2024-02-17T12:58:03.483632+0000","last_clean":"2024-02-17T12:58:03.483632+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:03.483632+0000","last_undegraded":"2024-02-17T12:58:03.483632+0000","last_fullsized":"2024-02-17T12:58:03.483632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500896+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:03.500896+0000","last_peered":"2024-02-17T12:58:03.500896+0000","last_clean":"2024-02-17T12:58:03.500896+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:03.500896+0000","last_undegraded":"2024-02-17T12:58:03.500896+0000","last_fullsized":"2024-02-17T12:58:03.500896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499634+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:03.499634+0000","last_peered":"2024-02-17T12:58:03.499634+0000","last_clean":"2024-02-17T12:58:03.499634+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:03.499634+0000","last_undegraded":"2024-02-17T12:58:03.499634+0000","last_fullsized":"2024-02-17T12:58:03.499634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435529+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:03.435529+0000","last_peered":"2024-02-17T12:58:03.435529+0000","last_clean":"2024-02-17T12:58:03.435529+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:03.435529+0000","last_undegraded":"2024-02-17T12:58:03.435529+0000","last_fullsized":"2024-02-17T12:58:03.435529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501502+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:03.501502+0000","last_peered":"2024-02-17T12:58:03.501502+0000","last_clean":"2024-02-17T12:58:03.501502+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:03.501502+0000","last_undegraded":"2024-02-17T12:58:03.501502+0000","last_fullsized":"2024-02-17T12:58:03.501502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500133+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:03.500133+0000","last_peered":"2024-02-17T12:58:03.500133+0000","last_clean":"2024-02-17T12:58:03.500133+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:03.500133+0000","last_undegraded":"2024-02-17T12:58:03.500133+0000","last_fullsized":"2024-02-17T12:58:03.500133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502017+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:03.502017+0000","last_peered":"2024-02-17T12:58:03.502017+0000","last_clean":"2024-02-17T12:58:03.502017+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:03.502017+0000","last_undegraded":"2024-02-17T12:58:03.502017+0000","last_fullsized":"2024-02-17T12:58:03.502017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501901+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:03.501901+0000","last_peered":"2024-02-17T12:58:03.501901+0000","last_clean":"2024-02-17T12:58:03.501901+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:03.501901+0000","last_undegraded":"2024-02-17T12:58:03.501901+0000","last_fullsized":"2024-02-17T12:58:03.501901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484366+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:03.484366+0000","last_peered":"2024-02-17T12:58:03.484366+0000","last_clean":"2024-02-17T12:58:03.484366+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:03.484366+0000","last_undegraded":"2024-02-17T12:58:03.484366+0000","last_fullsized":"2024-02-17T12:58:03.484366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436978+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:03.436978+0000","last_peered":"2024-02-17T12:58:03.436978+0000","last_clean":"2024-02-17T12:58:03.436978+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:03.436978+0000","last_undegraded":"2024-02-17T12:58:03.436978+0000","last_fullsized":"2024-02-17T12:58:03.436978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500930+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:03.500930+0000","last_peered":"2024-02-17T12:58:03.500930+0000","last_clean":"2024-02-17T12:58:03.500930+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:03.500930+0000","last_undegraded":"2024-02-17T12:58:03.500930+0000","last_fullsized":"2024-02-17T12:58:03.500930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499456+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:03.499456+0000","last_peered":"2024-02-17T12:58:03.499456+0000","last_clean":"2024-02-17T12:58:03.499456+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:03.499456+0000","last_undegraded":"2024-02-17T12:58:03.499456+0000","last_fullsized":"2024-02-17T12:58:03.499456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499570+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:03.499570+0000","last_peered":"2024-02-17T12:58:03.499570+0000","last_clean":"2024-02-17T12:58:03.499570+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:03.499570+0000","last_undegraded":"2024-02-17T12:58:03.499570+0000","last_fullsized":"2024-02-17T12:58:03.499570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500482+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:03.500482+0000","last_peered":"2024-02-17T12:58:03.500482+0000","last_clean":"2024-02-17T12:58:03.500482+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:03.500482+0000","last_undegraded":"2024-02-17T12:58:03.500482+0000","last_fullsized":"2024-02-17T12:58:03.500482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435751+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:03.435751+0000","last_peered":"2024-02-17T12:58:03.435751+0000","last_clean":"2024-02-17T12:58:03.435751+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:03.435751+0000","last_undegraded":"2024-02-17T12:58:03.435751+0000","last_fullsized":"2024-02-17T12:58:03.435751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500345+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:03.500345+0000","last_peered":"2024-02-17T12:58:03.500345+0000","last_clean":"2024-02-17T12:58:03.500345+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:03.500345+0000","last_undegraded":"2024-02-17T12:58:03.500345+0000","last_fullsized":"2024-02-17T12:58:03.500345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437483+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:03.437483+0000","last_peered":"2024-02-17T12:58:03.437483+0000","last_clean":"2024-02-17T12:58:03.437483+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:03.437483+0000","last_undegraded":"2024-02-17T12:58:03.437483+0000","last_fullsized":"2024-02-17T12:58:03.437483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501285+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:03.501285+0000","last_peered":"2024-02-17T12:58:03.501285+0000","last_clean":"2024-02-17T12:58:03.501285+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:03.501285+0000","last_undegraded":"2024-02-17T12:58:03.501285+0000","last_fullsized":"2024-02-17T12:58:03.501285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499393+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:03.499393+0000","last_peered":"2024-02-17T12:58:03.499393+0000","last_clean":"2024-02-17T12:58:03.499393+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:03.499393+0000","last_undegraded":"2024-02-17T12:58:03.499393+0000","last_fullsized":"2024-02-17T12:58:03.499393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501697+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:03.501697+0000","last_peered":"2024-02-17T12:58:03.501697+0000","last_clean":"2024-02-17T12:58:03.501697+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:03.501697+0000","last_undegraded":"2024-02-17T12:58:03.501697+0000","last_fullsized":"2024-02-17T12:58:03.501697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:29.720075+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:29.720075+0000","last_peered":"2024-02-17T12:58:29.720075+0000","last_clean":"2024-02-17T12:58:29.720075+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:29.720075+0000","last_undegraded":"2024-02-17T12:58:29.720075+0000","last_fullsized":"2024-02-17T12:58:29.720075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499979+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:03.499979+0000","last_peered":"2024-02-17T12:58:03.499979+0000","last_clean":"2024-02-17T12:58:03.499979+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:03.499979+0000","last_undegraded":"2024-02-17T12:58:03.499979+0000","last_fullsized":"2024-02-17T12:58:03.499979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499132+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:03.499132+0000","last_peered":"2024-02-17T12:58:03.499132+0000","last_clean":"2024-02-17T12:58:03.499132+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:03.499132+0000","last_undegraded":"2024-02-17T12:58:03.499132+0000","last_fullsized":"2024-02-17T12:58:03.499132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499536+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:03.499536+0000","last_peered":"2024-02-17T12:58:03.499536+0000","last_clean":"2024-02-17T12:58:03.499536+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:03.499536+0000","last_undegraded":"2024-02-17T12:58:03.499536+0000","last_fullsized":"2024-02-17T12:58:03.499536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499993+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:03.499993+0000","last_peered":"2024-02-17T12:58:03.499993+0000","last_clean":"2024-02-17T12:58:03.499993+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:03.499993+0000","last_undegraded":"2024-02-17T12:58:03.499993+0000","last_fullsized":"2024-02-17T12:58:03.499993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501326+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:03.501326+0000","last_peered":"2024-02-17T12:58:03.501326+0000","last_clean":"2024-02-17T12:58:03.501326+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:03.501326+0000","last_undegraded":"2024-02-17T12:58:03.501326+0000","last_fullsized":"2024-02-17T12:58:03.501326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501120+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:03.501120+0000","last_peered":"2024-02-17T12:58:03.501120+0000","last_clean":"2024-02-17T12:58:03.501120+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:03.501120+0000","last_undegraded":"2024-02-17T12:58:03.501120+0000","last_fullsized":"2024-02-17T12:58:03.501120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484156+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:03.484156+0000","last_peered":"2024-02-17T12:58:03.484156+0000","last_clean":"2024-02-17T12:58:03.484156+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:03.484156+0000","last_undegraded":"2024-02-17T12:58:03.484156+0000","last_fullsized":"2024-02-17T12:58:03.484156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483876+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:03.483876+0000","last_peered":"2024-02-17T12:58:03.483876+0000","last_clean":"2024-02-17T12:58:03.483876+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:03.483876+0000","last_undegraded":"2024-02-17T12:58:03.483876+0000","last_fullsized":"2024-02-17T12:58:03.483876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499942+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:03.499942+0000","last_peered":"2024-02-17T12:58:03.499942+0000","last_clean":"2024-02-17T12:58:03.499942+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:03.499942+0000","last_undegraded":"2024-02-17T12:58:03.499942+0000","last_fullsized":"2024-02-17T12:58:03.499942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501859+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:03.501859+0000","last_peered":"2024-02-17T12:58:03.501859+0000","last_clean":"2024-02-17T12:58:03.501859+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:03.501859+0000","last_undegraded":"2024-02-17T12:58:03.501859+0000","last_fullsized":"2024-02-17T12:58:03.501859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500616+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:03.500616+0000","last_peered":"2024-02-17T12:58:03.500616+0000","last_clean":"2024-02-17T12:58:03.500616+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:03.500616+0000","last_undegraded":"2024-02-17T12:58:03.500616+0000","last_fullsized":"2024-02-17T12:58:03.500616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:18.892914+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:18.892914+0000","last_peered":"2024-02-17T12:58:18.892914+0000","last_clean":"2024-02-17T12:58:18.892914+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:18.892914+0000","last_undegraded":"2024-02-17T12:58:18.892914+0000","last_fullsized":"2024-02-17T12:58:18.892914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435435+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:03.435435+0000","last_peered":"2024-02-17T12:58:03.435435+0000","last_clean":"2024-02-17T12:58:03.435435+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:03.435435+0000","last_undegraded":"2024-02-17T12:58:03.435435+0000","last_fullsized":"2024-02-17T12:58:03.435435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501617+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:03.501617+0000","last_peered":"2024-02-17T12:58:03.501617+0000","last_clean":"2024-02-17T12:58:03.501617+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:03.501617+0000","last_undegraded":"2024-02-17T12:58:03.501617+0000","last_fullsized":"2024-02-17T12:58:03.501617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499400+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:03.499400+0000","last_peered":"2024-02-17T12:58:03.499400+0000","last_clean":"2024-02-17T12:58:03.499400+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:03.499400+0000","last_undegraded":"2024-02-17T12:58:03.499400+0000","last_fullsized":"2024-02-17T12:58:03.499400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436993+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:03.436993+0000","last_peered":"2024-02-17T12:58:03.436993+0000","last_clean":"2024-02-17T12:58:03.436993+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:03.436993+0000","last_undegraded":"2024-02-17T12:58:03.436993+0000","last_fullsized":"2024-02-17T12:58:03.436993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499802+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:03.499802+0000","last_peered":"2024-02-17T12:58:03.499802+0000","last_clean":"2024-02-17T12:58:03.499802+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:03.499802+0000","last_undegraded":"2024-02-17T12:58:03.499802+0000","last_fullsized":"2024-02-17T12:58:03.499802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500396+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:03.500396+0000","last_peered":"2024-02-17T12:58:03.500396+0000","last_clean":"2024-02-17T12:58:03.500396+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:03.500396+0000","last_undegraded":"2024-02-17T12:58:03.500396+0000","last_fullsized":"2024-02-17T12:58:03.500396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498874+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:03.498874+0000","last_peered":"2024-02-17T12:58:03.498874+0000","last_clean":"2024-02-17T12:58:03.498874+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:03.498874+0000","last_undegraded":"2024-02-17T12:58:03.498874+0000","last_fullsized":"2024-02-17T12:58:03.498874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437473+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:03.437473+0000","last_peered":"2024-02-17T12:58:03.437473+0000","last_clean":"2024-02-17T12:58:03.437473+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:03.437473+0000","last_undegraded":"2024-02-17T12:58:03.437473+0000","last_fullsized":"2024-02-17T12:58:03.437473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499697+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:03.499697+0000","last_peered":"2024-02-17T12:58:03.499697+0000","last_clean":"2024-02-17T12:58:03.499697+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:03.499697+0000","last_undegraded":"2024-02-17T12:58:03.499697+0000","last_fullsized":"2024-02-17T12:58:03.499697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435402+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:03.435402+0000","last_peered":"2024-02-17T12:58:03.435402+0000","last_clean":"2024-02-17T12:58:03.435402+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:03.435402+0000","last_undegraded":"2024-02-17T12:58:03.435402+0000","last_fullsized":"2024-02-17T12:58:03.435402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435623+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:03.435623+0000","last_peered":"2024-02-17T12:58:03.435623+0000","last_clean":"2024-02-17T12:58:03.435623+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:03.435623+0000","last_undegraded":"2024-02-17T12:58:03.435623+0000","last_fullsized":"2024-02-17T12:58:03.435623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435454+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:03.435454+0000","last_peered":"2024-02-17T12:58:03.435454+0000","last_clean":"2024-02-17T12:58:03.435454+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:03.435454+0000","last_undegraded":"2024-02-17T12:58:03.435454+0000","last_fullsized":"2024-02-17T12:58:03.435454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500806+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:03.500806+0000","last_peered":"2024-02-17T12:58:03.500806+0000","last_clean":"2024-02-17T12:58:03.500806+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:03.500806+0000","last_undegraded":"2024-02-17T12:58:03.500806+0000","last_fullsized":"2024-02-17T12:58:03.500806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501656+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:03.501656+0000","last_peered":"2024-02-17T12:58:03.501656+0000","last_clean":"2024-02-17T12:58:03.501656+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:03.501656+0000","last_undegraded":"2024-02-17T12:58:03.501656+0000","last_fullsized":"2024-02-17T12:58:03.501656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499126+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:03.499126+0000","last_peered":"2024-02-17T12:58:03.499126+0000","last_clean":"2024-02-17T12:58:03.499126+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:03.499126+0000","last_undegraded":"2024-02-17T12:58:03.499126+0000","last_fullsized":"2024-02-17T12:58:03.499126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483654+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:03.483654+0000","last_peered":"2024-02-17T12:58:03.483654+0000","last_clean":"2024-02-17T12:58:03.483654+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:03.483654+0000","last_undegraded":"2024-02-17T12:58:03.483654+0000","last_fullsized":"2024-02-17T12:58:03.483654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501100+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:03.501100+0000","last_peered":"2024-02-17T12:58:03.501100+0000","last_clean":"2024-02-17T12:58:03.501100+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:03.501100+0000","last_undegraded":"2024-02-17T12:58:03.501100+0000","last_fullsized":"2024-02-17T12:58:03.501100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435901+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:03.435901+0000","last_peered":"2024-02-17T12:58:03.435901+0000","last_clean":"2024-02-17T12:58:03.435901+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:03.435901+0000","last_undegraded":"2024-02-17T12:58:03.435901+0000","last_fullsized":"2024-02-17T12:58:03.435901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435463+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:03.435463+0000","last_peered":"2024-02-17T12:58:03.435463+0000","last_clean":"2024-02-17T12:58:03.435463+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:03.435463+0000","last_undegraded":"2024-02-17T12:58:03.435463+0000","last_fullsized":"2024-02-17T12:58:03.435463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499774+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:03.499774+0000","last_peered":"2024-02-17T12:58:03.499774+0000","last_clean":"2024-02-17T12:58:03.499774+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:03.499774+0000","last_undegraded":"2024-02-17T12:58:03.499774+0000","last_fullsized":"2024-02-17T12:58:03.499774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499747+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:03.499747+0000","last_peered":"2024-02-17T12:58:03.499747+0000","last_clean":"2024-02-17T12:58:03.499747+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:03.499747+0000","last_undegraded":"2024-02-17T12:58:03.499747+0000","last_fullsized":"2024-02-17T12:58:03.499747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499185+0000","last_change":"2024-02-17T12:58:02.535095+0000","last_active":"2024-02-17T12:58:03.499185+0000","last_peered":"2024-02-17T12:58:03.499185+0000","last_clean":"2024-02-17T12:58:03.499185+0000","last_became_active":"2024-02-17T12:58:02.534718+0000","last_became_peered":"2024-02-17T12:58:02.534718+0000","last_unstale":"2024-02-17T12:58:03.499185+0000","last_undegraded":"2024-02-17T12:58:03.499185+0000","last_fullsized":"2024-02-17T12:58:03.499185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:43.813403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437040+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:03.437040+0000","last_peered":"2024-02-17T12:58:03.437040+0000","last_clean":"2024-02-17T12:58:03.437040+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:03.437040+0000","last_undegraded":"2024-02-17T12:58:03.437040+0000","last_fullsized":"2024-02-17T12:58:03.437040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499018+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:03.499018+0000","last_peered":"2024-02-17T12:58:03.499018+0000","last_clean":"2024-02-17T12:58:03.499018+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:03.499018+0000","last_undegraded":"2024-02-17T12:58:03.499018+0000","last_fullsized":"2024-02-17T12:58:03.499018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500940+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:03.500940+0000","last_peered":"2024-02-17T12:58:03.500940+0000","last_clean":"2024-02-17T12:58:03.500940+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:03.500940+0000","last_undegraded":"2024-02-17T12:58:03.500940+0000","last_fullsized":"2024-02-17T12:58:03.500940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499659+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:03.499659+0000","last_peered":"2024-02-17T12:58:03.499659+0000","last_clean":"2024-02-17T12:58:03.499659+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:03.499659+0000","last_undegraded":"2024-02-17T12:58:03.499659+0000","last_fullsized":"2024-02-17T12:58:03.499659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484252+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:03.484252+0000","last_peered":"2024-02-17T12:58:03.484252+0000","last_clean":"2024-02-17T12:58:03.484252+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:03.484252+0000","last_undegraded":"2024-02-17T12:58:03.484252+0000","last_fullsized":"2024-02-17T12:58:03.484252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483899+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:03.483899+0000","last_peered":"2024-02-17T12:58:03.483899+0000","last_clean":"2024-02-17T12:58:03.483899+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:03.483899+0000","last_undegraded":"2024-02-17T12:58:03.483899+0000","last_fullsized":"2024-02-17T12:58:03.483899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437387+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:03.437387+0000","last_peered":"2024-02-17T12:58:03.437387+0000","last_clean":"2024-02-17T12:58:03.437387+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:03.437387+0000","last_undegraded":"2024-02-17T12:58:03.437387+0000","last_fullsized":"2024-02-17T12:58:03.437387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499562+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:03.499562+0000","last_peered":"2024-02-17T12:58:03.499562+0000","last_clean":"2024-02-17T12:58:03.499562+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:03.499562+0000","last_undegraded":"2024-02-17T12:58:03.499562+0000","last_fullsized":"2024-02-17T12:58:03.499562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500719+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:03.500719+0000","last_peered":"2024-02-17T12:58:03.500719+0000","last_clean":"2024-02-17T12:58:03.500719+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:03.500719+0000","last_undegraded":"2024-02-17T12:58:03.500719+0000","last_fullsized":"2024-02-17T12:58:03.500719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499128+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:03.499128+0000","last_peered":"2024-02-17T12:58:03.499128+0000","last_clean":"2024-02-17T12:58:03.499128+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:03.499128+0000","last_undegraded":"2024-02-17T12:58:03.499128+0000","last_fullsized":"2024-02-17T12:58:03.499128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499663+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:03.499663+0000","last_peered":"2024-02-17T12:58:03.499663+0000","last_clean":"2024-02-17T12:58:03.499663+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:03.499663+0000","last_undegraded":"2024-02-17T12:58:03.499663+0000","last_fullsized":"2024-02-17T12:58:03.499663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435719+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:03.435719+0000","last_peered":"2024-02-17T12:58:03.435719+0000","last_clean":"2024-02-17T12:58:03.435719+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:03.435719+0000","last_undegraded":"2024-02-17T12:58:03.435719+0000","last_fullsized":"2024-02-17T12:58:03.435719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500074+0000","last_change":"2024-02-17T12:57:57.772384+0000","last_active":"2024-02-17T12:58:03.500074+0000","last_peered":"2024-02-17T12:58:03.500074+0000","last_clean":"2024-02-17T12:58:03.500074+0000","last_became_active":"2024-02-17T12:57:57.771936+0000","last_became_peered":"2024-02-17T12:57:57.771936+0000","last_unstale":"2024-02-17T12:58:03.500074+0000","last_undegraded":"2024-02-17T12:58:03.500074+0000","last_fullsized":"2024-02-17T12:58:03.500074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502000+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:03.502000+0000","last_peered":"2024-02-17T12:58:03.502000+0000","last_clean":"2024-02-17T12:58:03.502000+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:03.502000+0000","last_undegraded":"2024-02-17T12:58:03.502000+0000","last_fullsized":"2024-02-17T12:58:03.502000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499724+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:03.499724+0000","last_peered":"2024-02-17T12:58:03.499724+0000","last_clean":"2024-02-17T12:58:03.499724+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:03.499724+0000","last_undegraded":"2024-02-17T12:58:03.499724+0000","last_fullsized":"2024-02-17T12:58:03.499724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501981+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:03.501981+0000","last_peered":"2024-02-17T12:58:03.501981+0000","last_clean":"2024-02-17T12:58:03.501981+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:03.501981+0000","last_undegraded":"2024-02-17T12:58:03.501981+0000","last_fullsized":"2024-02-17T12:58:03.501981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500633+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:03.500633+0000","last_peered":"2024-02-17T12:58:03.500633+0000","last_clean":"2024-02-17T12:58:03.500633+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:03.500633+0000","last_undegraded":"2024-02-17T12:58:03.500633+0000","last_fullsized":"2024-02-17T12:58:03.500633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499030+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:03.499030+0000","last_peered":"2024-02-17T12:58:03.499030+0000","last_clean":"2024-02-17T12:58:03.499030+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:03.499030+0000","last_undegraded":"2024-02-17T12:58:03.499030+0000","last_fullsized":"2024-02-17T12:58:03.499030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483746+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:03.483746+0000","last_peered":"2024-02-17T12:58:03.483746+0000","last_clean":"2024-02-17T12:58:03.483746+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:03.483746+0000","last_undegraded":"2024-02-17T12:58:03.483746+0000","last_fullsized":"2024-02-17T12:58:03.483746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483901+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:03.483901+0000","last_peered":"2024-02-17T12:58:03.483901+0000","last_clean":"2024-02-17T12:58:03.483901+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:03.483901+0000","last_undegraded":"2024-02-17T12:58:03.483901+0000","last_fullsized":"2024-02-17T12:58:03.483901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500055+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:03.500055+0000","last_peered":"2024-02-17T12:58:03.500055+0000","last_clean":"2024-02-17T12:58:03.500055+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:03.500055+0000","last_undegraded":"2024-02-17T12:58:03.500055+0000","last_fullsized":"2024-02-17T12:58:03.500055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500899+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:03.500899+0000","last_peered":"2024-02-17T12:58:03.500899+0000","last_clean":"2024-02-17T12:58:03.500899+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:03.500899+0000","last_undegraded":"2024-02-17T12:58:03.500899+0000","last_fullsized":"2024-02-17T12:58:03.500899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500012+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:03.500012+0000","last_peered":"2024-02-17T12:58:03.500012+0000","last_clean":"2024-02-17T12:58:03.500012+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:03.500012+0000","last_undegraded":"2024-02-17T12:58:03.500012+0000","last_fullsized":"2024-02-17T12:58:03.500012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499612+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:03.499612+0000","last_peered":"2024-02-17T12:58:03.499612+0000","last_clean":"2024-02-17T12:58:03.499612+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:03.499612+0000","last_undegraded":"2024-02-17T12:58:03.499612+0000","last_fullsized":"2024-02-17T12:58:03.499612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498813+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:03.498813+0000","last_peered":"2024-02-17T12:58:03.498813+0000","last_clean":"2024-02-17T12:58:03.498813+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:03.498813+0000","last_undegraded":"2024-02-17T12:58:03.498813+0000","last_fullsized":"2024-02-17T12:58:03.498813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499532+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:03.499532+0000","last_peered":"2024-02-17T12:58:03.499532+0000","last_clean":"2024-02-17T12:58:03.499532+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:03.499532+0000","last_undegraded":"2024-02-17T12:58:03.499532+0000","last_fullsized":"2024-02-17T12:58:03.499532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437096+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:03.437096+0000","last_peered":"2024-02-17T12:58:03.437096+0000","last_clean":"2024-02-17T12:58:03.437096+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:03.437096+0000","last_undegraded":"2024-02-17T12:58:03.437096+0000","last_fullsized":"2024-02-17T12:58:03.437096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499732+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:03.499732+0000","last_peered":"2024-02-17T12:58:03.499732+0000","last_clean":"2024-02-17T12:58:03.499732+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:03.499732+0000","last_undegraded":"2024-02-17T12:58:03.499732+0000","last_fullsized":"2024-02-17T12:58:03.499732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437140+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:03.437140+0000","last_peered":"2024-02-17T12:58:03.437140+0000","last_clean":"2024-02-17T12:58:03.437140+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:03.437140+0000","last_undegraded":"2024-02-17T12:58:03.437140+0000","last_fullsized":"2024-02-17T12:58:03.437140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499291+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:03.499291+0000","last_peered":"2024-02-17T12:58:03.499291+0000","last_clean":"2024-02-17T12:58:03.499291+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:03.499291+0000","last_undegraded":"2024-02-17T12:58:03.499291+0000","last_fullsized":"2024-02-17T12:58:03.499291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499819+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:03.499819+0000","last_peered":"2024-02-17T12:58:03.499819+0000","last_clean":"2024-02-17T12:58:03.499819+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:03.499819+0000","last_undegraded":"2024-02-17T12:58:03.499819+0000","last_fullsized":"2024-02-17T12:58:03.499819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500208+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:03.500208+0000","last_peered":"2024-02-17T12:58:03.500208+0000","last_clean":"2024-02-17T12:58:03.500208+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:03.500208+0000","last_undegraded":"2024-02-17T12:58:03.500208+0000","last_fullsized":"2024-02-17T12:58:03.500208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4730,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":10064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":100388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":100846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:32.637 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:32.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.783+0000 7f31349c7640 1 Processor -- start 2024-02-17T12:58:32.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.783+0000 7f31349c7640 1 -- start start 2024-02-17T12:58:32.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.784+0000 7f31349c7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f31300c4340 0x7f31300c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.784+0000 7f31349c7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f3130070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.784+0000 7f31349c7640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31300c9d20 con 0x7f3130157430 2024-02-17T12:58:32.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.784+0000 7f31349c7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313006bf20 con 0x7f31300c4340 2024-02-17T12:58:32.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.784+0000 7f31349c7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313006cd20 con 0x7f31300c7e30 2024-02-17T12:58:32.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.785+0000 7f312ed9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f3130070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.785+0000 7f312ed9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f3130070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39696/0 (socket says 172.21.15.136:39696) 2024-02-17T12:58:32.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.785+0000 7f312ed9d640 1 -- 172.21.15.136:0/367774625 learned_addr learned my addr 172.21.15.136:0/367774625 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:32.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.785+0000 7f3127fff640 1 --2- 172.21.15.136:0/367774625 >> v2:172.21.15.136:3300/0 conn(0x7f31300c4340 0x7f31300c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.787+0000 7f312ed9d640 1 -- 172.21.15.136:0/367774625 >> v2:172.21.15.136:3300/0 conn(0x7f31300c4340 msgr2=0x7f31300c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:32.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.787+0000 7f312ed9d640 1 --2- 172.21.15.136:0/367774625 >> v2:172.21.15.136:3300/0 conn(0x7f31300c4340 0x7f31300c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.787+0000 7f312ed9d640 1 -- 172.21.15.136:0/367774625 >> v1:172.21.15.136:6789/0 conn(0x7f3130157430 legacy=0x7f313015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.787+0000 7f312ed9d640 1 -- 172.21.15.136:0/367774625 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313006bbd0 con 0x7f31300c7e30 2024-02-17T12:58:32.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.789+0000 7f312ed9d640 1 --2- 172.21.15.136:0/367774625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f3130070720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3128009e50 tx=0x7f312802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d517ff0ce076cbd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f312dd9b640 1 -- 172.21.15.136:0/367774625 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312802cb00 con 0x7f31300c7e30 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f312dd9b640 1 -- 172.21.15.136:0/367774625 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312802cc60 con 0x7f31300c7e30 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f312dd9b640 1 -- 172.21.15.136:0/367774625 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31280343f0 con 0x7f31300c7e30 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 -- 172.21.15.136:0/367774625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 msgr2=0x7f3130070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 --2- 172.21.15.136:0/367774625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f3130070720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3128009e50 tx=0x7f312802bf60 comp rx=0 tx=0).stop 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 -- 172.21.15.136:0/367774625 shutdown_connections 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 --2- 172.21.15.136:0/367774625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f3130070720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 --2- 172.21.15.136:0/367774625 >> v2:172.21.15.136:3300/0 conn(0x7f31300c4340 0x7f31300c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 -- 172.21.15.136:0/367774625 >> 172.21.15.136:0/367774625 conn(0x7f313006fe80 msgr2=0x7f313006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:32.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.793+0000 7f31349c7640 1 -- 172.21.15.136:0/367774625 shutdown_connections 2024-02-17T12:58:32.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.794+0000 7f31349c7640 1 -- 172.21.15.136:0/367774625 wait complete. 2024-02-17T12:58:32.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.795+0000 7f31349c7640 1 Processor -- start 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.795+0000 7f31349c7640 1 -- start start 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.795+0000 7f31349c7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 0x7f313014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.795+0000 7f31349c7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f31300c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f31349c7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3130157430 0x7f31301f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f31349c7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300c3e20 con 0x7f31300c4340 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f31349c7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300c49d0 con 0x7f3130157430 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f31349c7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300c4f50 con 0x7f31300c7e30 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f312e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 0x7f313014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f3127fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f31300c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f312e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 0x7f313014da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50170/0 (socket says 172.21.15.136:50170) 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f312e59c640 1 -- 172.21.15.136:0/3091964171 learned_addr learned my addr 172.21.15.136:0/3091964171 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:32.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.796+0000 7f312ed9d640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3130157430 0x7f31301f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:32.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.800+0000 7f312e59c640 1 -- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 msgr2=0x7f31300c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.800+0000 7f312e59c640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f31300c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.800+0000 7f312e59c640 1 -- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3130157430 msgr2=0x7f31301f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:32.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.800+0000 7f312e59c640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3130157430 0x7f31301f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:32.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.800+0000 7f312e59c640 1 -- 172.21.15.136:0/3091964171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3128009b30 con 0x7f31300c4340 2024-02-17T12:58:32.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.802+0000 7f312e59c640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 0x7f313014da50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f312000c3c0 tx=0x7f312000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.806+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31200052d0 con 0x7f31300c4340 2024-02-17T12:58:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.806+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3120005450 con 0x7f31300c4340 2024-02-17T12:58:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.806+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31300c4c70 con 0x7f31300c4340 2024-02-17T12:58:32.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.806+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120007260 con 0x7f31300c4340 2024-02-17T12:58:32.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.806+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31300c6d80 con 0x7f31300c4340 2024-02-17T12:58:32.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:32.807+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3130067e00 con 0x7f31300c4340 2024-02-17T12:58:33.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.049+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f31200073c0 con 0x7f31300c4340 2024-02-17T12:58:33.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.050+0000 7f3126ffd640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f311006b890 0x7f311006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.050+0000 7f3127fff640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f311006b890 0x7f311006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.050+0000 7f3127fff640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f311006b890 0x7f311006dd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f313014c600 tx=0x7f3118009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.063+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3120007670 con 0x7f31300c4340 2024-02-17T12:58:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.064+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3120054620 con 0x7f31300c4340 2024-02-17T12:58:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.266+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31300ca900 con 0x7f311006b890 2024-02-17T12:58:33.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.283+0000 7f3126ffd640 1 -- 172.21.15.136:0/3091964171 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345197 (secure 0 0 0) 0x7f3118011a30 con 0x7f311006b890 2024-02-17T12:58:33.277 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:33.279 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:33.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f311006b890 msgr2=0x7f311006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:33.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f311006b890 0x7f311006dd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f313014c600 tx=0x7f3118009190 comp rx=0 tx=0).stop 2024-02-17T12:58:33.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 msgr2=0x7f313014da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:33.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 0x7f313014da50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f312000c3c0 tx=0x7f312000c880 comp rx=0 tx=0).stop 2024-02-17T12:58:33.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 shutdown_connections 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f311006b890 0x7f311006dd50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3130157430 0x7f31301f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31300c7e30 0x7f31300c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 --2- 172.21.15.136:0/3091964171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31300c4340 0x7f313014da50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 >> 172.21.15.136:0/3091964171 conn(0x7f313006fe80 msgr2=0x7f313006c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 shutdown_connections 2024-02-17T12:58:33.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.287+0000 7f31349c7640 1 -- 172.21.15.136:0/3091964171 wait complete. 2024-02-17T12:58:33.289 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-02-17T12:58:31.989577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595098,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219416,"kb_used_data":3224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755304,"statfs":{"total":773094113280,"available":772869431296,"internally_reserved":0,"allocated":3301376,"data_stored":1992912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002964"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435958+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:03.435958+0000","last_peered":"2024-02-17T12:58:03.435958+0000","last_clean":"2024-02-17T12:58:03.435958+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:03.435958+0000","last_undegraded":"2024-02-17T12:58:03.435958+0000","last_fullsized":"2024-02-17T12:58:03.435958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499978+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:03.499978+0000","last_peered":"2024-02-17T12:58:03.499978+0000","last_clean":"2024-02-17T12:58:03.499978+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:03.499978+0000","last_undegraded":"2024-02-17T12:58:03.499978+0000","last_fullsized":"2024-02-17T12:58:03.499978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498917+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:03.498917+0000","last_peered":"2024-02-17T12:58:03.498917+0000","last_clean":"2024-02-17T12:58:03.498917+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:03.498917+0000","last_undegraded":"2024-02-17T12:58:03.498917+0000","last_fullsized":"2024-02-17T12:58:03.498917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500086+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:03.500086+0000","last_peered":"2024-02-17T12:58:03.500086+0000","last_clean":"2024-02-17T12:58:03.500086+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:03.500086+0000","last_undegraded":"2024-02-17T12:58:03.500086+0000","last_fullsized":"2024-02-17T12:58:03.500086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499709+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:03.499709+0000","last_peered":"2024-02-17T12:58:03.499709+0000","last_clean":"2024-02-17T12:58:03.499709+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:03.499709+0000","last_undegraded":"2024-02-17T12:58:03.499709+0000","last_fullsized":"2024-02-17T12:58:03.499709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437354+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:03.437354+0000","last_peered":"2024-02-17T12:58:03.437354+0000","last_clean":"2024-02-17T12:58:03.437354+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:03.437354+0000","last_undegraded":"2024-02-17T12:58:03.437354+0000","last_fullsized":"2024-02-17T12:58:03.437354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500781+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:03.500781+0000","last_peered":"2024-02-17T12:58:03.500781+0000","last_clean":"2024-02-17T12:58:03.500781+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:03.500781+0000","last_undegraded":"2024-02-17T12:58:03.500781+0000","last_fullsized":"2024-02-17T12:58:03.500781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500058+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:03.500058+0000","last_peered":"2024-02-17T12:58:03.500058+0000","last_clean":"2024-02-17T12:58:03.500058+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:03.500058+0000","last_undegraded":"2024-02-17T12:58:03.500058+0000","last_fullsized":"2024-02-17T12:58:03.500058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437167+0000","last_change":"2024-02-17T12:58:02.530056+0000","last_active":"2024-02-17T12:58:03.437167+0000","last_peered":"2024-02-17T12:58:03.437167+0000","last_clean":"2024-02-17T12:58:03.437167+0000","last_became_active":"2024-02-17T12:58:02.529672+0000","last_became_peered":"2024-02-17T12:58:02.529672+0000","last_unstale":"2024-02-17T12:58:03.437167+0000","last_undegraded":"2024-02-17T12:58:03.437167+0000","last_fullsized":"2024-02-17T12:58:03.437167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501030+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:03.501030+0000","last_peered":"2024-02-17T12:58:03.501030+0000","last_clean":"2024-02-17T12:58:03.501030+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:03.501030+0000","last_undegraded":"2024-02-17T12:58:03.501030+0000","last_fullsized":"2024-02-17T12:58:03.501030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501815+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:03.501815+0000","last_peered":"2024-02-17T12:58:03.501815+0000","last_clean":"2024-02-17T12:58:03.501815+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:03.501815+0000","last_undegraded":"2024-02-17T12:58:03.501815+0000","last_fullsized":"2024-02-17T12:58:03.501815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436985+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:03.436985+0000","last_peered":"2024-02-17T12:58:03.436985+0000","last_clean":"2024-02-17T12:58:03.436985+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:03.436985+0000","last_undegraded":"2024-02-17T12:58:03.436985+0000","last_fullsized":"2024-02-17T12:58:03.436985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501021+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:03.501021+0000","last_peered":"2024-02-17T12:58:03.501021+0000","last_clean":"2024-02-17T12:58:03.501021+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:03.501021+0000","last_undegraded":"2024-02-17T12:58:03.501021+0000","last_fullsized":"2024-02-17T12:58:03.501021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501474+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:03.501474+0000","last_peered":"2024-02-17T12:58:03.501474+0000","last_clean":"2024-02-17T12:58:03.501474+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:03.501474+0000","last_undegraded":"2024-02-17T12:58:03.501474+0000","last_fullsized":"2024-02-17T12:58:03.501474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501650+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:03.501650+0000","last_peered":"2024-02-17T12:58:03.501650+0000","last_clean":"2024-02-17T12:58:03.501650+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:03.501650+0000","last_undegraded":"2024-02-17T12:58:03.501650+0000","last_fullsized":"2024-02-17T12:58:03.501650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499773+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:03.499773+0000","last_peered":"2024-02-17T12:58:03.499773+0000","last_clean":"2024-02-17T12:58:03.499773+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:03.499773+0000","last_undegraded":"2024-02-17T12:58:03.499773+0000","last_fullsized":"2024-02-17T12:58:03.499773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484009+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:03.484009+0000","last_peered":"2024-02-17T12:58:03.484009+0000","last_clean":"2024-02-17T12:58:03.484009+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:03.484009+0000","last_undegraded":"2024-02-17T12:58:03.484009+0000","last_fullsized":"2024-02-17T12:58:03.484009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499965+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:03.499965+0000","last_peered":"2024-02-17T12:58:03.499965+0000","last_clean":"2024-02-17T12:58:03.499965+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:03.499965+0000","last_undegraded":"2024-02-17T12:58:03.499965+0000","last_fullsized":"2024-02-17T12:58:03.499965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435201+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:03.435201+0000","last_peered":"2024-02-17T12:58:03.435201+0000","last_clean":"2024-02-17T12:58:03.435201+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:03.435201+0000","last_undegraded":"2024-02-17T12:58:03.435201+0000","last_fullsized":"2024-02-17T12:58:03.435201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:29.720679+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:29.720679+0000","last_peered":"2024-02-17T12:58:29.720679+0000","last_clean":"2024-02-17T12:58:29.720679+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:29.720679+0000","last_undegraded":"2024-02-17T12:58:29.720679+0000","last_fullsized":"2024-02-17T12:58:29.720679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499608+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:03.499608+0000","last_peered":"2024-02-17T12:58:03.499608+0000","last_clean":"2024-02-17T12:58:03.499608+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:03.499608+0000","last_undegraded":"2024-02-17T12:58:03.499608+0000","last_fullsized":"2024-02-17T12:58:03.499608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501760+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:03.501760+0000","last_peered":"2024-02-17T12:58:03.501760+0000","last_clean":"2024-02-17T12:58:03.501760+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:03.501760+0000","last_undegraded":"2024-02-17T12:58:03.501760+0000","last_fullsized":"2024-02-17T12:58:03.501760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499292+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:03.499292+0000","last_peered":"2024-02-17T12:58:03.499292+0000","last_clean":"2024-02-17T12:58:03.499292+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:03.499292+0000","last_undegraded":"2024-02-17T12:58:03.499292+0000","last_fullsized":"2024-02-17T12:58:03.499292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437414+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:03.437414+0000","last_peered":"2024-02-17T12:58:03.437414+0000","last_clean":"2024-02-17T12:58:03.437414+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:03.437414+0000","last_undegraded":"2024-02-17T12:58:03.437414+0000","last_fullsized":"2024-02-17T12:58:03.437414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435676+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:03.435676+0000","last_peered":"2024-02-17T12:58:03.435676+0000","last_clean":"2024-02-17T12:58:03.435676+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:03.435676+0000","last_undegraded":"2024-02-17T12:58:03.435676+0000","last_fullsized":"2024-02-17T12:58:03.435676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502023+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:03.502023+0000","last_peered":"2024-02-17T12:58:03.502023+0000","last_clean":"2024-02-17T12:58:03.502023+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:03.502023+0000","last_undegraded":"2024-02-17T12:58:03.502023+0000","last_fullsized":"2024-02-17T12:58:03.502023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436919+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:03.436919+0000","last_peered":"2024-02-17T12:58:03.436919+0000","last_clean":"2024-02-17T12:58:03.436919+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:03.436919+0000","last_undegraded":"2024-02-17T12:58:03.436919+0000","last_fullsized":"2024-02-17T12:58:03.436919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435894+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:03.435894+0000","last_peered":"2024-02-17T12:58:03.435894+0000","last_clean":"2024-02-17T12:58:03.435894+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:03.435894+0000","last_undegraded":"2024-02-17T12:58:03.435894+0000","last_fullsized":"2024-02-17T12:58:03.435894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435863+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:03.435863+0000","last_peered":"2024-02-17T12:58:03.435863+0000","last_clean":"2024-02-17T12:58:03.435863+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:03.435863+0000","last_undegraded":"2024-02-17T12:58:03.435863+0000","last_fullsized":"2024-02-17T12:58:03.435863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435266+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:03.435266+0000","last_peered":"2024-02-17T12:58:03.435266+0000","last_clean":"2024-02-17T12:58:03.435266+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:03.435266+0000","last_undegraded":"2024-02-17T12:58:03.435266+0000","last_fullsized":"2024-02-17T12:58:03.435266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484291+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:03.484291+0000","last_peered":"2024-02-17T12:58:03.484291+0000","last_clean":"2024-02-17T12:58:03.484291+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:03.484291+0000","last_undegraded":"2024-02-17T12:58:03.484291+0000","last_fullsized":"2024-02-17T12:58:03.484291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502079+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:03.502079+0000","last_peered":"2024-02-17T12:58:03.502079+0000","last_clean":"2024-02-17T12:58:03.502079+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:03.502079+0000","last_undegraded":"2024-02-17T12:58:03.502079+0000","last_fullsized":"2024-02-17T12:58:03.502079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483806+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:03.483806+0000","last_peered":"2024-02-17T12:58:03.483806+0000","last_clean":"2024-02-17T12:58:03.483806+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:03.483806+0000","last_undegraded":"2024-02-17T12:58:03.483806+0000","last_fullsized":"2024-02-17T12:58:03.483806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437184+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:03.437184+0000","last_peered":"2024-02-17T12:58:03.437184+0000","last_clean":"2024-02-17T12:58:03.437184+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:03.437184+0000","last_undegraded":"2024-02-17T12:58:03.437184+0000","last_fullsized":"2024-02-17T12:58:03.437184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499359+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:03.499359+0000","last_peered":"2024-02-17T12:58:03.499359+0000","last_clean":"2024-02-17T12:58:03.499359+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:03.499359+0000","last_undegraded":"2024-02-17T12:58:03.499359+0000","last_fullsized":"2024-02-17T12:58:03.499359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483778+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:03.483778+0000","last_peered":"2024-02-17T12:58:03.483778+0000","last_clean":"2024-02-17T12:58:03.483778+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:03.483778+0000","last_undegraded":"2024-02-17T12:58:03.483778+0000","last_fullsized":"2024-02-17T12:58:03.483778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499666+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:03.499666+0000","last_peered":"2024-02-17T12:58:03.499666+0000","last_clean":"2024-02-17T12:58:03.499666+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:03.499666+0000","last_undegraded":"2024-02-17T12:58:03.499666+0000","last_fullsized":"2024-02-17T12:58:03.499666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501191+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:03.501191+0000","last_peered":"2024-02-17T12:58:03.501191+0000","last_clean":"2024-02-17T12:58:03.501191+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:03.501191+0000","last_undegraded":"2024-02-17T12:58:03.501191+0000","last_fullsized":"2024-02-17T12:58:03.501191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484214+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:03.484214+0000","last_peered":"2024-02-17T12:58:03.484214+0000","last_clean":"2024-02-17T12:58:03.484214+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:03.484214+0000","last_undegraded":"2024-02-17T12:58:03.484214+0000","last_fullsized":"2024-02-17T12:58:03.484214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498931+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:03.498931+0000","last_peered":"2024-02-17T12:58:03.498931+0000","last_clean":"2024-02-17T12:58:03.498931+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:03.498931+0000","last_undegraded":"2024-02-17T12:58:03.498931+0000","last_fullsized":"2024-02-17T12:58:03.498931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499103+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:03.499103+0000","last_peered":"2024-02-17T12:58:03.499103+0000","last_clean":"2024-02-17T12:58:03.499103+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:03.499103+0000","last_undegraded":"2024-02-17T12:58:03.499103+0000","last_fullsized":"2024-02-17T12:58:03.499103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484172+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:03.484172+0000","last_peered":"2024-02-17T12:58:03.484172+0000","last_clean":"2024-02-17T12:58:03.484172+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:03.484172+0000","last_undegraded":"2024-02-17T12:58:03.484172+0000","last_fullsized":"2024-02-17T12:58:03.484172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483632+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:03.483632+0000","last_peered":"2024-02-17T12:58:03.483632+0000","last_clean":"2024-02-17T12:58:03.483632+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:03.483632+0000","last_undegraded":"2024-02-17T12:58:03.483632+0000","last_fullsized":"2024-02-17T12:58:03.483632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500896+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:03.500896+0000","last_peered":"2024-02-17T12:58:03.500896+0000","last_clean":"2024-02-17T12:58:03.500896+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:03.500896+0000","last_undegraded":"2024-02-17T12:58:03.500896+0000","last_fullsized":"2024-02-17T12:58:03.500896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499634+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:03.499634+0000","last_peered":"2024-02-17T12:58:03.499634+0000","last_clean":"2024-02-17T12:58:03.499634+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:03.499634+0000","last_undegraded":"2024-02-17T12:58:03.499634+0000","last_fullsized":"2024-02-17T12:58:03.499634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435529+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:03.435529+0000","last_peered":"2024-02-17T12:58:03.435529+0000","last_clean":"2024-02-17T12:58:03.435529+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:03.435529+0000","last_undegraded":"2024-02-17T12:58:03.435529+0000","last_fullsized":"2024-02-17T12:58:03.435529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501502+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:03.501502+0000","last_peered":"2024-02-17T12:58:03.501502+0000","last_clean":"2024-02-17T12:58:03.501502+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:03.501502+0000","last_undegraded":"2024-02-17T12:58:03.501502+0000","last_fullsized":"2024-02-17T12:58:03.501502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500133+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:03.500133+0000","last_peered":"2024-02-17T12:58:03.500133+0000","last_clean":"2024-02-17T12:58:03.500133+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:03.500133+0000","last_undegraded":"2024-02-17T12:58:03.500133+0000","last_fullsized":"2024-02-17T12:58:03.500133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502017+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:03.502017+0000","last_peered":"2024-02-17T12:58:03.502017+0000","last_clean":"2024-02-17T12:58:03.502017+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:03.502017+0000","last_undegraded":"2024-02-17T12:58:03.502017+0000","last_fullsized":"2024-02-17T12:58:03.502017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501901+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:03.501901+0000","last_peered":"2024-02-17T12:58:03.501901+0000","last_clean":"2024-02-17T12:58:03.501901+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:03.501901+0000","last_undegraded":"2024-02-17T12:58:03.501901+0000","last_fullsized":"2024-02-17T12:58:03.501901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484366+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:03.484366+0000","last_peered":"2024-02-17T12:58:03.484366+0000","last_clean":"2024-02-17T12:58:03.484366+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:03.484366+0000","last_undegraded":"2024-02-17T12:58:03.484366+0000","last_fullsized":"2024-02-17T12:58:03.484366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436978+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:03.436978+0000","last_peered":"2024-02-17T12:58:03.436978+0000","last_clean":"2024-02-17T12:58:03.436978+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:03.436978+0000","last_undegraded":"2024-02-17T12:58:03.436978+0000","last_fullsized":"2024-02-17T12:58:03.436978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500930+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:03.500930+0000","last_peered":"2024-02-17T12:58:03.500930+0000","last_clean":"2024-02-17T12:58:03.500930+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:03.500930+0000","last_undegraded":"2024-02-17T12:58:03.500930+0000","last_fullsized":"2024-02-17T12:58:03.500930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499456+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:03.499456+0000","last_peered":"2024-02-17T12:58:03.499456+0000","last_clean":"2024-02-17T12:58:03.499456+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:03.499456+0000","last_undegraded":"2024-02-17T12:58:03.499456+0000","last_fullsized":"2024-02-17T12:58:03.499456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499570+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:03.499570+0000","last_peered":"2024-02-17T12:58:03.499570+0000","last_clean":"2024-02-17T12:58:03.499570+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:03.499570+0000","last_undegraded":"2024-02-17T12:58:03.499570+0000","last_fullsized":"2024-02-17T12:58:03.499570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500482+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:03.500482+0000","last_peered":"2024-02-17T12:58:03.500482+0000","last_clean":"2024-02-17T12:58:03.500482+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:03.500482+0000","last_undegraded":"2024-02-17T12:58:03.500482+0000","last_fullsized":"2024-02-17T12:58:03.500482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435751+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:03.435751+0000","last_peered":"2024-02-17T12:58:03.435751+0000","last_clean":"2024-02-17T12:58:03.435751+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:03.435751+0000","last_undegraded":"2024-02-17T12:58:03.435751+0000","last_fullsized":"2024-02-17T12:58:03.435751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500345+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:03.500345+0000","last_peered":"2024-02-17T12:58:03.500345+0000","last_clean":"2024-02-17T12:58:03.500345+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:03.500345+0000","last_undegraded":"2024-02-17T12:58:03.500345+0000","last_fullsized":"2024-02-17T12:58:03.500345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437483+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:03.437483+0000","last_peered":"2024-02-17T12:58:03.437483+0000","last_clean":"2024-02-17T12:58:03.437483+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:03.437483+0000","last_undegraded":"2024-02-17T12:58:03.437483+0000","last_fullsized":"2024-02-17T12:58:03.437483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501285+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:03.501285+0000","last_peered":"2024-02-17T12:58:03.501285+0000","last_clean":"2024-02-17T12:58:03.501285+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:03.501285+0000","last_undegraded":"2024-02-17T12:58:03.501285+0000","last_fullsized":"2024-02-17T12:58:03.501285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499393+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:03.499393+0000","last_peered":"2024-02-17T12:58:03.499393+0000","last_clean":"2024-02-17T12:58:03.499393+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:03.499393+0000","last_undegraded":"2024-02-17T12:58:03.499393+0000","last_fullsized":"2024-02-17T12:58:03.499393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501697+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:03.501697+0000","last_peered":"2024-02-17T12:58:03.501697+0000","last_clean":"2024-02-17T12:58:03.501697+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:03.501697+0000","last_undegraded":"2024-02-17T12:58:03.501697+0000","last_fullsized":"2024-02-17T12:58:03.501697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:29.720075+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:29.720075+0000","last_peered":"2024-02-17T12:58:29.720075+0000","last_clean":"2024-02-17T12:58:29.720075+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:29.720075+0000","last_undegraded":"2024-02-17T12:58:29.720075+0000","last_fullsized":"2024-02-17T12:58:29.720075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499979+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:03.499979+0000","last_peered":"2024-02-17T12:58:03.499979+0000","last_clean":"2024-02-17T12:58:03.499979+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:03.499979+0000","last_undegraded":"2024-02-17T12:58:03.499979+0000","last_fullsized":"2024-02-17T12:58:03.499979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499132+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:03.499132+0000","last_peered":"2024-02-17T12:58:03.499132+0000","last_clean":"2024-02-17T12:58:03.499132+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:03.499132+0000","last_undegraded":"2024-02-17T12:58:03.499132+0000","last_fullsized":"2024-02-17T12:58:03.499132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499536+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:03.499536+0000","last_peered":"2024-02-17T12:58:03.499536+0000","last_clean":"2024-02-17T12:58:03.499536+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:03.499536+0000","last_undegraded":"2024-02-17T12:58:03.499536+0000","last_fullsized":"2024-02-17T12:58:03.499536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499993+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:03.499993+0000","last_peered":"2024-02-17T12:58:03.499993+0000","last_clean":"2024-02-17T12:58:03.499993+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:03.499993+0000","last_undegraded":"2024-02-17T12:58:03.499993+0000","last_fullsized":"2024-02-17T12:58:03.499993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501326+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:03.501326+0000","last_peered":"2024-02-17T12:58:03.501326+0000","last_clean":"2024-02-17T12:58:03.501326+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:03.501326+0000","last_undegraded":"2024-02-17T12:58:03.501326+0000","last_fullsized":"2024-02-17T12:58:03.501326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501120+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:03.501120+0000","last_peered":"2024-02-17T12:58:03.501120+0000","last_clean":"2024-02-17T12:58:03.501120+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:03.501120+0000","last_undegraded":"2024-02-17T12:58:03.501120+0000","last_fullsized":"2024-02-17T12:58:03.501120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484156+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:03.484156+0000","last_peered":"2024-02-17T12:58:03.484156+0000","last_clean":"2024-02-17T12:58:03.484156+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:03.484156+0000","last_undegraded":"2024-02-17T12:58:03.484156+0000","last_fullsized":"2024-02-17T12:58:03.484156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483876+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:03.483876+0000","last_peered":"2024-02-17T12:58:03.483876+0000","last_clean":"2024-02-17T12:58:03.483876+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:03.483876+0000","last_undegraded":"2024-02-17T12:58:03.483876+0000","last_fullsized":"2024-02-17T12:58:03.483876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499942+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:03.499942+0000","last_peered":"2024-02-17T12:58:03.499942+0000","last_clean":"2024-02-17T12:58:03.499942+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:03.499942+0000","last_undegraded":"2024-02-17T12:58:03.499942+0000","last_fullsized":"2024-02-17T12:58:03.499942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501859+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:03.501859+0000","last_peered":"2024-02-17T12:58:03.501859+0000","last_clean":"2024-02-17T12:58:03.501859+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:03.501859+0000","last_undegraded":"2024-02-17T12:58:03.501859+0000","last_fullsized":"2024-02-17T12:58:03.501859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500616+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:03.500616+0000","last_peered":"2024-02-17T12:58:03.500616+0000","last_clean":"2024-02-17T12:58:03.500616+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:03.500616+0000","last_undegraded":"2024-02-17T12:58:03.500616+0000","last_fullsized":"2024-02-17T12:58:03.500616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:18.892914+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:18.892914+0000","last_peered":"2024-02-17T12:58:18.892914+0000","last_clean":"2024-02-17T12:58:18.892914+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:18.892914+0000","last_undegraded":"2024-02-17T12:58:18.892914+0000","last_fullsized":"2024-02-17T12:58:18.892914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435435+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:03.435435+0000","last_peered":"2024-02-17T12:58:03.435435+0000","last_clean":"2024-02-17T12:58:03.435435+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:03.435435+0000","last_undegraded":"2024-02-17T12:58:03.435435+0000","last_fullsized":"2024-02-17T12:58:03.435435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501617+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:03.501617+0000","last_peered":"2024-02-17T12:58:03.501617+0000","last_clean":"2024-02-17T12:58:03.501617+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:03.501617+0000","last_undegraded":"2024-02-17T12:58:03.501617+0000","last_fullsized":"2024-02-17T12:58:03.501617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499400+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:03.499400+0000","last_peered":"2024-02-17T12:58:03.499400+0000","last_clean":"2024-02-17T12:58:03.499400+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:03.499400+0000","last_undegraded":"2024-02-17T12:58:03.499400+0000","last_fullsized":"2024-02-17T12:58:03.499400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.436993+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:03.436993+0000","last_peered":"2024-02-17T12:58:03.436993+0000","last_clean":"2024-02-17T12:58:03.436993+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:03.436993+0000","last_undegraded":"2024-02-17T12:58:03.436993+0000","last_fullsized":"2024-02-17T12:58:03.436993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499802+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:03.499802+0000","last_peered":"2024-02-17T12:58:03.499802+0000","last_clean":"2024-02-17T12:58:03.499802+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:03.499802+0000","last_undegraded":"2024-02-17T12:58:03.499802+0000","last_fullsized":"2024-02-17T12:58:03.499802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500396+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:03.500396+0000","last_peered":"2024-02-17T12:58:03.500396+0000","last_clean":"2024-02-17T12:58:03.500396+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:03.500396+0000","last_undegraded":"2024-02-17T12:58:03.500396+0000","last_fullsized":"2024-02-17T12:58:03.500396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498874+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:03.498874+0000","last_peered":"2024-02-17T12:58:03.498874+0000","last_clean":"2024-02-17T12:58:03.498874+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:03.498874+0000","last_undegraded":"2024-02-17T12:58:03.498874+0000","last_fullsized":"2024-02-17T12:58:03.498874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437473+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:03.437473+0000","last_peered":"2024-02-17T12:58:03.437473+0000","last_clean":"2024-02-17T12:58:03.437473+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:03.437473+0000","last_undegraded":"2024-02-17T12:58:03.437473+0000","last_fullsized":"2024-02-17T12:58:03.437473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499697+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:03.499697+0000","last_peered":"2024-02-17T12:58:03.499697+0000","last_clean":"2024-02-17T12:58:03.499697+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:03.499697+0000","last_undegraded":"2024-02-17T12:58:03.499697+0000","last_fullsized":"2024-02-17T12:58:03.499697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435402+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:03.435402+0000","last_peered":"2024-02-17T12:58:03.435402+0000","last_clean":"2024-02-17T12:58:03.435402+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:03.435402+0000","last_undegraded":"2024-02-17T12:58:03.435402+0000","last_fullsized":"2024-02-17T12:58:03.435402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435623+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:03.435623+0000","last_peered":"2024-02-17T12:58:03.435623+0000","last_clean":"2024-02-17T12:58:03.435623+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:03.435623+0000","last_undegraded":"2024-02-17T12:58:03.435623+0000","last_fullsized":"2024-02-17T12:58:03.435623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435454+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:03.435454+0000","last_peered":"2024-02-17T12:58:03.435454+0000","last_clean":"2024-02-17T12:58:03.435454+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:03.435454+0000","last_undegraded":"2024-02-17T12:58:03.435454+0000","last_fullsized":"2024-02-17T12:58:03.435454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500806+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:03.500806+0000","last_peered":"2024-02-17T12:58:03.500806+0000","last_clean":"2024-02-17T12:58:03.500806+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:03.500806+0000","last_undegraded":"2024-02-17T12:58:03.500806+0000","last_fullsized":"2024-02-17T12:58:03.500806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501656+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:03.501656+0000","last_peered":"2024-02-17T12:58:03.501656+0000","last_clean":"2024-02-17T12:58:03.501656+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:03.501656+0000","last_undegraded":"2024-02-17T12:58:03.501656+0000","last_fullsized":"2024-02-17T12:58:03.501656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499126+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:03.499126+0000","last_peered":"2024-02-17T12:58:03.499126+0000","last_clean":"2024-02-17T12:58:03.499126+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:03.499126+0000","last_undegraded":"2024-02-17T12:58:03.499126+0000","last_fullsized":"2024-02-17T12:58:03.499126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483654+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:03.483654+0000","last_peered":"2024-02-17T12:58:03.483654+0000","last_clean":"2024-02-17T12:58:03.483654+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:03.483654+0000","last_undegraded":"2024-02-17T12:58:03.483654+0000","last_fullsized":"2024-02-17T12:58:03.483654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501100+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:03.501100+0000","last_peered":"2024-02-17T12:58:03.501100+0000","last_clean":"2024-02-17T12:58:03.501100+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:03.501100+0000","last_undegraded":"2024-02-17T12:58:03.501100+0000","last_fullsized":"2024-02-17T12:58:03.501100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435901+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:03.435901+0000","last_peered":"2024-02-17T12:58:03.435901+0000","last_clean":"2024-02-17T12:58:03.435901+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:03.435901+0000","last_undegraded":"2024-02-17T12:58:03.435901+0000","last_fullsized":"2024-02-17T12:58:03.435901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435463+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:03.435463+0000","last_peered":"2024-02-17T12:58:03.435463+0000","last_clean":"2024-02-17T12:58:03.435463+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:03.435463+0000","last_undegraded":"2024-02-17T12:58:03.435463+0000","last_fullsized":"2024-02-17T12:58:03.435463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499774+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:03.499774+0000","last_peered":"2024-02-17T12:58:03.499774+0000","last_clean":"2024-02-17T12:58:03.499774+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:03.499774+0000","last_undegraded":"2024-02-17T12:58:03.499774+0000","last_fullsized":"2024-02-17T12:58:03.499774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499747+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:03.499747+0000","last_peered":"2024-02-17T12:58:03.499747+0000","last_clean":"2024-02-17T12:58:03.499747+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:03.499747+0000","last_undegraded":"2024-02-17T12:58:03.499747+0000","last_fullsized":"2024-02-17T12:58:03.499747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499185+0000","last_change":"2024-02-17T12:58:02.535095+0000","last_active":"2024-02-17T12:58:03.499185+0000","last_peered":"2024-02-17T12:58:03.499185+0000","last_clean":"2024-02-17T12:58:03.499185+0000","last_became_active":"2024-02-17T12:58:02.534718+0000","last_became_peered":"2024-02-17T12:58:02.534718+0000","last_unstale":"2024-02-17T12:58:03.499185+0000","last_undegraded":"2024-02-17T12:58:03.499185+0000","last_fullsized":"2024-02-17T12:58:03.499185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:43.813403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437040+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:03.437040+0000","last_peered":"2024-02-17T12:58:03.437040+0000","last_clean":"2024-02-17T12:58:03.437040+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:03.437040+0000","last_undegraded":"2024-02-17T12:58:03.437040+0000","last_fullsized":"2024-02-17T12:58:03.437040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499018+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:03.499018+0000","last_peered":"2024-02-17T12:58:03.499018+0000","last_clean":"2024-02-17T12:58:03.499018+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:03.499018+0000","last_undegraded":"2024-02-17T12:58:03.499018+0000","last_fullsized":"2024-02-17T12:58:03.499018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500940+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:03.500940+0000","last_peered":"2024-02-17T12:58:03.500940+0000","last_clean":"2024-02-17T12:58:03.500940+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:03.500940+0000","last_undegraded":"2024-02-17T12:58:03.500940+0000","last_fullsized":"2024-02-17T12:58:03.500940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499659+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:03.499659+0000","last_peered":"2024-02-17T12:58:03.499659+0000","last_clean":"2024-02-17T12:58:03.499659+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:03.499659+0000","last_undegraded":"2024-02-17T12:58:03.499659+0000","last_fullsized":"2024-02-17T12:58:03.499659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.484252+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:03.484252+0000","last_peered":"2024-02-17T12:58:03.484252+0000","last_clean":"2024-02-17T12:58:03.484252+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:03.484252+0000","last_undegraded":"2024-02-17T12:58:03.484252+0000","last_fullsized":"2024-02-17T12:58:03.484252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483899+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:03.483899+0000","last_peered":"2024-02-17T12:58:03.483899+0000","last_clean":"2024-02-17T12:58:03.483899+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:03.483899+0000","last_undegraded":"2024-02-17T12:58:03.483899+0000","last_fullsized":"2024-02-17T12:58:03.483899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437387+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:03.437387+0000","last_peered":"2024-02-17T12:58:03.437387+0000","last_clean":"2024-02-17T12:58:03.437387+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:03.437387+0000","last_undegraded":"2024-02-17T12:58:03.437387+0000","last_fullsized":"2024-02-17T12:58:03.437387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499562+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:03.499562+0000","last_peered":"2024-02-17T12:58:03.499562+0000","last_clean":"2024-02-17T12:58:03.499562+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:03.499562+0000","last_undegraded":"2024-02-17T12:58:03.499562+0000","last_fullsized":"2024-02-17T12:58:03.499562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500719+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:03.500719+0000","last_peered":"2024-02-17T12:58:03.500719+0000","last_clean":"2024-02-17T12:58:03.500719+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:03.500719+0000","last_undegraded":"2024-02-17T12:58:03.500719+0000","last_fullsized":"2024-02-17T12:58:03.500719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499128+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:03.499128+0000","last_peered":"2024-02-17T12:58:03.499128+0000","last_clean":"2024-02-17T12:58:03.499128+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:03.499128+0000","last_undegraded":"2024-02-17T12:58:03.499128+0000","last_fullsized":"2024-02-17T12:58:03.499128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499663+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:03.499663+0000","last_peered":"2024-02-17T12:58:03.499663+0000","last_clean":"2024-02-17T12:58:03.499663+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:03.499663+0000","last_undegraded":"2024-02-17T12:58:03.499663+0000","last_fullsized":"2024-02-17T12:58:03.499663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.435719+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:03.435719+0000","last_peered":"2024-02-17T12:58:03.435719+0000","last_clean":"2024-02-17T12:58:03.435719+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:03.435719+0000","last_undegraded":"2024-02-17T12:58:03.435719+0000","last_fullsized":"2024-02-17T12:58:03.435719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500074+0000","last_change":"2024-02-17T12:57:57.772384+0000","last_active":"2024-02-17T12:58:03.500074+0000","last_peered":"2024-02-17T12:58:03.500074+0000","last_clean":"2024-02-17T12:58:03.500074+0000","last_became_active":"2024-02-17T12:57:57.771936+0000","last_became_peered":"2024-02-17T12:57:57.771936+0000","last_unstale":"2024-02-17T12:58:03.500074+0000","last_undegraded":"2024-02-17T12:58:03.500074+0000","last_fullsized":"2024-02-17T12:58:03.500074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.502000+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:03.502000+0000","last_peered":"2024-02-17T12:58:03.502000+0000","last_clean":"2024-02-17T12:58:03.502000+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:03.502000+0000","last_undegraded":"2024-02-17T12:58:03.502000+0000","last_fullsized":"2024-02-17T12:58:03.502000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499724+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:03.499724+0000","last_peered":"2024-02-17T12:58:03.499724+0000","last_clean":"2024-02-17T12:58:03.499724+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:03.499724+0000","last_undegraded":"2024-02-17T12:58:03.499724+0000","last_fullsized":"2024-02-17T12:58:03.499724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.501981+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:03.501981+0000","last_peered":"2024-02-17T12:58:03.501981+0000","last_clean":"2024-02-17T12:58:03.501981+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:03.501981+0000","last_undegraded":"2024-02-17T12:58:03.501981+0000","last_fullsized":"2024-02-17T12:58:03.501981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500633+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:03.500633+0000","last_peered":"2024-02-17T12:58:03.500633+0000","last_clean":"2024-02-17T12:58:03.500633+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:03.500633+0000","last_undegraded":"2024-02-17T12:58:03.500633+0000","last_fullsized":"2024-02-17T12:58:03.500633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499030+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:03.499030+0000","last_peered":"2024-02-17T12:58:03.499030+0000","last_clean":"2024-02-17T12:58:03.499030+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:03.499030+0000","last_undegraded":"2024-02-17T12:58:03.499030+0000","last_fullsized":"2024-02-17T12:58:03.499030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483746+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:03.483746+0000","last_peered":"2024-02-17T12:58:03.483746+0000","last_clean":"2024-02-17T12:58:03.483746+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:03.483746+0000","last_undegraded":"2024-02-17T12:58:03.483746+0000","last_fullsized":"2024-02-17T12:58:03.483746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.483901+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:03.483901+0000","last_peered":"2024-02-17T12:58:03.483901+0000","last_clean":"2024-02-17T12:58:03.483901+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:03.483901+0000","last_undegraded":"2024-02-17T12:58:03.483901+0000","last_fullsized":"2024-02-17T12:58:03.483901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500055+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:03.500055+0000","last_peered":"2024-02-17T12:58:03.500055+0000","last_clean":"2024-02-17T12:58:03.500055+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:03.500055+0000","last_undegraded":"2024-02-17T12:58:03.500055+0000","last_fullsized":"2024-02-17T12:58:03.500055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500899+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:03.500899+0000","last_peered":"2024-02-17T12:58:03.500899+0000","last_clean":"2024-02-17T12:58:03.500899+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:03.500899+0000","last_undegraded":"2024-02-17T12:58:03.500899+0000","last_fullsized":"2024-02-17T12:58:03.500899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500012+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:03.500012+0000","last_peered":"2024-02-17T12:58:03.500012+0000","last_clean":"2024-02-17T12:58:03.500012+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:03.500012+0000","last_undegraded":"2024-02-17T12:58:03.500012+0000","last_fullsized":"2024-02-17T12:58:03.500012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499612+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:03.499612+0000","last_peered":"2024-02-17T12:58:03.499612+0000","last_clean":"2024-02-17T12:58:03.499612+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:03.499612+0000","last_undegraded":"2024-02-17T12:58:03.499612+0000","last_fullsized":"2024-02-17T12:58:03.499612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.498813+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:03.498813+0000","last_peered":"2024-02-17T12:58:03.498813+0000","last_clean":"2024-02-17T12:58:03.498813+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:03.498813+0000","last_undegraded":"2024-02-17T12:58:03.498813+0000","last_fullsized":"2024-02-17T12:58:03.498813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499532+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:03.499532+0000","last_peered":"2024-02-17T12:58:03.499532+0000","last_clean":"2024-02-17T12:58:03.499532+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:03.499532+0000","last_undegraded":"2024-02-17T12:58:03.499532+0000","last_fullsized":"2024-02-17T12:58:03.499532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437096+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:03.437096+0000","last_peered":"2024-02-17T12:58:03.437096+0000","last_clean":"2024-02-17T12:58:03.437096+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:03.437096+0000","last_undegraded":"2024-02-17T12:58:03.437096+0000","last_fullsized":"2024-02-17T12:58:03.437096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499732+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:03.499732+0000","last_peered":"2024-02-17T12:58:03.499732+0000","last_clean":"2024-02-17T12:58:03.499732+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:03.499732+0000","last_undegraded":"2024-02-17T12:58:03.499732+0000","last_fullsized":"2024-02-17T12:58:03.499732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.437140+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:03.437140+0000","last_peered":"2024-02-17T12:58:03.437140+0000","last_clean":"2024-02-17T12:58:03.437140+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:03.437140+0000","last_undegraded":"2024-02-17T12:58:03.437140+0000","last_fullsized":"2024-02-17T12:58:03.437140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499291+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:03.499291+0000","last_peered":"2024-02-17T12:58:03.499291+0000","last_clean":"2024-02-17T12:58:03.499291+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:03.499291+0000","last_undegraded":"2024-02-17T12:58:03.499291+0000","last_fullsized":"2024-02-17T12:58:03.499291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.499819+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:03.499819+0000","last_peered":"2024-02-17T12:58:03.499819+0000","last_clean":"2024-02-17T12:58:03.499819+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:03.499819+0000","last_undegraded":"2024-02-17T12:58:03.499819+0000","last_fullsized":"2024-02-17T12:58:03.499819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-02-17T12:58:03.500208+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:03.500208+0000","last_peered":"2024-02-17T12:58:03.500208+0000","last_clean":"2024-02-17T12:58:03.500208+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:03.500208+0000","last_undegraded":"2024-02-17T12:58:03.500208+0000","last_fullsized":"2024-02-17T12:58:03.500208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4730,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":10064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":100388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":100846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:33.295 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:58:33.295 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-17T12:58:33.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-17T12:58:33.295 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-17T12:58:33.296 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-17T12:58:33.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 Processor -- start 2024-02-17T12:58:33.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 -- start start 2024-02-17T12:58:33.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8828157450 0x7f8828159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f882806bbd0 0x7f8828070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882806cd20 con 0x7f8828157450 2024-02-17T12:58:33.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882806c6f0 con 0x7f882806bbd0 2024-02-17T12:58:33.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.466+0000 7f882ea2e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882815d320 con 0x7f88280c7e30 2024-02-17T12:58:33.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.467+0000 7f8827fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8828157450 0x7f8828159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.467+0000 7f882cfcb640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f882806bbd0 0x7f8828070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.467+0000 7f88277fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.467+0000 7f8827fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8828157450 0x7f8828159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50178/0 (socket says 172.21.15.136:50178) 2024-02-17T12:58:33.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.467+0000 7f8827fff640 1 -- 172.21.15.136:0/3097616705 learned_addr learned my addr 172.21.15.136:0/3097616705 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:33.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.470+0000 7f8827fff640 1 -- 172.21.15.136:0/3097616705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 msgr2=0x7f8828070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:33.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.470+0000 7f8827fff640 1 --2- 172.21.15.136:0/3097616705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.470+0000 7f8827fff640 1 -- 172.21.15.136:0/3097616705 >> v2:172.21.15.160:3300/0 conn(0x7f882806bbd0 msgr2=0x7f8828070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:33.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.470+0000 7f8827fff640 1 --2- 172.21.15.136:0/3097616705 >> v2:172.21.15.160:3300/0 conn(0x7f882806bbd0 0x7f8828070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.470+0000 7f8827fff640 1 -- 172.21.15.136:0/3097616705 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828157830 con 0x7f8828157450 2024-02-17T12:58:33.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.471+0000 7f8827fff640 1 --2- 172.21.15.136:0/3097616705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828159db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88280c94d0 tx=0x7f881c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ab9bee1c672ef6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:33.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.475+0000 7f8826ffd640 1 -- 172.21.15.136:0/3097616705 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0317e0 con 0x7f8828157450 2024-02-17T12:58:33.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.475+0000 7f8826ffd640 1 -- 172.21.15.136:0/3097616705 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c031940 con 0x7f8828157450 2024-02-17T12:58:33.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.475+0000 7f8826ffd640 1 -- 172.21.15.136:0/3097616705 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c031cd0 con 0x7f8828157450 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 -- 172.21.15.136:0/3097616705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 msgr2=0x7f8828159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 --2- 172.21.15.136:0/3097616705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828159db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88280c94d0 tx=0x7f881c02b880 comp rx=0 tx=0).stop 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 -- 172.21.15.136:0/3097616705 shutdown_connections 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 --2- 172.21.15.136:0/3097616705 >> v2:172.21.15.160:3300/0 conn(0x7f882806bbd0 0x7f8828070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 --2- 172.21.15.136:0/3097616705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 --2- 172.21.15.136:0/3097616705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828159db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 -- 172.21.15.136:0/3097616705 >> 172.21.15.136:0/3097616705 conn(0x7f882806fe80 msgr2=0x7f882806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 -- 172.21.15.136:0/3097616705 shutdown_connections 2024-02-17T12:58:33.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.476+0000 7f882ea2e640 1 -- 172.21.15.136:0/3097616705 wait complete. 2024-02-17T12:58:33.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.478+0000 7f882ea2e640 1 Processor -- start 2024-02-17T12:58:33.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.478+0000 7f882ea2e640 1 -- start start 2024-02-17T12:58:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882ea2e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882806bbd0 0x7f88280cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882ea2e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882ea2e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882ea2e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88281e5610 con 0x7f8828157450 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882ea2e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280cbde0 con 0x7f882806bbd0 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882ea2e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c71c0 con 0x7f88280c7e30 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882cfcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f88277fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f8827fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882806bbd0 0x7f88280cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882cfcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50186/0 (socket says 172.21.15.136:50186) 2024-02-17T12:58:33.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.479+0000 7f882cfcb640 1 -- 172.21.15.136:0/1851536718 learned_addr learned my addr 172.21.15.136:0/1851536718 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:33.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.483+0000 7f882cfcb640 1 -- 172.21.15.136:0/1851536718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 msgr2=0x7f8828155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:33.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.483+0000 7f882cfcb640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.483+0000 7f882cfcb640 1 -- 172.21.15.136:0/1851536718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882806bbd0 msgr2=0x7f88280cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:33.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.483+0000 7f882cfcb640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882806bbd0 0x7f88280cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:33.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.483+0000 7f882cfcb640 1 -- 172.21.15.136:0/1851536718 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c0094d0 con 0x7f8828157450 2024-02-17T12:58:33.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.485+0000 7f882cfcb640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828155640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f882000eed0 tx=0x7f882000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:33.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.489+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820010040 con 0x7f8828157450 2024-02-17T12:58:33.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.489+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820014400 con 0x7f8828157450 2024-02-17T12:58:33.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.489+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88280cb4e0 con 0x7f8828157450 2024-02-17T12:58:33.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.489+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200147b0 con 0x7f8828157450 2024-02-17T12:58:33.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.489+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88281f2a30 con 0x7f8828157450 2024-02-17T12:58:33.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.490+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88280cba00 con 0x7f8828157450 2024-02-17T12:58:33.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.737+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8820014910 con 0x7f8828157450 2024-02-17T12:58:33.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.737+0000 7f8824ff9640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f881406b860 0x7f881406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:33.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.738+0000 7f8827fff640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f881406b860 0x7f881406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:33.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.738+0000 7f8827fff640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f881406b860 0x7f881406dd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f881c036000 tx=0x7f881c03d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:33.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.751+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f88200597f0 con 0x7f8828157450 2024-02-17T12:58:33.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.751+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8820055a90 con 0x7f8828157450 2024-02-17T12:58:33.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:33.983+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f88280cba00 con 0x7f8828157450 2024-02-17T12:58:34.109 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.118+0000 7f8824ff9640 1 -- 172.21.15.136:0/1851536718 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171799 (secure 0 0 0) 0x7f88280cba00 con 0x7f8828157450 2024-02-17T12:58:34.111 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f881406b860 msgr2=0x7f881406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f881406b860 0x7f881406dd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f881c036000 tx=0x7f881c03d040 comp rx=0 tx=0).stop 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 msgr2=0x7f8828155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828155640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f882000eed0 tx=0x7f882000b480 comp rx=0 tx=0).stop 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 shutdown_connections 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f881406b860 0x7f881406dd20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8828157450 0x7f8828155640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88280c7e30 0x7f8828155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 --2- 172.21.15.136:0/1851536718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882806bbd0 0x7f88280cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 >> 172.21.15.136:0/1851536718 conn(0x7f882806fe80 msgr2=0x7f88280c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.121+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 shutdown_connections 2024-02-17T12:58:34.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.122+0000 7f882ea2e640 1 -- 172.21.15.136:0/1851536718 wait complete. 2024-02-17T12:58:34.123 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":5,"flags":0,"active_gid":4117,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":451441740},{"type":"v1","addr":"172.21.15.136:6833","nonce":451441740}]},"active_addr":"172.21.15.136:6833/451441740","active_change":"2024-02-17T12:57:33.611311+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":3769267311}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1816724218}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":2730371779}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":3372206936}]}]} 2024-02-17T12:58:34.126 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-17T12:58:34.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-17T12:58:34.127 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:34.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.245+0000 7f93ca4f4640 1 Processor -- start 2024-02-17T12:58:34.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.245+0000 7f93ca4f4640 1 -- start start 2024-02-17T12:58:34.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.246+0000 7f93ca4f4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93c40ca090 0x7f93c40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.246+0000 7f93ca4f4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93c41573e0 0x7f93c415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.246+0000 7f93ca4f4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40c3690 con 0x7f93c4150b50 2024-02-17T12:58:34.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.246+0000 7f93ca4f4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c4159f50 con 0x7f93c40ca090 2024-02-17T12:58:34.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.246+0000 7f93ca4f4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c4157870 con 0x7f93c41573e0 2024-02-17T12:58:34.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.252+0000 7f93c8a91640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93c41573e0 0x7f93c415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.252+0000 7f93c8a91640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93c41573e0 0x7f93c415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59068/0 (socket says 172.21.15.136:59068) 2024-02-17T12:58:34.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.252+0000 7f93c8a91640 1 -- 172.21.15.136:0/1543215329 learned_addr learned my addr 172.21.15.136:0/1543215329 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:34.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.256+0000 7f93c8a91640 1 -- 172.21.15.136:0/1543215329 >> v2:172.21.15.136:3300/0 conn(0x7f93c40ca090 msgr2=0x7f93c40726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:34.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.256+0000 7f93c8a91640 1 --2- 172.21.15.136:0/1543215329 >> v2:172.21.15.136:3300/0 conn(0x7f93c40ca090 0x7f93c40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.256+0000 7f93c8a91640 1 -- 172.21.15.136:0/1543215329 >> v1:172.21.15.160:6789/0 conn(0x7f93c4150b50 legacy=0x7f93c40c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:34.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.256+0000 7f93c8a91640 1 -- 172.21.15.136:0/1543215329 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40c38e0 con 0x7f93c41573e0 2024-02-17T12:58:34.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.260+0000 7f93c8a91640 1 --2- 172.21.15.136:0/1543215329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c41573e0 0x7f93c415a3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93c40717d0 tx=0x7f93bc02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4364a609fc44b8f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:34.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.262+0000 7f93c2ffd640 1 -- 172.21.15.136:0/1543215329 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc02ca80 con 0x7f93c41573e0 2024-02-17T12:58:34.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.263+0000 7f93c2ffd640 1 -- 172.21.15.136:0/1543215329 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc02cbe0 con 0x7f93c41573e0 2024-02-17T12:58:34.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.263+0000 7f93c2ffd640 1 -- 172.21.15.136:0/1543215329 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0343f0 con 0x7f93c41573e0 2024-02-17T12:58:34.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 -- 172.21.15.136:0/1543215329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c41573e0 msgr2=0x7f93c415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/1543215329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c41573e0 0x7f93c415a3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93c40717d0 tx=0x7f93bc02bee0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 -- 172.21.15.136:0/1543215329 shutdown_connections 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/1543215329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c41573e0 0x7f93c415a3e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/1543215329 >> v2:172.21.15.136:3300/0 conn(0x7f93c40ca090 0x7f93c40726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 -- 172.21.15.136:0/1543215329 >> 172.21.15.136:0/1543215329 conn(0x7f93c406bbd0 msgr2=0x7f93c406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 -- 172.21.15.136:0/1543215329 shutdown_connections 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.264+0000 7f93ca4f4640 1 -- 172.21.15.136:0/1543215329 wait complete. 2024-02-17T12:58:34.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.265+0000 7f93ca4f4640 1 Processor -- start 2024-02-17T12:58:34.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 -- start start 2024-02-17T12:58:34.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93c40ca090 0x7f93c414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4150b50 0x7f93c41efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 0x7f93c4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40cb840 con 0x7f93c40ca090 2024-02-17T12:58:34.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c414e8e0 con 0x7f93c4150b50 2024-02-17T12:58:34.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.266+0000 7f93ca4f4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c414d7b0 con 0x7f93c41573e0 2024-02-17T12:58:34.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.267+0000 7f93c8a91640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 0x7f93c4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.267+0000 7f93c8a91640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 0x7f93c4158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39730/0 (socket says 172.21.15.136:39730) 2024-02-17T12:58:34.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.267+0000 7f93c8a91640 1 -- 172.21.15.136:0/2854662872 learned_addr learned my addr 172.21.15.136:0/2854662872 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:34.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.269+0000 7f93c37fe640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4150b50 0x7f93c41efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.271+0000 7f93c8a91640 1 -- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4150b50 msgr2=0x7f93c41efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.271+0000 7f93c8a91640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4150b50 0x7f93c41efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.271+0000 7f93c8a91640 1 -- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93c40ca090 msgr2=0x7f93c414e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.271+0000 7f93c8a91640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93c40ca090 0x7f93c414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.271+0000 7f93c8a91640 1 -- 172.21.15.136:0/2854662872 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc009b30 con 0x7f93c41573e0 2024-02-17T12:58:34.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.274+0000 7f93c8a91640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 0x7f93c4158b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02c4f0 tx=0x7f93bc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:34.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.278+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc03e450 con 0x7f93c41573e0 2024-02-17T12:58:34.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.278+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc03e5d0 con 0x7f93c41573e0 2024-02-17T12:58:34.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.278+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc03e980 con 0x7f93c41573e0 2024-02-17T12:58:34.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.278+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c40cbb80 con 0x7f93c41573e0 2024-02-17T12:58:34.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.278+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c40cb290 con 0x7f93c41573e0 2024-02-17T12:58:34.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.279+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c4072d70 con 0x7f93c41573e0 2024-02-17T12:58:34.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.296+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f93bc02cd50 con 0x7f93c41573e0 2024-02-17T12:58:34.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.296+0000 7f93c0ff9640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93b006b860 0x7f93b006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.297+0000 7f93c3fff640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93b006b860 0x7f93b006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.297+0000 7f93c3fff640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93b006b860 0x7f93b006dd20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f93b8003cc0 tx=0x7f93b80079b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:34.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.300+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f93bc07c910 con 0x7f93c41573e0 2024-02-17T12:58:34.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.562+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93bc0784b0 con 0x7f93c41573e0 2024-02-17T12:58:34.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.745+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93c4147af0 con 0x7f93c41573e0 2024-02-17T12:58:34.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.856+0000 7f93c0ff9640 1 -- 172.21.15.136:0/2854662872 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f93bc043020 con 0x7f93c41573e0 2024-02-17T12:58:34.846 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:34.846 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:03.149001+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:34.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.857+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93b006b860 msgr2=0x7f93b006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.857+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93b006b860 0x7f93b006dd20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f93b8003cc0 tx=0x7f93b80079b0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.857+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 msgr2=0x7f93c4158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.857+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 0x7f93c4158b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93bc02c4f0 tx=0x7f93bc004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:34.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.857+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 shutdown_connections 2024-02-17T12:58:34.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.857+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f93b006b860 0x7f93b006dd20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.858+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93c41573e0 0x7f93c4158b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.858+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93c4150b50 0x7f93c41efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.858+0000 7f93ca4f4640 1 --2- 172.21.15.136:0/2854662872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93c40ca090 0x7f93c414e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.858+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 >> 172.21.15.136:0/2854662872 conn(0x7f93c406bbd0 msgr2=0x7f93c414fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:34.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.858+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 shutdown_connections 2024-02-17T12:58:34.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.858+0000 7f93ca4f4640 1 -- 172.21.15.136:0/2854662872 wait complete. 2024-02-17T12:58:34.860 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-17T12:58:34.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:34.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.972+0000 7f53bab3e640 1 Processor -- start 2024-02-17T12:58:34.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.972+0000 7f53bab3e640 1 -- start start 2024-02-17T12:58:34.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53bab3e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f53b4070710 0x7f53b406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53bab3e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b406c260 con 0x7f53b406f4f0 2024-02-17T12:58:34.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53bab3e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b415a1a0 con 0x7f53b406f8d0 2024-02-17T12:58:34.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53bab3e640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b406dbe0 con 0x7f53b4070710 2024-02-17T12:58:34.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53b88da640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f53b406f4f0 0x7f53b4156ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37940/0 (socket says 172.21.15.136:37940) 2024-02-17T12:58:34.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53b88da640 1 -- 172.21.15.136:0/1019277749 learned_addr learned my addr 172.21.15.136:0/1019277749 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:34.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.973+0000 7f53b90db640 1 --2- 172.21.15.136:0/1019277749 >> v2:172.21.15.160:3300/0 conn(0x7f53b4070710 0x7f53b406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.976+0000 7f53b37fe640 1 -- 172.21.15.136:0/1019277749 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374797871 0 0) 0x7f53b406c260 con 0x7f53b406f4f0 2024-02-17T12:58:34.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.976+0000 7f53b37fe640 1 -- 172.21.15.136:0/1019277749 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a4003520 con 0x7f53b406f4f0 2024-02-17T12:58:34.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.976+0000 7f53b90db640 1 -- 172.21.15.136:0/1019277749 >> v1:172.21.15.160:6789/0 conn(0x7f53b406f8d0 legacy=0x7f53b4070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:34.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.976+0000 7f53b90db640 1 -- 172.21.15.136:0/1019277749 >> v1:172.21.15.136:6789/0 conn(0x7f53b406f4f0 legacy=0x7f53b4156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.976+0000 7f53b90db640 1 -- 172.21.15.136:0/1019277749 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b415a480 con 0x7f53b4070710 2024-02-17T12:58:34.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.979+0000 7f53b90db640 1 --2- 172.21.15.136:0/1019277749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b4070710 0x7f53b406bbd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009d90 tx=0x7f53ac02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80635a1b73d62c0a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:34.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.983+0000 7f53b37fe640 1 -- 172.21.15.136:0/1019277749 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac02cd00 con 0x7f53b4070710 2024-02-17T12:58:34.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.983+0000 7f53b37fe640 1 -- 172.21.15.136:0/1019277749 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac02ce60 con 0x7f53b4070710 2024-02-17T12:58:34.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.983+0000 7f53b37fe640 1 -- 172.21.15.136:0/1019277749 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac034660 con 0x7f53b4070710 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 -- 172.21.15.136:0/1019277749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b4070710 msgr2=0x7f53b406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 --2- 172.21.15.136:0/1019277749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b4070710 0x7f53b406bbd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009d90 tx=0x7f53ac02bf50 comp rx=0 tx=0).stop 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 -- 172.21.15.136:0/1019277749 shutdown_connections 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 --2- 172.21.15.136:0/1019277749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b4070710 0x7f53b406bbd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 -- 172.21.15.136:0/1019277749 >> 172.21.15.136:0/1019277749 conn(0x7f53b406b0f0 msgr2=0x7f53b40668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 -- 172.21.15.136:0/1019277749 shutdown_connections 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.984+0000 7f53bab3e640 1 -- 172.21.15.136:0/1019277749 wait complete. 2024-02-17T12:58:34.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.985+0000 7f53bab3e640 1 Processor -- start 2024-02-17T12:58:34.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.985+0000 7f53bab3e640 1 -- start start 2024-02-17T12:58:34.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53bab3e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b406f4f0 0x7f53b40b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53bab3e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b406f8d0 0x7f53b40ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53bab3e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 0x7f53b40ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:34.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53bab3e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c4730 con 0x7f53b4070710 2024-02-17T12:58:34.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53bab3e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40b1280 con 0x7f53b406f8d0 2024-02-17T12:58:34.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53bab3e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40b0fa0 con 0x7f53b406f4f0 2024-02-17T12:58:34.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.986+0000 7f53b90db640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 0x7f53b40ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.987+0000 7f53b3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b406f8d0 0x7f53b40ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.987+0000 7f53b88da640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b406f4f0 0x7f53b40b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:34.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.987+0000 7f53b90db640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 0x7f53b40ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50218/0 (socket says 172.21.15.136:50218) 2024-02-17T12:58:34.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.987+0000 7f53b90db640 1 -- 172.21.15.136:0/3018806411 learned_addr learned my addr 172.21.15.136:0/3018806411 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:34.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.990+0000 7f53b90db640 1 -- 172.21.15.136:0/3018806411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b406f4f0 msgr2=0x7f53b40b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.990+0000 7f53b90db640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b406f4f0 0x7f53b40b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.990+0000 7f53b90db640 1 -- 172.21.15.136:0/3018806411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b406f8d0 msgr2=0x7f53b40ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:34.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.990+0000 7f53b90db640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b406f8d0 0x7f53b40ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:34.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.990+0000 7f53b90db640 1 -- 172.21.15.136:0/3018806411 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009a70 con 0x7f53b4070710 2024-02-17T12:58:34.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.992+0000 7f53b90db640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 0x7f53b40ae790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009eb0 tx=0x7f53ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:34.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.996+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac03e610 con 0x7f53b4070710 2024-02-17T12:58:34.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.996+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac03e770 con 0x7f53b4070710 2024-02-17T12:58:34.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.996+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac03eb00 con 0x7f53b4070710 2024-02-17T12:58:34.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.996+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b40ad970 con 0x7f53b4070710 2024-02-17T12:58:34.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.996+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b41f02e0 con 0x7f53b4070710 2024-02-17T12:58:34.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:34.997+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b40c91e0 con 0x7f53b4070710 2024-02-17T12:58:35.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.015+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f53ac03b050 con 0x7f53b4070710 2024-02-17T12:58:35.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.016+0000 7f53b17fa640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f539806b890 0x7f539806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.016+0000 7f53b88da640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f539806b890 0x7f539806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.016+0000 7f53b88da640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f539806b890 0x7f539806dd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005880 tx=0x7f53a8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.018+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f53ac07b640 con 0x7f53b4070710 2024-02-17T12:58:35.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.258+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53ac0778e0 con 0x7f53b4070710 2024-02-17T12:58:35.351 INFO:tasks.ceph.mds.a.smithi136.stderr:2024-02-17T12:58:35.360+0000 f5e3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-02-17T12:58:35.351 INFO:tasks.ceph.mds.a.smithi136.stderr:2024-02-17T12:58:35.360+0000 f5e3640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-02-17T12:58:35.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.476+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53b4159500 con 0x7f53b4070710 2024-02-17T12:58:35.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.544+0000 7f53b17fa640 1 -- 172.21.15.136:0/3018806411 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f53ac04e070 con 0x7f53b4070710 2024-02-17T12:58:35.536 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:35.536 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":25,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:35.264722+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:35.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.546+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f539806b890 msgr2=0x7f539806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.546+0000 7f53bab3e640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f539806b890 0x7f539806dd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005880 tx=0x7f53a8009040 comp rx=0 tx=0).stop 2024-02-17T12:58:35.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.546+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 msgr2=0x7f53b40ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.546+0000 7f53bab3e640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 0x7f53b40ae790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009eb0 tx=0x7f53ac004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:35.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.546+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 shutdown_connections 2024-02-17T12:58:35.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f539806b890 0x7f539806dd50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b4070710 0x7f53b40ae790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53b406f8d0 0x7f53b40ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 --2- 172.21.15.136:0/3018806411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b406f4f0 0x7f53b40b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 >> 172.21.15.136:0/3018806411 conn(0x7f53b406b0f0 msgr2=0x7f53b40c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 shutdown_connections 2024-02-17T12:58:35.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.547+0000 7f53bab3e640 1 -- 172.21.15.136:0/3018806411 wait complete. 2024-02-17T12:58:35.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-17T12:58:35.551 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-17T12:58:35.552 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-17T12:58:35.552 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-17T12:58:35.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-17T12:58:35.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-17T12:58:35.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-17T12:58:35.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-17T12:58:35.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.742+0000 7f61a21d7640 1 Processor -- start 2024-02-17T12:58:35.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.742+0000 7f61a21d7640 1 -- start start 2024-02-17T12:58:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.743+0000 7f61a21d7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f619c14fcb0 0x7f619c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.743+0000 7f61a21d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c06f000 0x7f619c071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.743+0000 7f61a21d7640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c15a030 con 0x7f619c150090 2024-02-17T12:58:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.743+0000 7f61a21d7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0c62e0 con 0x7f619c14fcb0 2024-02-17T12:58:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.743+0000 7f61a21d7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c6580 con 0x7f619c06f000 2024-02-17T12:58:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.744+0000 7f619bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c06f000 0x7f619c071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.745+0000 7f619b7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f619c14fcb0 0x7f619c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.745+0000 7f619b7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f619c14fcb0 0x7f619c159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50222/0 (socket says 172.21.15.136:50222) 2024-02-17T12:58:35.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.745+0000 7f619b7fe640 1 -- 172.21.15.136:0/3646144419 learned_addr learned my addr 172.21.15.136:0/3646144419 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.745+0000 7fb329e40640 1 Processor -- start 2024-02-17T12:58:35.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7f1ce2292640 1 Processor -- start 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.745+0000 7fb329e40640 1 -- start start 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7fb329e40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7fb329e40640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb3240c6030 0x7fb324161c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7fb329e40640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32415eea0 con 0x7fb324162190 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7fb329e40640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3241586a0 con 0x7fb3240c6030 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7fb329e40640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324070e40 con 0x7fb3241582c0 2024-02-17T12:58:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.746+0000 7f1ce2292640 1 -- start start 2024-02-17T12:58:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.747+0000 7fe718702640 1 Processor -- start 2024-02-17T12:58:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.747+0000 7fe718702640 1 -- start start 2024-02-17T12:58:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f1ce2292640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1cd4007670 0x7f1cd40e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f1ce2292640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd404f940 con 0x7f1cd404f520 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f1ce2292640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd4007ac0 con 0x7f1cd4037670 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f1ce2292640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40071e0 con 0x7f1cd4007670 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f619a7fc640 1 -- 172.21.15.136:0/3646144419 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372565742 0 0) 0x7f6194001490 con 0x7f619c150090 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f619a7fc640 1 -- 172.21.15.136:0/3646144419 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6184003520 con 0x7f619c150090 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f619b7fe640 1 -- 172.21.15.136:0/3646144419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c06f000 msgr2=0x7f619c071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f619b7fe640 1 --2- 172.21.15.136:0/3646144419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c06f000 0x7f619c071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f619b7fe640 1 -- 172.21.15.136:0/3646144419 >> v1:172.21.15.160:6789/0 conn(0x7f619c150090 legacy=0x7f619c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7f619b7fe640 1 -- 172.21.15.136:0/3646144419 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0c6840 con 0x7f619c14fcb0 2024-02-17T12:58:35.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7fe718702640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe71015e9b0 0x7fe71006dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.749+0000 7fb323fff640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fb324162190 0x7fb324071670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:52016/0 (socket says 172.21.15.136:52016) 2024-02-17T12:58:35.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.749+0000 7fb323fff640 1 -- 172.21.15.136:0/559611049 learned_addr learned my addr 172.21.15.136:0/559611049 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:35.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7fe718702640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100c5e70 con 0x7fe710157f20 2024-02-17T12:58:35.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7fe718702640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100c7420 con 0x7fe7100708f0 2024-02-17T12:58:35.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.748+0000 7fe718702640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71006e120 con 0x7fe71015e9b0 2024-02-17T12:58:35.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.749+0000 7f1ce1290640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f1cd4037670 0x7f1cd4038d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:52030/0 (socket says 172.21.15.136:52030) 2024-02-17T12:58:35.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.749+0000 7f1ce1290640 1 -- 172.21.15.136:0/3035794100 learned_addr learned my addr 172.21.15.136:0/3035794100 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:35.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.749+0000 7fe715c9d640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe7100708f0 0x7fe71015e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:52046/0 (socket says 172.21.15.136:52046) 2024-02-17T12:58:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.749+0000 7fe715c9d640 1 -- 172.21.15.136:0/2553650542 learned_addr learned my addr 172.21.15.136:0/2553650542 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.751+0000 7f619b7fe640 1 --2- 172.21.15.136:0/3646144419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c14fcb0 0x7f619c159af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f618c0091e0 tx=0x7f618c02bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a60527c2a368f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.751+0000 7fb3237fe640 1 --2- 172.21.15.136:0/559611049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.754+0000 7fb3237fe640 1 -- 172.21.15.136:0/559611049 >> v2:172.21.15.136:3300/0 conn(0x7fb3240c6030 msgr2=0x7fb324161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.754+0000 7fb3237fe640 1 --2- 172.21.15.136:0/559611049 >> v2:172.21.15.136:3300/0 conn(0x7fb3240c6030 0x7fb324161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.754+0000 7fb3237fe640 1 -- 172.21.15.136:0/559611049 >> v1:172.21.15.160:6789/0 conn(0x7fb324162190 legacy=0x7fb324071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.754+0000 7fb3237fe640 1 -- 172.21.15.136:0/559611049 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240710b0 con 0x7fb3241582c0 2024-02-17T12:58:35.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.756+0000 7f1ce1a91640 1 --2- 172.21.15.136:0/3035794100 >> v2:172.21.15.136:3300/0 conn(0x7f1cd4007670 0x7f1cd40e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.756+0000 7fb3237fe640 1 --2- 172.21.15.136:0/559611049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415e960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097a0 tx=0x7fb31402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637b56b45f06da51 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.758+0000 7f5d8b54f640 1 Processor -- start 2024-02-17T12:58:35.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.758+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129685468 0 0) 0x7fe7100c7420 con 0x7fe7100708f0 2024-02-17T12:58:35.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.758+0000 7f5d8b54f640 1 -- start start 2024-02-17T12:58:35.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.758+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6fc003520 con 0x7fe7100708f0 2024-02-17T12:58:35.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.758+0000 7fcb684bb640 1 Processor -- start 2024-02-17T12:58:35.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.759+0000 7fcb684bb640 1 -- start start 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.759+0000 7fcb684bb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 0x7fcb6006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.759+0000 7fcb684bb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcb600c2830 0x7fcb601594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7fcb684bb640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6015a380 con 0x7fcb600c6b60 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7fcb684bb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6015a120 con 0x7fcb600c2830 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7fcb684bb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c4130 con 0x7fcb60150110 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f1ce1a91640 1 -- 172.21.15.136:0/3035794100 >> v1:172.21.15.160:6789/0 conn(0x7f1cd4037670 legacy=0x7f1cd4038d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f1ce1a91640 1 -- 172.21.15.136:0/3035794100 >> v1:172.21.15.136:6789/0 conn(0x7f1cd404f520 legacy=0x7f1cd4037a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f1ce1a91640 1 -- 172.21.15.136:0/3035794100 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4039490 con 0x7f1cd4007670 2024-02-17T12:58:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f5d8b54f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 0x7f5d8415e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f5d8b54f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8415eea0 con 0x7f5d841582c0 2024-02-17T12:58:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f5d8b54f640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d841586a0 con 0x7f5d840c6030 2024-02-17T12:58:35.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.760+0000 7f5d8b54f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84070e40 con 0x7f5d84071d80 2024-02-17T12:58:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.761+0000 7fb3227fc640 1 -- 172.21.15.136:0/559611049 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314030610 con 0x7fb3241582c0 2024-02-17T12:58:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.761+0000 7fb3227fc640 1 -- 172.21.15.136:0/559611049 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314030770 con 0x7fb3241582c0 2024-02-17T12:58:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb3227fc640 1 -- 172.21.15.136:0/559611049 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314030b00 con 0x7fb3241582c0 2024-02-17T12:58:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 -- 172.21.15.136:0/559611049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 msgr2=0x7fb32415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 --2- 172.21.15.136:0/559611049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415e960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097a0 tx=0x7fb31402b960 comp rx=0 tx=0).stop 2024-02-17T12:58:35.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fcb66257640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 0x7fcb6006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 -- 172.21.15.136:0/559611049 shutdown_connections 2024-02-17T12:58:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 --2- 172.21.15.136:0/559611049 >> v2:172.21.15.136:3300/0 conn(0x7fb3240c6030 0x7fb324161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 --2- 172.21.15.136:0/559611049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415e960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 -- 172.21.15.136:0/559611049 >> 172.21.15.136:0/559611049 conn(0x7fb32406aac0 msgr2=0x7fb32406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7f5d89aec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 0x7f5d8415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 -- 172.21.15.136:0/559611049 shutdown_connections 2024-02-17T12:58:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fb329e40640 1 -- 172.21.15.136:0/559611049 wait complete. 2024-02-17T12:58:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7f5d89aec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 0x7f5d8415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39790/0 (socket says 172.21.15.136:39790) 2024-02-17T12:58:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7f5d89aec640 1 -- 172.21.15.136:0/896790866 learned_addr learned my addr 172.21.15.136:0/896790866 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7f1ce1a91640 1 --2- 172.21.15.136:0/3035794100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd4007670 0x7f1cd40e3880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0097a0 tx=0x7f1ccc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4de9decb32cb43a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fcb66257640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 0x7fcb6006bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39774/0 (socket says 172.21.15.136:39774) 2024-02-17T12:58:35.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.762+0000 7fcb66257640 1 -- 172.21.15.136:0/2577377080 learned_addr learned my addr 172.21.15.136:0/2577377080 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.763+0000 7febafb87640 1 Processor -- start 2024-02-17T12:58:35.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.763+0000 7febafb87640 1 -- start start 2024-02-17T12:58:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.763+0000 7fb329e40640 1 Processor -- start 2024-02-17T12:58:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.764+0000 7fb329e40640 1 -- start start 2024-02-17T12:58:35.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.764+0000 7febafb87640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 0x7feba80c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.764+0000 7febafb87640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feba80c76d0 0x7feba80c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.764+0000 7febafb87640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80b31f0 con 0x7feba80c7d30 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.764+0000 7febafb87640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80b34d0 con 0x7feba80c76d0 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.764+0000 7febafb87640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c8830 con 0x7feba8151e70 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.765+0000 7fb329e40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3240c6030 0x7fb32415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.765+0000 7fb329e40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.765+0000 7fb329e40640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb324162190 0x7fb32415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.765+0000 7fb329e40640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324158cc0 con 0x7fb324162190 2024-02-17T12:58:35.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.765+0000 7fb329e40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415c560 con 0x7fb3240c6030 2024-02-17T12:58:35.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.765+0000 7fb329e40640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415b390 con 0x7fb3241582c0 2024-02-17T12:58:35.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.766+0000 7fcb66257640 1 -- 172.21.15.136:0/2577377080 >> v2:172.21.15.136:3300/0 conn(0x7fcb600c2830 msgr2=0x7fcb601594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.766+0000 7fcb66257640 1 --2- 172.21.15.136:0/2577377080 >> v2:172.21.15.136:3300/0 conn(0x7fcb600c2830 0x7fcb601594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.766+0000 7fcb66257640 1 -- 172.21.15.136:0/2577377080 >> v1:172.21.15.160:6789/0 conn(0x7fcb600c6b60 legacy=0x7fcb60159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.766+0000 7fcb66257640 1 -- 172.21.15.136:0/2577377080 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600c77d0 con 0x7fcb60150110 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3604761981 0 0) 0x7fe6fc003520 con 0x7fe7100708f0 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 >> v2:172.21.15.136:3300/0 conn(0x7fe71015e9b0 msgr2=0x7fe71006dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 --2- 172.21.15.136:0/2553650542 >> v2:172.21.15.136:3300/0 conn(0x7fe71015e9b0 0x7fe71006dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 >> v1:172.21.15.136:6789/0 conn(0x7fe710157f20 legacy=0x7fe71006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100c6810 con 0x7fe7100708f0 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3338030640 0 0) 0x7fe70c001670 con 0x7fe7100708f0 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 >> v1:172.21.15.160:6789/0 conn(0x7fe7100708f0 legacy=0x7fe71015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc003970 0x7fe6fc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe6fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6fc0052a0 0x7fe6fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006e120 con 0x7fe6fc003970 2024-02-17T12:58:35.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc00c190 con 0x7fe6fc0047c0 2024-02-17T12:58:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.767+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc00c350 con 0x7fe6fc0052a0 2024-02-17T12:58:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.768+0000 7f5d89aec640 1 -- 172.21.15.136:0/896790866 >> v1:172.21.15.160:6789/0 conn(0x7f5d840c6030 legacy=0x7f5d84071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.768+0000 7f5d89aec640 1 -- 172.21.15.136:0/896790866 >> v1:172.21.15.136:6789/0 conn(0x7f5d841582c0 legacy=0x7f5d84161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.768+0000 7f5d89aec640 1 -- 172.21.15.136:0/896790866 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840710b0 con 0x7f5d84071d80 2024-02-17T12:58:35.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f1cd3fff640 1 -- 172.21.15.136:0/3035794100 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc031830 con 0x7f1cd4007670 2024-02-17T12:58:35.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f1cd3fff640 1 -- 172.21.15.136:0/3035794100 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc031990 con 0x7f1cd4007670 2024-02-17T12:58:35.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f1cd3fff640 1 -- 172.21.15.136:0/3035794100 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc031d20 con 0x7f1cd4007670 2024-02-17T12:58:35.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7fcb66257640 1 --2- 172.21.15.136:0/2577377080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 0x7fcb6006bcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009870 tx=0x7fcb5c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e305a3a0826028e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7febad923640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 0x7feba80c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7fe71649e640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc003970 0x7fe6fc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f5d89aec640 1 --2- 172.21.15.136:0/896790866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 0x7f5d8415e960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009e80 tx=0x7f5d7c02bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ca109160e5af08 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f619a7fc640 1 -- 172.21.15.136:0/3646144419 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c02c9f0 con 0x7f619c14fcb0 2024-02-17T12:58:35.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f619a7fc640 1 -- 172.21.15.136:0/3646144419 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c02cb50 con 0x7f619c14fcb0 2024-02-17T12:58:35.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f1ce2292640 1 -- 172.21.15.136:0/3035794100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd4007670 msgr2=0x7f1cd40e3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f1ce2292640 1 --2- 172.21.15.136:0/3035794100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd4007670 0x7f1cd40e3880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0097a0 tx=0x7f1ccc02b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.772+0000 7f619a7fc640 1 -- 172.21.15.136:0/3646144419 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c034440 con 0x7f619c14fcb0 2024-02-17T12:58:35.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f1ce2292640 1 -- 172.21.15.136:0/3035794100 shutdown_connections 2024-02-17T12:58:35.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f1ce2292640 1 --2- 172.21.15.136:0/3035794100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd4007670 0x7f1cd40e3880 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f1ce2292640 1 -- 172.21.15.136:0/3035794100 >> 172.21.15.136:0/3035794100 conn(0x7f1cd4054610 msgr2=0x7f1cd4054a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f1ce2292640 1 -- 172.21.15.136:0/3035794100 shutdown_connections 2024-02-17T12:58:35.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f1ce2292640 1 -- 172.21.15.136:0/3035794100 wait complete. 2024-02-17T12:58:35.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7fe715c9d640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe6fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3240c6030 0x7fb32415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 -- 172.21.15.136:0/3646144419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c14fcb0 msgr2=0x7f619c159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 --2- 172.21.15.136:0/3646144419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c14fcb0 0x7f619c159af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f618c0091e0 tx=0x7f618c02bc40 comp rx=0 tx=0).stop 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 -- 172.21.15.136:0/3646144419 shutdown_connections 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 --2- 172.21.15.136:0/3646144419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c06f000 0x7f619c071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 --2- 172.21.15.136:0/3646144419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c14fcb0 0x7f619c159af0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 -- 172.21.15.136:0/3646144419 >> 172.21.15.136:0/3646144419 conn(0x7f619c06aac0 msgr2=0x7f619c06aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.773+0000 7f61a21d7640 1 -- 172.21.15.136:0/3646144419 shutdown_connections 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7f61a21d7640 1 -- 172.21.15.136:0/3646144419 wait complete. 2024-02-17T12:58:35.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3240c6030 0x7fb32415a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59104/0 (socket says 172.21.15.136:59104) 2024-02-17T12:58:35.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7fb3237fe640 1 -- 172.21.15.136:0/2588832165 learned_addr learned my addr 172.21.15.136:0/2588832165 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7febad923640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 0x7feba80c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39806/0 (socket says 172.21.15.136:39806) 2024-02-17T12:58:35.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7febad923640 1 -- 172.21.15.136:0/3587491803 learned_addr learned my addr 172.21.15.136:0/3587491803 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7f1ce2292640 1 Processor -- start 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.774+0000 7f1ce2292640 1 -- start start 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f1ce2292640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd4007670 0x7f1cd404c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f1ce2292640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd4037670 0x7f1cd404c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f1ce2292640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd404f520 0x7f1cd417c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f1ce2292640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40de990 con 0x7f1cd404f520 2024-02-17T12:58:35.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7fb323fff640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb324162190 0x7fb32415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f1ce2292640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40d9b50 con 0x7f1cd4037670 2024-02-17T12:58:35.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f1ce2292640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd404bc60 con 0x7f1cd4007670 2024-02-17T12:58:35.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f61a21d7640 1 Processor -- start 2024-02-17T12:58:35.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7fe716c9f640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6fc0052a0 0x7fe6fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.775+0000 7f61a21d7640 1 -- start start 2024-02-17T12:58:35.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.776+0000 7f61a21d7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f619c06f000 0x7f619c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.776+0000 7f61a21d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c14fcb0 0x7f619c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7f61a21d7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c150090 0x7f619c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7f61a21d7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c1f3550 con 0x7f619c150090 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7f61a21d7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c150e80 con 0x7f619c06f000 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7f61a21d7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c1f37a0 con 0x7f619c14fcb0 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7fe715c9d640 1 -- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6fc0052a0 msgr2=0x7fe6fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7fe715c9d640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6fc0052a0 0x7fe6fc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7fe715c9d640 1 -- 172.21.15.136:0/2553650542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc003970 msgr2=0x7fe6fc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7fe715c9d640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6fc003970 0x7fe6fc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7fe715c9d640 1 -- 172.21.15.136:0/2553650542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc003520 con 0x7fe6fc0047c0 2024-02-17T12:58:35.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.777+0000 7fe716c9f640 1 -- 172.21.15.136:0/2553650542 reap_dead start 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.778+0000 7febad122640 1 --2- 172.21.15.136:0/3587491803 >> v2:172.21.15.136:3300/0 conn(0x7feba80c76d0 0x7feba80c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.780+0000 7fb3237fe640 1 -- 172.21.15.136:0/2588832165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 msgr2=0x7fb32415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.780+0000 7fb3237fe640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3241582c0 0x7fb32415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.780+0000 7fb3237fe640 1 -- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb324162190 msgr2=0x7fb32415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.780+0000 7fb3237fe640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb324162190 0x7fb32415f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.780+0000 7fb3237fe640 1 -- 172.21.15.136:0/2588832165 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314009400 con 0x7fb3240c6030 2024-02-17T12:58:35.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.780+0000 7fb323fff640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb324162190 0x7fb32415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:58:35.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.781+0000 7f5d7bfff640 1 -- 172.21.15.136:0/896790866 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c02caf0 con 0x7f5d84071d80 2024-02-17T12:58:35.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.781+0000 7f5d7bfff640 1 -- 172.21.15.136:0/896790866 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c02cc50 con 0x7f5d84071d80 2024-02-17T12:58:35.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.781+0000 7f5d7bfff640 1 -- 172.21.15.136:0/896790866 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0343f0 con 0x7f5d84071d80 2024-02-17T12:58:35.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f1825d56640 1 Processor -- start 2024-02-17T12:58:35.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f1825d56640 1 -- start start 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 -- 172.21.15.136:0/896790866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 msgr2=0x7f5d8415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 --2- 172.21.15.136:0/896790866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 0x7f5d8415e960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009e80 tx=0x7f5d7c02bf50 comp rx=0 tx=0).stop 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 -- 172.21.15.136:0/896790866 shutdown_connections 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 --2- 172.21.15.136:0/896790866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d84071d80 0x7f5d8415e960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 -- 172.21.15.136:0/896790866 >> 172.21.15.136:0/896790866 conn(0x7f5d8406aac0 msgr2=0x7f5d8406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 -- 172.21.15.136:0/896790866 shutdown_connections 2024-02-17T12:58:35.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.782+0000 7f5d8b54f640 1 -- 172.21.15.136:0/896790866 wait complete. 2024-02-17T12:58:35.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.783+0000 7f1825d56640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1820153f90 0x7f18200c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.783+0000 7f1825d56640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f182015dd20 0x7f18200cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.783+0000 7f1825d56640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182015d280 con 0x7f182006b420 2024-02-17T12:58:35.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.783+0000 7f1825d56640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182006c3b0 con 0x7f1820153f90 2024-02-17T12:58:35.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.783+0000 7f1825d56640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200cbc20 con 0x7f182015dd20 2024-02-17T12:58:35.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7f5d8b54f640 1 Processor -- start 2024-02-17T12:58:35.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7f5d8b54f640 1 -- start start 2024-02-17T12:58:35.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7febad923640 1 -- 172.21.15.136:0/3587491803 >> v2:172.21.15.136:3300/0 conn(0x7feba80c76d0 msgr2=0x7feba80c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7febad923640 1 --2- 172.21.15.136:0/3587491803 >> v2:172.21.15.136:3300/0 conn(0x7feba80c76d0 0x7feba80c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7febad923640 1 -- 172.21.15.136:0/3587491803 >> v1:172.21.15.160:6789/0 conn(0x7feba80c7d30 legacy=0x7feba80b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7fb3237fe640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3240c6030 0x7fb32415a050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb31402bf70 tx=0x7fb314004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7febad923640 1 -- 172.21.15.136:0/3587491803 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80c8b10 con 0x7feba8151e70 2024-02-17T12:58:35.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.784+0000 7fe715c9d640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe6fc004c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe710070d20 tx=0x7fe6fc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5d4f7e68aa8a0a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.785+0000 7f5d8b54f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84071d80 0x7f5d84147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.785+0000 7f5d8b54f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d840c6030 0x7f5d84148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.785+0000 7f5d8b54f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d841582c0 0x7f5d840caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.785+0000 7f5d8b54f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840ca810 con 0x7f5d840c6030 2024-02-17T12:58:35.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.785+0000 7f5d8b54f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c7080 con 0x7f5d84071d80 2024-02-17T12:58:35.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.785+0000 7f5d8b54f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c7360 con 0x7f5d841582c0 2024-02-17T12:58:35.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7fcb65255640 1 -- 172.21.15.136:0/2577377080 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c031640 con 0x7fcb60150110 2024-02-17T12:58:35.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7f1ce1a91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd404f520 0x7f1cd417c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7fcb65255640 1 -- 172.21.15.136:0/2577377080 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0317a0 con 0x7fcb60150110 2024-02-17T12:58:35.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7fcb65255640 1 -- 172.21.15.136:0/2577377080 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c031b30 con 0x7fcb60150110 2024-02-17T12:58:35.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7f1ce1a91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd404f520 0x7f1cd417c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50278/0 (socket says 172.21.15.136:50278) 2024-02-17T12:58:35.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7f1ce1a91640 1 -- 172.21.15.136:0/1057050939 learned_addr learned my addr 172.21.15.136:0/1057050939 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.788+0000 7febad923640 1 --2- 172.21.15.136:0/3587491803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 0x7feba80c9120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feba4009870 tx=0x7feba402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e47cf9adffea41b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7f619bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c150090 0x7f619c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 -- 172.21.15.136:0/2577377080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 msgr2=0x7fcb6006bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7f1ce0a8f640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd4037670 0x7f1cd404c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 --2- 172.21.15.136:0/2577377080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 0x7fcb6006bcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009870 tx=0x7fcb5c02b8f0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 -- 172.21.15.136:0/2577377080 shutdown_connections 2024-02-17T12:58:35.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 --2- 172.21.15.136:0/2577377080 >> v2:172.21.15.136:3300/0 conn(0x7fcb600c2830 0x7fcb601594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 --2- 172.21.15.136:0/2577377080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb60150110 0x7fcb6006bcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 -- 172.21.15.136:0/2577377080 >> 172.21.15.136:0/2577377080 conn(0x7fcb600c83d0 msgr2=0x7fcb600c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 -- 172.21.15.136:0/2577377080 shutdown_connections 2024-02-17T12:58:35.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7fcb684bb640 1 -- 172.21.15.136:0/2577377080 wait complete. 2024-02-17T12:58:35.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7f619bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c150090 0x7f619c1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50292/0 (socket says 172.21.15.136:50292) 2024-02-17T12:58:35.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.789+0000 7f619bfff640 1 -- 172.21.15.136:0/1127714933 learned_addr learned my addr 172.21.15.136:0/1127714933 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.790+0000 7fcb684bb640 1 Processor -- start 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.790+0000 7fcb684bb640 1 -- start start 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.791+0000 7fcb684bb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb600c2830 0x7fcb60135c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.791+0000 7fcb684bb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb600c6b60 0x7fcb6013c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.791+0000 7fcb684bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb60150110 0x7fcb601f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.791+0000 7fcb684bb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601f44e0 con 0x7fcb600c6b60 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.791+0000 7fcb684bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6013f020 con 0x7fcb60150110 2024-02-17T12:58:35.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.791+0000 7fcb684bb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60136250 con 0x7fcb600c2830 2024-02-17T12:58:35.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.792+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c005ad0 con 0x7fe6fc0047c0 2024-02-17T12:58:35.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c005c30 con 0x7fe6fc0047c0 2024-02-17T12:58:35.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe71549c640 1 -- 172.21.15.136:0/2553650542 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c02c850 con 0x7fe6fc0047c0 2024-02-17T12:58:35.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 -- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 msgr2=0x7fe6fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe6fc004c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe710070d20 tx=0x7fe6fc0057f0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7f5d892eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84071d80 0x7f5d84147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 -- 172.21.15.136:0/2553650542 shutdown_connections 2024-02-17T12:58:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 --2- 172.21.15.136:0/2553650542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe6fc004c40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 -- 172.21.15.136:0/2553650542 >> 172.21.15.136:0/2553650542 conn(0x7fe7100c7e90 msgr2=0x7fe7100c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 -- 172.21.15.136:0/2553650542 shutdown_connections 2024-02-17T12:58:35.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7fe718702640 1 -- 172.21.15.136:0/2553650542 wait complete. 2024-02-17T12:58:35.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7f1ce1a91640 1 -- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd4007670 msgr2=0x7f1cd404c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7f1ce1a91640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd4007670 0x7f1cd404c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7f1ce1a91640 1 -- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd4037670 msgr2=0x7f1cd404c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.793+0000 7f1ce1a91640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd4037670 0x7f1cd404c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.794+0000 7f1ce1a91640 1 -- 172.21.15.136:0/1057050939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc009400 con 0x7f1cd404f520 2024-02-17T12:58:35.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.794+0000 7f5d892eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84071d80 0x7f5d84147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59146/0 (socket says 172.21.15.136:59146) 2024-02-17T12:58:35.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.794+0000 7f5d892eb640 1 -- 172.21.15.136:0/1480560370 learned_addr learned my addr 172.21.15.136:0/1480560370 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.794+0000 7f619affd640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c14fcb0 0x7f619c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.795+0000 7fe718702640 1 Processor -- start 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.795+0000 7fe718702640 1 -- start start 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.796+0000 7fe718702640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe7100c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.796+0000 7fe718702640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71015f110 0x7fe7101f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.796+0000 7fe718702640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7101f4330 0x7fe71015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.796+0000 7fe718702640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710158ad0 con 0x7fe7101f4330 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.796+0000 7fe718702640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100c4be0 con 0x7fe6fc0047c0 2024-02-17T12:58:35.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.796+0000 7fe718702640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100c5df0 con 0x7fe71015f110 2024-02-17T12:58:35.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.798+0000 7f619bfff640 1 -- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c14fcb0 msgr2=0x7f619c1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.798+0000 7f619bfff640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f619c14fcb0 0x7f619c1504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.798+0000 7f619bfff640 1 -- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f619c06f000 msgr2=0x7f619c152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.798+0000 7f619bfff640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f619c06f000 0x7f619c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.798+0000 7f619bfff640 1 -- 172.21.15.136:0/1127714933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c009d60 con 0x7f619c150090 2024-02-17T12:58:35.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.800+0000 7f5d89aec640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d841582c0 0x7f5d840caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31403e040 con 0x7fb3240c6030 2024-02-17T12:58:35.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314039cd0 con 0x7fb3240c6030 2024-02-17T12:58:35.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7f1ce1a91640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd404f520 0x7f1cd417c410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0098c0 tx=0x7f1ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fcb66a58640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb60150110 0x7fcb601f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32415b630 con 0x7fb3240c6030 2024-02-17T12:58:35.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314044630 con 0x7fb3240c6030 2024-02-17T12:58:35.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32415bfa0 con 0x7fb3240c6030 2024-02-17T12:58:35.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fcb66257640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb600c2830 0x7fcb60135c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fcb66a58640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb60150110 0x7fcb601f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59156/0 (socket says 172.21.15.136:59156) 2024-02-17T12:58:35.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7fcb66a58640 1 -- 172.21.15.136:0/3617818379 learned_addr learned my addr 172.21.15.136:0/3617818379 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.802+0000 7f181f7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1820153f90 0x7f18200c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.803+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb324161730 con 0x7fb3240c6030 2024-02-17T12:58:35.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.803+0000 7f619bfff640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c150090 0x7f619c1551a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f619000f990 tx=0x7f619000fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.804+0000 7f181f7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1820153f90 0x7f18200c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50294/0 (socket says 172.21.15.136:50294) 2024-02-17T12:58:35.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.804+0000 7f181f7fe640 1 -- 172.21.15.136:0/2529373871 learned_addr learned my addr 172.21.15.136:0/2529373871 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febac921640 1 -- 172.21.15.136:0/3587491803 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4030840 con 0x7feba8151e70 2024-02-17T12:58:35.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febac921640 1 -- 172.21.15.136:0/3587491803 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba40309a0 con 0x7feba8151e70 2024-02-17T12:58:35.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febac921640 1 -- 172.21.15.136:0/3587491803 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4030d30 con 0x7feba8151e70 2024-02-17T12:58:35.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7f5d892eb640 1 -- 172.21.15.136:0/1480560370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d841582c0 msgr2=0x7f5d840caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7f5d892eb640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d841582c0 0x7f5d840caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7f5d892eb640 1 -- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d840c6030 msgr2=0x7f5d84148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7f5d892eb640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d840c6030 0x7f5d84148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7f5d892eb640 1 -- 172.21.15.136:0/1480560370 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009b30 con 0x7f5d84071d80 2024-02-17T12:58:35.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febafb87640 1 -- 172.21.15.136:0/3587491803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 msgr2=0x7feba80c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febafb87640 1 --2- 172.21.15.136:0/3587491803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 0x7feba80c9120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feba4009870 tx=0x7feba402b980 comp rx=0 tx=0).stop 2024-02-17T12:58:35.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febafb87640 1 -- 172.21.15.136:0/3587491803 shutdown_connections 2024-02-17T12:58:35.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febafb87640 1 --2- 172.21.15.136:0/3587491803 >> v2:172.21.15.136:3300/0 conn(0x7feba80c76d0 0x7feba80c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febafb87640 1 --2- 172.21.15.136:0/3587491803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba8151e70 0x7feba80c9120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.805+0000 7febafb87640 1 -- 172.21.15.136:0/3587491803 >> 172.21.15.136:0/3587491803 conn(0x7feba8070790 msgr2=0x7feba8070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.806+0000 7febafb87640 1 -- 172.21.15.136:0/3587491803 shutdown_connections 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.806+0000 7febafb87640 1 -- 172.21.15.136:0/3587491803 wait complete. 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.807+0000 7fe71649e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe7100c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.807+0000 7febafb87640 1 Processor -- start 2024-02-17T12:58:35.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.807+0000 7febafb87640 1 -- start start 2024-02-17T12:58:35.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7fe71649e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe7100c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59162/0 (socket says 172.21.15.136:59162) 2024-02-17T12:58:35.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7fe71649e640 1 -- 172.21.15.136:0/3687205795 learned_addr learned my addr 172.21.15.136:0/3687205795 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7febafb87640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feba80c76d0 0x7feba81e0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7febafb87640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba80c7d30 0x7feba80ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7febafb87640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feba8151e70 0x7feba80cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7f181effd640 1 --2- 172.21.15.136:0/2529373871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f182015dd20 0x7f18200cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7febafb87640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cbb80 con 0x7feba80c76d0 2024-02-17T12:58:35.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7febafb87640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8143290 con 0x7feba8151e70 2024-02-17T12:58:35.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.808+0000 7febafb87640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cd700 con 0x7feba80c7d30 2024-02-17T12:58:35.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.810+0000 7f181f7fe640 1 -- 172.21.15.136:0/2529373871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f182015dd20 msgr2=0x7f18200cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.810+0000 7f181f7fe640 1 --2- 172.21.15.136:0/2529373871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f182015dd20 0x7f18200cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.810+0000 7f181f7fe640 1 -- 172.21.15.136:0/2529373871 >> v1:172.21.15.160:6789/0 conn(0x7f182006b420 legacy=0x7f18200ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:35.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.810+0000 7f181f7fe640 1 -- 172.21.15.136:0/2529373871 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182006bdf0 con 0x7f1820153f90 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.811+0000 7fcb66257640 1 -- 172.21.15.136:0/3617818379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb60150110 msgr2=0x7fcb601f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.811+0000 7fcb66257640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb60150110 0x7fcb601f03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.811+0000 7fcb66257640 1 -- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb600c6b60 msgr2=0x7fcb6013c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.811+0000 7fcb66257640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcb600c6b60 0x7fcb6013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.811+0000 7fcb66257640 1 -- 172.21.15.136:0/3617818379 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0094d0 con 0x7fcb600c2830 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc03b9f0 con 0x7f1cd404f520 2024-02-17T12:58:35.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000c070 con 0x7f619c150090 2024-02-17T12:58:35.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190009c70 con 0x7f619c150090 2024-02-17T12:58:35.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd40deba0 con 0x7f1cd404f520 2024-02-17T12:58:35.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc03bb50 con 0x7f1cd404f520 2024-02-17T12:58:35.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0453f0 con 0x7f1cd404f520 2024-02-17T12:58:35.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd404bf00 con 0x7f1cd404f520 2024-02-17T12:58:35.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c1f3a80 con 0x7f619c150090 2024-02-17T12:58:35.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619001a480 con 0x7f619c150090 2024-02-17T12:58:35.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.815+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c1f4040 con 0x7f619c150090 2024-02-17T12:58:35.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cd40065d0 con 0x7f1cd404f520 2024-02-17T12:58:35.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7f181f7fe640 1 --2- 172.21.15.136:0/2529373871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1820153f90 0x7f18200c4340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1810009870 tx=0x7f181002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee89f8ce8e375e02 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7fe71649e640 1 -- 172.21.15.136:0/3687205795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71015f110 msgr2=0x7fe7101f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7fe71649e640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71015f110 0x7fe7101f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7fe71649e640 1 -- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7101f4330 msgr2=0x7fe71015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7fe71649e640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7101f4330 0x7fe71015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7fe71649e640 1 -- 172.21.15.136:0/3687205795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100c6090 con 0x7fe6fc0047c0 2024-02-17T12:58:35.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.816+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f619c0c3570 con 0x7f619c150090 2024-02-17T12:58:35.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.817+0000 7fcb66257640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb600c2830 0x7fcb60135c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb600c4270 tx=0x7fcb5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.819+0000 7f5d892eb640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84071d80 0x7f5d84147bb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c410 tx=0x7f5d8000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.822+0000 7fe71649e640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe7100c5070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe70000e410 tx=0x7fe70000e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.824+0000 7febad122640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba80c7d30 0x7feba80ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c03bc70 con 0x7fcb600c2830 2024-02-17T12:58:35.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c03bdd0 con 0x7fcb600c2830 2024-02-17T12:58:35.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c045630 con 0x7fcb600c2830 2024-02-17T12:58:35.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb601f38d0 con 0x7fcb600c2830 2024-02-17T12:58:35.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb601f3e90 con 0x7fcb600c2830 2024-02-17T12:58:35.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7febad122640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba80c7d30 0x7feba80ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39870/0 (socket says 172.21.15.136:39870) 2024-02-17T12:58:35.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.825+0000 7febad122640 1 -- 172.21.15.136:0/3784901644 learned_addr learned my addr 172.21.15.136:0/3784901644 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.826+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb6014e8e0 con 0x7fcb600c2830 2024-02-17T12:58:35.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.829+0000 7febad122640 1 -- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feba8151e70 msgr2=0x7feba80cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.829+0000 7febad122640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feba8151e70 0x7feba80cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.829+0000 7febad122640 1 -- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feba80c76d0 msgr2=0x7feba81e0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.829+0000 7febad122640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feba80c76d0 0x7feba81e0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.829+0000 7febad122640 1 -- 172.21.15.136:0/3784901644 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40094d0 con 0x7feba80c7d30 2024-02-17T12:58:35.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.840+0000 7febad122640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba80c7d30 0x7feba80ccc80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb9800e8d0 tx=0x7feb9800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.840+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800035f0 con 0x7f5d84071d80 2024-02-17T12:58:35.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.840+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80003750 con 0x7f5d84071d80 2024-02-17T12:58:35.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.840+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80003b40 con 0x7f5d84071d80 2024-02-17T12:58:35.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.840+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d840c7640 con 0x7f5d84071d80 2024-02-17T12:58:35.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.840+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d84148560 con 0x7f5d84071d80 2024-02-17T12:58:35.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.841+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d84161730 con 0x7f5d84071d80 2024-02-17T12:58:35.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.842+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1ccc045550 con 0x7f1cd404f520 2024-02-17T12:58:35.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.842+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700003a70 con 0x7fe6fc0047c0 2024-02-17T12:58:35.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.843+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700003bd0 con 0x7fe6fc0047c0 2024-02-17T12:58:35.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.843+0000 7fe718702640 1 -- 172.21.15.136:0/3687205795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7100c4590 con 0x7fe6fc0047c0 2024-02-17T12:58:35.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.843+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700004050 con 0x7fe6fc0047c0 2024-02-17T12:58:35.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.843+0000 7fe718702640 1 -- 172.21.15.136:0/3687205795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101f47c0 con 0x7fe6fc0047c0 2024-02-17T12:58:35.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.843+0000 7f1cd1ffb640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1cc006b890 0x7f1cc006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.843+0000 7f1ce1290640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1cc006b890 0x7f1cc006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.844+0000 7fe718702640 1 -- 172.21.15.136:0/3687205795 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe710156720 con 0x7fe6fc0047c0 2024-02-17T12:58:35.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.844+0000 7f1ce1290640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1cc006b890 0x7f1cc006dd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8000fb0 tx=0x7f1cd8007a20 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.855+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcb5c02f050 con 0x7fcb600c2830 2024-02-17T12:58:35.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.855+0000 7fcb56ffd640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb4406b810 0x7fcb4406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.855+0000 7fcb65a56640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb4406b810 0x7fcb4406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.856+0000 7fcb65a56640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb4406b810 0x7fcb4406dcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb6013caf0 tx=0x7fcb50006be0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fcb5c07b610 con 0x7fcb600c2830 2024-02-17T12:58:35.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb31404d3b0 con 0x7fb3240c6030 2024-02-17T12:58:35.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fcb56ffd640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fcb44074f20 0x7fcb440773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 --> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb44077a90 con 0x7fcb44074f20 2024-02-17T12:58:35.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fcb66a58640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fcb44074f20 0x7fcb440773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fb30bfff640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb31006b810 0x7fb31006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5c0771b0 con 0x7fcb600c2830 2024-02-17T12:58:35.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.857+0000 7fb322ffd640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb31006b810 0x7fb31006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.858+0000 7fcb66a58640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fcb44074f20 0x7fcb440773c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.858+0000 7fb322ffd640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb31006b810 0x7fb31006dcd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb324160fa0 tx=0x7fb318006c90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.858+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== osd.0 v2:172.21.15.136:6816/3029567503 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcb44077a90 con 0x7fcb44074f20 2024-02-17T12:58:35.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.861+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6190011450 con 0x7f619c150090 2024-02-17T12:58:35.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.861+0000 7f6183fff640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f618806b860 0x7f618806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.861+0000 7f619b7fe640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f618806b860 0x7f618806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.861+0000 7f619b7fe640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f618806b860 0x7f618806dd20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f618c036000 tx=0x7f618c02e000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.862+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98009630 con 0x7feba80c7d30 2024-02-17T12:58:35.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.862+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800c940 con 0x7feba80c7d30 2024-02-17T12:58:35.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.862+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800ccf0 con 0x7feba80c7d30 2024-02-17T12:58:35.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.862+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80c95f0 con 0x7feba80c7d30 2024-02-17T12:58:35.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.862+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba81e33b0 con 0x7feba80c7d30 2024-02-17T12:58:35.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.863+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feba8152250 con 0x7feba80c7d30 2024-02-17T12:58:35.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.864+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f1ccc07b9d0 con 0x7f1cd404f520 2024-02-17T12:58:35.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.864+0000 7f1cd1ffb640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f1cc0075030 0x7f1cc00774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.864+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 --> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cc0077ba0 con 0x7f1cc0075030 2024-02-17T12:58:35.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.864+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ccc077c70 con 0x7f1cd404f520 2024-02-17T12:58:35.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.865+0000 7f1ce0a8f640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f1cc0075030 0x7f1cc00774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.865+0000 7f1ce0a8f640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f1cc0075030 0x7f1cc00774d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.866+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== osd.7 v2:172.21.15.160:6814/2434888201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1cc0077ba0 con 0x7f1cc0075030 2024-02-17T12:58:35.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.867+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb314039e40 con 0x7fb3240c6030 2024-02-17T12:58:35.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.867+0000 7fb30bfff640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7fb310074f20 0x7fb3100773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.867+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 --> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb310077a90 con 0x7fb310074f20 2024-02-17T12:58:35.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.868+0000 7fb323fff640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7fb310074f20 0x7fb3100773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.868+0000 7fb323fff640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7fb310074f20 0x7fb3100773c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.869+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== osd.1 v2:172.21.15.136:6800/2661143693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb310077a90 con 0x7fb310074f20 2024-02-17T12:58:35.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.869+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb314077a00 con 0x7fb3240c6030 2024-02-17T12:58:35.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.873+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f6190015070 con 0x7f619c150090 2024-02-17T12:58:35.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.873+0000 7f6183fff640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7f6188075070 0x7f6188077510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.874+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 --> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6188077be0 con 0x7f6188075070 2024-02-17T12:58:35.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.874+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6190055470 con 0x7f619c150090 2024-02-17T12:58:35.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.874+0000 7f619affd640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7f6188075070 0x7f6188077510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.874+0000 7f619affd640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7f6188075070 0x7f6188077510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.875+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 --> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb600cb760 con 0x7fcb44074f20 2024-02-17T12:58:35.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.875+0000 7fcb56ffd640 1 -- 172.21.15.136:0/3617818379 <== osd.0 v2:172.21.15.136:6816/3029567503 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb600cb760 con 0x7fcb44074f20 2024-02-17T12:58:35.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.875+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== osd.5 v2:172.21.15.160:6808/2660831410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6188077be0 con 0x7f6188075070 2024-02-17T12:58:35.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fcb44074f20 msgr2=0x7fcb440773c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fcb44074f20 0x7fcb440773c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb4406b810 msgr2=0x7fcb4406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb4406b810 0x7fcb4406dcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb6013caf0 tx=0x7fcb50006be0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb600c2830 msgr2=0x7fcb60135c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 --2- 172.21.15.136:0/3617818379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb600c2830 0x7fcb60135c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb600c4270 tx=0x7fcb5c0046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb66a58640 1 -- 172.21.15.136:0/3617818379 reap_dead start 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 shutdown_connections 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 >> 172.21.15.136:0/3617818379 conn(0x7fcb600c83d0 msgr2=0x7fcb601594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 shutdown_connections 2024-02-17T12:58:35.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.877+0000 7fcb684bb640 1 -- 172.21.15.136:0/3617818379 wait complete. 2024-02-17T12:58:35.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.885+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5d80003ca0 con 0x7f5d84071d80 2024-02-17T12:58:35.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.885+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7feb98013470 con 0x7feba80c7d30 2024-02-17T12:58:35.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.885+0000 7feb9e7fc640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feb8c06b860 0x7feb8c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7f5d79ffb640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d6806b890 0x7f5d6806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7febad923640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feb8c06b860 0x7feb8c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7f5d88aea640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d6806b890 0x7f5d6806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f5d800010c0 con 0x7f5d84071d80 2024-02-17T12:58:35.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7f5d79ffb640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f5d680750a0 0x7f5d68077540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 --> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d68077c10 con 0x7f5d680750a0 2024-02-17T12:58:35.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.886+0000 7f5d89aec640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f5d680750a0 0x7f5d68077540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.887+0000 7febad923640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feb8c06b860 0x7feb8c06dd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feba4036000 tx=0x7feba403b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.887+0000 7f5d88aea640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d6806b890 0x7f5d6806dd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d84145cb0 tx=0x7f5d74007990 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.887+0000 7f5d89aec640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f5d680750a0 0x7f5d68077540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.887+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 --> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1cd40062f0 con 0x7f1cc0075030 2024-02-17T12:58:35.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.888+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== osd.3 v2:172.21.15.136:6824/918147356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5d68077c10 con 0x7f5d680750a0 2024-02-17T12:58:35.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.888+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d800549f0 con 0x7f5d84071d80 2024-02-17T12:58:35.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.888+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 --> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb324161450 con 0x7fb310074f20 2024-02-17T12:58:35.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.888+0000 7f1cd1ffb640 1 -- 172.21.15.136:0/1057050939 <== osd.7 v2:172.21.15.160:6814/2434888201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1cdc04f450 con 0x7f1cc0075030 2024-02-17T12:58:35.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.888+0000 7fb30bfff640 1 -- 172.21.15.136:0/2588832165 <== osd.1 v2:172.21.15.136:6800/2661143693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb31c001d70 con 0x7fb310074f20 2024-02-17T12:58:35.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.888+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f1cc0075030 msgr2=0x7f1cc00774d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f1cc0075030 0x7f1cc00774d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7feb98059620 con 0x7feba80c7d30 2024-02-17T12:58:35.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7feb9e7fc640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7feb8c074ff0 0x7feb8c077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 --> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb8c077b60 con 0x7feb8c074ff0 2024-02-17T12:58:35.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1cc006b890 msgr2=0x7f1cc006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1cc006b890 0x7f1cc006dd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8000fb0 tx=0x7f1cd8007a20 comp rx=0 tx=0).stop 2024-02-17T12:58:35.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7fb310074f20 msgr2=0x7fb3100773c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7fb310074f20 0x7fb3100773c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7febae124640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7feb8c074ff0 0x7feb8c077490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd404f520 msgr2=0x7f1cd417c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 --2- 172.21.15.136:0/1057050939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cd404f520 0x7f1cd417c410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0098c0 tx=0x7f1ccc0046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce1a91640 1 -- 172.21.15.136:0/1057050939 reap_dead start 2024-02-17T12:58:35.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb98058cf0 con 0x7feba80c7d30 2024-02-17T12:58:35.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb31006b810 msgr2=0x7fb31006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb31006b810 0x7fb31006dcd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb324160fa0 tx=0x7fb318006c90 comp rx=0 tx=0).stop 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3240c6030 msgr2=0x7fb32415a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 --2- 172.21.15.136:0/2588832165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3240c6030 0x7fb32415a050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb31402bf70 tx=0x7fb314004730 comp rx=0 tx=0).stop 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb323fff640 1 -- 172.21.15.136:0/2588832165 reap_dead start 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 shutdown_connections 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 >> 172.21.15.136:0/1057050939 conn(0x7f1cd4054610 msgr2=0x7f1cd4038370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 shutdown_connections 2024-02-17T12:58:35.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 >> 172.21.15.136:0/2588832165 conn(0x7fb32406aac0 msgr2=0x7fb324155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 shutdown_connections 2024-02-17T12:58:35.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.889+0000 7febae124640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7feb8c074ff0 0x7feb8c077490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.890+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 shutdown_connections 2024-02-17T12:58:35.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.890+0000 7f1ce2292640 1 -- 172.21.15.136:0/1057050939 wait complete. 2024-02-17T12:58:35.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.890+0000 7fb329e40640 1 -- 172.21.15.136:0/2588832165 wait complete. 2024-02-17T12:58:35.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.890+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== osd.4 v2:172.21.15.160:6800/2188049654 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7feb8c077b60 con 0x7feb8c074ff0 2024-02-17T12:58:35.887 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:35.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T12:58:35.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.897+0000 7f181e7fc640 1 -- 172.21.15.136:0/2529373871 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810031640 con 0x7f1820153f90 2024-02-17T12:58:35.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.897+0000 7f181e7fc640 1 -- 172.21.15.136:0/2529373871 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100317a0 con 0x7f1820153f90 2024-02-17T12:58:35.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.897+0000 7f181e7fc640 1 -- 172.21.15.136:0/2529373871 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810031b30 con 0x7f1820153f90 2024-02-17T12:58:35.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.898+0000 7f1825d56640 1 -- 172.21.15.136:0/2529373871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1820153f90 msgr2=0x7f18200c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.898+0000 7f1825d56640 1 --2- 172.21.15.136:0/2529373871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1820153f90 0x7f18200c4340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1810009870 tx=0x7f181002b8f0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.899+0000 7f1825d56640 1 -- 172.21.15.136:0/2529373871 shutdown_connections 2024-02-17T12:58:35.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.899+0000 7f1825d56640 1 --2- 172.21.15.136:0/2529373871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f182015dd20 0x7f18200cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.899+0000 7f1825d56640 1 --2- 172.21.15.136:0/2529373871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1820153f90 0x7f18200c4340 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.899+0000 7f1825d56640 1 -- 172.21.15.136:0/2529373871 >> 172.21.15.136:0/2529373871 conn(0x7f18200723d0 msgr2=0x7f18200727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.900+0000 7f1825d56640 1 -- 172.21.15.136:0/2529373871 shutdown_connections 2024-02-17T12:58:35.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.900+0000 7f1825d56640 1 -- 172.21.15.136:0/2529373871 wait complete. 2024-02-17T12:58:35.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.902+0000 7f1825d56640 1 Processor -- start 2024-02-17T12:58:35.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.902+0000 7f1825d56640 1 -- start start 2024-02-17T12:58:35.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f1825d56640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182006b420 0x7f1820150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f1825d56640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1820153f90 0x7f182015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f1825d56640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f182015dd20 0x7f1820152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f1825d56640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201f2d30 con 0x7f182006b420 2024-02-17T12:58:35.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f1825d56640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201e4670 con 0x7f182015dd20 2024-02-17T12:58:35.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f1825d56640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18201efd20 con 0x7f1820153f90 2024-02-17T12:58:35.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.904+0000 7f181effd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1820153f90 0x7f182015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.895 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:35.896 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T12:58:35.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.905+0000 7f181effd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1820153f90 0x7f182015a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39884/0 (socket says 172.21.15.136:39884) 2024-02-17T12:58:35.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.905+0000 7f181effd640 1 -- 172.21.15.136:0/3182221681 learned_addr learned my addr 172.21.15.136:0/3182221681 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:35.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.905+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 --> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f619c0c27a0 con 0x7f6188075070 2024-02-17T12:58:35.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.906+0000 7f6183fff640 1 -- 172.21.15.136:0/1127714933 <== osd.5 v2:172.21.15.160:6808/2660831410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6194001b80 con 0x7f6188075070 2024-02-17T12:58:35.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.906+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7f6188075070 msgr2=0x7f6188077510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.906+0000 7f61a21d7640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7f6188075070 0x7f6188077510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.898 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:35.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f618806b860 msgr2=0x7f618806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f618806b860 0x7f618806dd20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f618c036000 tx=0x7f618c02e000 comp rx=0 tx=0).stop 2024-02-17T12:58:35.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c150090 msgr2=0x7f619c1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 --2- 172.21.15.136:0/1127714933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f619c150090 0x7f619c1551a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f619000f990 tx=0x7f619000fe50 comp rx=0 tx=0).stop 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f619bfff640 1 -- 172.21.15.136:0/1127714933 reap_dead start 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 shutdown_connections 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 >> 172.21.15.136:0/1127714933 conn(0x7f619c06aac0 msgr2=0x7f619c0c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 shutdown_connections 2024-02-17T12:58:35.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.907+0000 7f61a21d7640 1 -- 172.21.15.136:0/1127714933 wait complete. 2024-02-17T12:58:35.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.908+0000 7f181effd640 1 -- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f182015dd20 msgr2=0x7f1820152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.908+0000 7f181effd640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f182015dd20 0x7f1820152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.908+0000 7f181effd640 1 -- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182006b420 msgr2=0x7f1820150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.908+0000 7f181effd640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182006b420 0x7f1820150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.908+0000 7f181effd640 1 -- 172.21.15.136:0/3182221681 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100094d0 con 0x7f1820153f90 2024-02-17T12:58:35.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.910+0000 7f181effd640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1820153f90 0x7f182015a6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f181400c7f0 tx=0x7f181400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.911+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 --> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d84161450 con 0x7f5d680750a0 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.911+0000 7f5d79ffb640 1 -- 172.21.15.136:0/1480560370 <== osd.3 v2:172.21.15.136:6824/918147356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d7c02cac0 con 0x7f5d680750a0 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f5d680750a0 msgr2=0x7f5d68077540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f5d680750a0 0x7f5d68077540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d6806b890 msgr2=0x7f5d6806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d6806b890 0x7f5d6806dd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d84145cb0 tx=0x7f5d74007990 comp rx=0 tx=0).stop 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84071d80 msgr2=0x7f5d84147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 --2- 172.21.15.136:0/1480560370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84071d80 0x7f5d84147bb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c410 tx=0x7f5d8000c8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d89aec640 1 -- 172.21.15.136:0/1480560370 reap_dead start 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 shutdown_connections 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 >> 172.21.15.136:0/1480560370 conn(0x7f5d8406aac0 msgr2=0x7f5d84155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 shutdown_connections 2024-02-17T12:58:35.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.912+0000 7f5d8b54f640 1 -- 172.21.15.136:0/1480560370 wait complete. 2024-02-17T12:58:35.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.914+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814004230 con 0x7f1820153f90 2024-02-17T12:58:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.915+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 --> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feba8067e00 con 0x7feb8c074ff0 2024-02-17T12:58:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.914+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1814004390 con 0x7f1820153f90 2024-02-17T12:58:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.915+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814004230 con 0x7f1820153f90 2024-02-17T12:58:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.915+0000 7f1825d56640 1 -- 172.21.15.136:0/3182221681 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18201f0000 con 0x7f1820153f90 2024-02-17T12:58:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.915+0000 7f1825d56640 1 -- 172.21.15.136:0/3182221681 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18201f05c0 con 0x7f1820153f90 2024-02-17T12:58:35.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.915+0000 7feb9e7fc640 1 -- 172.21.15.136:0/3784901644 <== osd.4 v2:172.21.15.160:6800/2188049654 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feba8067e00 con 0x7feb8c074ff0 2024-02-17T12:58:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.916+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7feb8c074ff0 msgr2=0x7feb8c077490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.916+0000 7febafb87640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7feb8c074ff0 0x7feb8c077490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.916+0000 7f1825d56640 1 -- 172.21.15.136:0/3182221681 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f182015d800 con 0x7f1820153f90 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feb8c06b860 msgr2=0x7feb8c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feb8c06b860 0x7feb8c06dd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feba4036000 tx=0x7feba403b040 comp rx=0 tx=0).stop 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba80c7d30 msgr2=0x7feba80ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 --2- 172.21.15.136:0/3784901644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feba80c7d30 0x7feba80ccc80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb9800e8d0 tx=0x7feb9800ed90 comp rx=0 tx=0).stop 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febae124640 1 -- 172.21.15.136:0/3784901644 reap_dead start 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 shutdown_connections 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 >> 172.21.15.136:0/3784901644 conn(0x7feba8070790 msgr2=0x7feba80b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.917+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 shutdown_connections 2024-02-17T12:58:35.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.918+0000 7febafb87640 1 -- 172.21.15.136:0/3784901644 wait complete. 2024-02-17T12:58:35.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.923+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe7000041b0 con 0x7fe6fc0047c0 2024-02-17T12:58:35.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.923+0000 7fe706ffd640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6f406b860 0x7fe6f406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.914 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:35.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T12:58:35.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.924+0000 7fe715c9d640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6f406b860 0x7fe6f406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.925+0000 7fe715c9d640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6f406b860 0x7fe6f406dd20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe70c034000 tx=0x7fe70c02e000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.929+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fe700059790 con 0x7fe6fc0047c0 2024-02-17T12:58:35.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.929+0000 7fe706ffd640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7fe6f4075000 0x7fe6f40774a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.929+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 --> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6f4077b70 con 0x7fe6f4075000 2024-02-17T12:58:35.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.930+0000 7fe716c9f640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7fe6f4075000 0x7fe6f40774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.921 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:35.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T12:58:35.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.931+0000 7fe716c9f640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7fe6f4075000 0x7fe6f40774a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.932+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== osd.2 v2:172.21.15.136:6808/1843608595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe6f4077b70 con 0x7fe6f4075000 2024-02-17T12:58:35.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.932+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe700055330 con 0x7fe6fc0047c0 2024-02-17T12:58:35.926 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:35.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T12:58:35.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.938+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1814007830 con 0x7f1820153f90 2024-02-17T12:58:35.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.939+0000 7f1807fff640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f180c06b8a0 0x7f180c06dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.939+0000 7f181f7fe640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f180c06b8a0 0x7f180c06dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.941+0000 7f181f7fe640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f180c06b8a0 0x7f180c06dd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1810036000 tx=0x7f1810030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.941+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f1814059230 con 0x7f1820153f90 2024-02-17T12:58:35.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.941+0000 7f1807fff640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f180c074fb0 0x7f180c077450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:35.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.941+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 --> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f180c077b20 con 0x7f180c074fb0 2024-02-17T12:58:35.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.942+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f181400a3b0 con 0x7f1820153f90 2024-02-17T12:58:35.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.942+0000 7f181ffff640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f180c074fb0 0x7f180c077450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:35.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.943+0000 7f181ffff640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f180c074fb0 0x7f180c077450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:35.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.944+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== osd.6 v2:172.21.15.160:6824/2024415336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f180c077b20 con 0x7f180c074fb0 2024-02-17T12:58:35.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.964+0000 7fe718702640 1 -- 172.21.15.136:0/3687205795 --> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7100c70b0 con 0x7fe6f4075000 2024-02-17T12:58:35.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.965+0000 7fe706ffd640 1 -- 172.21.15.136:0/3687205795 <== osd.2 v2:172.21.15.136:6808/1843608595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7080075e0 con 0x7fe6f4075000 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.965+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7fe6f4075000 msgr2=0x7fe6f40774a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.965+0000 7fe704ff9640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7fe6f4075000 0x7fe6f40774a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6f406b860 msgr2=0x7fe6f406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe704ff9640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6f406b860 0x7fe6f406dd20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe70c034000 tx=0x7fe70c02e000 comp rx=0 tx=0).stop 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 msgr2=0x7fe7100c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe704ff9640 1 --2- 172.21.15.136:0/3687205795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6fc0047c0 0x7fe7100c5070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe70000e410 tx=0x7fe70000e8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe716c9f640 1 -- 172.21.15.136:0/3687205795 reap_dead start 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 shutdown_connections 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.966+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 >> 172.21.15.136:0/3687205795 conn(0x7fe7100c7e90 msgr2=0x7fe710155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.967+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 shutdown_connections 2024-02-17T12:58:35.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.967+0000 7fe704ff9640 1 -- 172.21.15.136:0/3687205795 wait complete. 2024-02-17T12:58:35.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.978+0000 7f1825d56640 1 -- 172.21.15.136:0/3182221681 --> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f182015d520 con 0x7f180c074fb0 2024-02-17T12:58:35.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.978+0000 7f1807fff640 1 -- 172.21.15.136:0/3182221681 <== osd.6 v2:172.21.15.160:6824/2024415336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1818006b10 con 0x7f180c074fb0 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f180c074fb0 msgr2=0x7f180c077450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f1805ffb640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f180c074fb0 0x7f180c077450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f180c06b8a0 msgr2=0x7f180c06dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f1805ffb640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f180c06b8a0 0x7f180c06dd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1810036000 tx=0x7f1810030000 comp rx=0 tx=0).stop 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1820153f90 msgr2=0x7f182015a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f1805ffb640 1 --2- 172.21.15.136:0/3182221681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1820153f90 0x7f182015a6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f181400c7f0 tx=0x7f181400ccb0 comp rx=0 tx=0).stop 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.979+0000 7f181ffff640 1 -- 172.21.15.136:0/3182221681 reap_dead start 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.980+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 shutdown_connections 2024-02-17T12:58:35.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.980+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 >> 172.21.15.136:0/3182221681 conn(0x7f18200723d0 msgr2=0x7f18200cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:35.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.980+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 shutdown_connections 2024-02-17T12:58:35.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:35.980+0000 7f1805ffb640 1 -- 172.21.15.136:0/3182221681 wait complete. 2024-02-17T12:58:35.975 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:35.975 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-17T12:58:35.990 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:35.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-17T12:58:36.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.056+0000 7fa90ffff640 1 Processor -- start 2024-02-17T12:58:36.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.056+0000 7fa90ffff640 1 -- start start 2024-02-17T12:58:36.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.057+0000 7fa90ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa910151ac0 0x7fa9101577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.057+0000 7fa90ffff640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100c7900 con 0x7fa91006c300 2024-02-17T12:58:36.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.057+0000 7fa90ffff640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91015b680 con 0x7fa9100c5df0 2024-02-17T12:58:36.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.057+0000 7fa90ffff640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91015ad90 con 0x7fa910151ac0 2024-02-17T12:58:36.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.059+0000 7fa90f7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa91006c300 0x7fa910162120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37984/0 (socket says 172.21.15.136:37984) 2024-02-17T12:58:36.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.059+0000 7fa90f7fe640 1 -- 172.21.15.136:0/594016911 learned_addr learned my addr 172.21.15.136:0/594016911 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:36.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.060+0000 7fa90effd640 1 --2- 172.21.15.136:0/594016911 >> v2:172.21.15.136:3300/0 conn(0x7fa910151ac0 0x7fa9101577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.072+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810246594 0 0) 0x7fa9100c7900 con 0x7fa91006c300 2024-02-17T12:58:36.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.072+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f8003520 con 0x7fa91006c300 2024-02-17T12:58:36.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.073+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032455048 0 0) 0x7fa91015b680 con 0x7fa9100c5df0 2024-02-17T12:58:36.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.073+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9100c7900 con 0x7fa9100c5df0 2024-02-17T12:58:36.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.073+0000 7fa90effd640 1 -- 172.21.15.136:0/594016911 >> v1:172.21.15.160:6789/0 conn(0x7fa9100c5df0 legacy=0x7fa9100c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.073+0000 7fa90effd640 1 -- 172.21.15.136:0/594016911 >> v1:172.21.15.136:6789/0 conn(0x7fa91006c300 legacy=0x7fa910162120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.073+0000 7fa90effd640 1 -- 172.21.15.136:0/594016911 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910151ea0 con 0x7fa910151ac0 2024-02-17T12:58:36.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.078+0000 7fa90effd640 1 --2- 172.21.15.136:0/594016911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910151ac0 0x7fa9101577a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097a0 tx=0x7fa90402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0cb43c9beac2d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.083+0000 7f7e48ed0640 1 Processor -- start 2024-02-17T12:58:36.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.083+0000 7f7e48ed0640 1 -- start start 2024-02-17T12:58:36.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.083+0000 7fb61d5c7640 1 Processor -- start 2024-02-17T12:58:36.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7f7e48ed0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7e4406dab0 0x7f7e4406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7f7e48ed0640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7e4406de90 0x7f7e4406aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7f7e48ed0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 0x7f7e4414f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7f7e48ed0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e44156990 con 0x7f7e4406dab0 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7f7e48ed0640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4406b500 con 0x7f7e4406de90 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7f7e48ed0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44155d10 con 0x7f7e4406b000 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7f7e41d9b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7e4406de90 0x7f7e4406aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 0x7f7e4414f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.084+0000 7fb61d5c7640 1 -- start start 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7fb61d5c7640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb6180c6480 0x7fb6181583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7fb61d5c7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb61806dce0 0x7fb6180c5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7fb61d5c7640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6180708f0 con 0x7fb618157fd0 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7fb61d5c7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb618071100 con 0x7fb61806dce0 2024-02-17T12:58:36.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7fb61d5c7640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180c57a0 con 0x7fb6180c6480 2024-02-17T12:58:36.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 0x7f7e4414f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39892/0 (socket says 172.21.15.136:39892) 2024-02-17T12:58:36.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.085+0000 7f7e42d9d640 1 -- 172.21.15.136:0/1476338813 learned_addr learned my addr 172.21.15.136:0/1476338813 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.087+0000 7f7e4259c640 1 --2- 172.21.15.136:0/1476338813 >> v2:172.21.15.136:3300/0 conn(0x7f7e4406dab0 0x7f7e4406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.087+0000 7f7e42d9d640 1 -- 172.21.15.136:0/1476338813 >> v2:172.21.15.160:3300/0 conn(0x7f7e4406de90 msgr2=0x7f7e4406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.087+0000 7f7e42d9d640 1 --2- 172.21.15.136:0/1476338813 >> v2:172.21.15.160:3300/0 conn(0x7f7e4406de90 0x7f7e4406aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.087+0000 7f7e42d9d640 1 -- 172.21.15.136:0/1476338813 >> v2:172.21.15.136:3300/0 conn(0x7f7e4406dab0 msgr2=0x7f7e4406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.088+0000 7f7e42d9d640 1 --2- 172.21.15.136:0/1476338813 >> v2:172.21.15.136:3300/0 conn(0x7f7e4406dab0 0x7f7e4406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.088+0000 7f7e42d9d640 1 -- 172.21.15.136:0/1476338813 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44155ff0 con 0x7f7e4406b000 2024-02-17T12:58:36.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.089+0000 7fb6167fc640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb6180c6480 0x7fb6181583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.089+0000 7fa0ceb6c640 1 Processor -- start 2024-02-17T12:58:36.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.090+0000 7fa0ceb6c640 1 -- start start 2024-02-17T12:58:36.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.090+0000 7f7e42d9d640 1 --2- 172.21.15.136:0/1476338813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 0x7f7e4414f9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e440c7df0 tx=0x7f7e34030750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721862fef5b6d7fd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.090+0000 7fb6167fc640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb6180c6480 0x7fb6181583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59190/0 (socket says 172.21.15.136:59190) 2024-02-17T12:58:36.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.090+0000 7fb6167fc640 1 -- 172.21.15.136:0/3682861531 learned_addr learned my addr 172.21.15.136:0/3682861531 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.091+0000 7fa0ceb6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.091+0000 7fa0ceb6c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c80c6f40 con 0x7fa0c80c31d0 2024-02-17T12:58:36.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.091+0000 7fa0ceb6c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c80c8a50 con 0x7fa0c8151b80 2024-02-17T12:58:36.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.091+0000 7fa0ceb6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80c6570 con 0x7fa0c8070120 2024-02-17T12:58:36.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.091+0000 7fb6177fe640 1 --2- 172.21.15.136:0/3682861531 >> v2:172.21.15.136:3300/0 conn(0x7fb61806dce0 0x7fb6180c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.092+0000 7fa0cc908640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa0c8151b80 0x7fa0c80c5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:52104/0 (socket says 172.21.15.136:52104) 2024-02-17T12:58:36.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.092+0000 7fa0cc908640 1 -- 172.21.15.136:0/2193134031 learned_addr learned my addr 172.21.15.136:0/2193134031 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:36.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.093+0000 7fb6167fc640 1 -- 172.21.15.136:0/3682861531 >> v2:172.21.15.136:3300/0 conn(0x7fb61806dce0 msgr2=0x7fb6180c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.093+0000 7fb6167fc640 1 --2- 172.21.15.136:0/3682861531 >> v2:172.21.15.136:3300/0 conn(0x7fb61806dce0 0x7fb6180c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.093+0000 7fb6167fc640 1 -- 172.21.15.136:0/3682861531 >> v1:172.21.15.136:6789/0 conn(0x7fb618157fd0 legacy=0x7fb61815e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.093+0000 7fb6167fc640 1 -- 172.21.15.136:0/3682861531 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61806e130 con 0x7fb6180c6480 2024-02-17T12:58:36.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.094+0000 7fa0cd109640 1 --2- 172.21.15.136:0/2193134031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.095+0000 7f7e4159a640 1 -- 172.21.15.136:0/1476338813 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34008730 con 0x7f7e4406b000 2024-02-17T12:58:36.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.095+0000 7f7e4159a640 1 -- 172.21.15.136:0/1476338813 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34033050 con 0x7f7e4406b000 2024-02-17T12:58:36.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.095+0000 7f7e4159a640 1 -- 172.21.15.136:0/1476338813 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34008ab0 con 0x7f7e4406b000 2024-02-17T12:58:36.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.095+0000 7f0387dbc640 1 Processor -- start 2024-02-17T12:58:36.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.095+0000 7f0387dbc640 1 -- start start 2024-02-17T12:58:36.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 -- 172.21.15.136:0/1476338813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 msgr2=0x7f7e4414f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/1476338813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 0x7f7e4414f9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e440c7df0 tx=0x7f7e34030750 comp rx=0 tx=0).stop 2024-02-17T12:58:36.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 -- 172.21.15.136:0/1476338813 shutdown_connections 2024-02-17T12:58:36.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/1476338813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406b000 0x7f7e4414f9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/1476338813 >> v2:172.21.15.160:3300/0 conn(0x7f7e4406de90 0x7f7e4406aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/1476338813 >> v2:172.21.15.136:3300/0 conn(0x7f7e4406dab0 0x7f7e4406d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 -- 172.21.15.136:0/1476338813 >> 172.21.15.136:0/1476338813 conn(0x7f7e440c7e90 msgr2=0x7f7e440c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f0387dbc640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f03800c72f0 0x7f03800b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f0387dbc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03800b1320 con 0x7f03800b30a0 2024-02-17T12:58:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f0387dbc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03800c9ef0 con 0x7f03800c7cc0 2024-02-17T12:58:36.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f0387dbc640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03800ca1d0 con 0x7f03800c72f0 2024-02-17T12:58:36.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 -- 172.21.15.136:0/1476338813 shutdown_connections 2024-02-17T12:58:36.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.096+0000 7f7e48ed0640 1 -- 172.21.15.136:0/1476338813 wait complete. 2024-02-17T12:58:36.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.097+0000 7fb6167fc640 1 --2- 172.21.15.136:0/3682861531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6180c6480 0x7fb6181583b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb610009e50 tx=0x7fb61002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cb0335e3538f65e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.097+0000 7fa0cd109640 1 -- 172.21.15.136:0/2193134031 >> v1:172.21.15.160:6789/0 conn(0x7fa0c8151b80 legacy=0x7fa0c80c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.097+0000 7fa0cd109640 1 -- 172.21.15.136:0/2193134031 >> v1:172.21.15.136:6789/0 conn(0x7fa0c80c31d0 legacy=0x7fa0c806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.097+0000 7fa0cd109640 1 -- 172.21.15.136:0/2193134031 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c80c71e0 con 0x7fa0c8070120 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.098+0000 7f7e48ed0640 1 Processor -- start 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.098+0000 7f7e48ed0640 1 -- start start 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.099+0000 7f7e48ed0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e4406b000 0x7f7e44155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.099+0000 7f7e48ed0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 0x7f7e441f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.099+0000 7f7e48ed0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4406de90 0x7f7e441f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.099+0000 7f7e48ed0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44143630 con 0x7f7e4406de90 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.099+0000 7f7e48ed0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c1e10 con 0x7f7e4406b000 2024-02-17T12:58:36.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.099+0000 7f7e48ed0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c3c30 con 0x7f7e4406dab0 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.100+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90402f840 con 0x7fa910151ac0 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.100+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90402f9a0 con 0x7fa910151ac0 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.100+0000 7fa90dffb640 1 -- 172.21.15.136:0/594016911 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90402fd30 con 0x7fa910151ac0 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 -- 172.21.15.136:0/594016911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910151ac0 msgr2=0x7fa9101577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 --2- 172.21.15.136:0/594016911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910151ac0 0x7fa9101577a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097a0 tx=0x7fa90402ba20 comp rx=0 tx=0).stop 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 -- 172.21.15.136:0/594016911 shutdown_connections 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 --2- 172.21.15.136:0/594016911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa910151ac0 0x7fa9101577a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 -- 172.21.15.136:0/594016911 >> 172.21.15.136:0/594016911 conn(0x7fa9100cb0d0 msgr2=0x7fa9100cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 -- 172.21.15.136:0/594016911 shutdown_connections 2024-02-17T12:58:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa0cd109640 1 --2- 172.21.15.136:0/2193134031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8163340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009dc0 tx=0x7fa0c002bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c2d7f79ed7c4ab server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.101+0000 7fa90ffff640 1 -- 172.21.15.136:0/594016911 wait complete. 2024-02-17T12:58:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.102+0000 7f0386359640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f03800b30a0 0x7f03800c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:37996/0 (socket says 172.21.15.136:37996) 2024-02-17T12:58:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.102+0000 7f0386359640 1 -- 172.21.15.136:0/371201846 learned_addr learned my addr 172.21.15.136:0/371201846 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.102+0000 7f0385b58640 1 --2- 172.21.15.136:0/371201846 >> v2:172.21.15.160:3300/0 conn(0x7f03800c72f0 0x7f03800b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.102+0000 7f7e41d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 0x7f7e441f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.103+0000 7fa90ffff640 1 Processor -- start 2024-02-17T12:58:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.103+0000 7fa90ffff640 1 -- start start 2024-02-17T12:58:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.103+0000 7ff9f0e98640 1 Processor -- start 2024-02-17T12:58:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.103+0000 7ff9f0e98640 1 -- start start 2024-02-17T12:58:36.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 0x7fa9101e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9100c5df0 0x7fa9101ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7f7e41d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 0x7f7e441f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39904/0 (socket says 172.21.15.136:39904) 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7f7e41d9b640 1 -- 172.21.15.136:0/283077176 learned_addr learned my addr 172.21.15.136:0/283077176 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa910151ac0 0x7fa9101edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7fa90ffff640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91014d260 con 0x7fa91006c300 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7fa90ffff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91014b840 con 0x7fa9100c5df0 2024-02-17T12:58:36.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.104+0000 7fa90ffff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91014c6c0 con 0x7fa910151ac0 2024-02-17T12:58:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.105+0000 7ff9f0e98640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec151e70 0x7ff9ec0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.105+0000 7ff9f0e98640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff9ec0c76d0 0x7ff9ec0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.105+0000 7ff9f0e98640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec0b31f0 con 0x7ff9ec0c7d30 2024-02-17T12:58:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.105+0000 7ff9f0e98640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0b34d0 con 0x7ff9ec0c76d0 2024-02-17T12:58:36.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.105+0000 7ff9f0e98640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c8830 con 0x7ff9ec151e70 2024-02-17T12:58:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.105+0000 7f0385b58640 1 -- 172.21.15.136:0/371201846 >> v1:172.21.15.160:6789/0 conn(0x7f03800c7cc0 legacy=0x7f038015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.106+0000 7f0385b58640 1 -- 172.21.15.136:0/371201846 >> v1:172.21.15.136:6789/0 conn(0x7f03800b30a0 legacy=0x7f03800c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.106+0000 7f0385b58640 1 -- 172.21.15.136:0/371201846 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800ca4b0 con 0x7f03800c72f0 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.106+0000 7fa0c77fe640 1 -- 172.21.15.136:0/2193134031 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c002ccc0 con 0x7fa0c8070120 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.106+0000 7fa0c77fe640 1 -- 172.21.15.136:0/2193134031 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c002ce20 con 0x7fa0c8070120 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.106+0000 7fa0c77fe640 1 -- 172.21.15.136:0/2193134031 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0034660 con 0x7fa0c8070120 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/2193134031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 msgr2=0x7fa0c8163340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/2193134031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8163340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009dc0 tx=0x7fa0c002bf10 comp rx=0 tx=0).stop 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/2193134031 shutdown_connections 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/2193134031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8163340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/2193134031 >> 172.21.15.136:0/2193134031 conn(0x7fa0c806bbd0 msgr2=0x7fa0c806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/2193134031 shutdown_connections 2024-02-17T12:58:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/2193134031 wait complete. 2024-02-17T12:58:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fb615ffb640 1 -- 172.21.15.136:0/3682861531 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61002ca80 con 0x7fb6180c6480 2024-02-17T12:58:36.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.107+0000 7fb615ffb640 1 -- 172.21.15.136:0/3682861531 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61002cbe0 con 0x7fb6180c6480 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb615ffb640 1 -- 172.21.15.136:0/3682861531 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100343f0 con 0x7fb6180c6480 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 -- 172.21.15.136:0/3682861531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6180c6480 msgr2=0x7fb6181583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/3682861531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6180c6480 0x7fb6181583b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb610009e50 tx=0x7fb61002bee0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 -- 172.21.15.136:0/3682861531 shutdown_connections 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/3682861531 >> v2:172.21.15.136:3300/0 conn(0x7fb61806dce0 0x7fb6180c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/3682861531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6180c6480 0x7fb6181583b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 -- 172.21.15.136:0/3682861531 >> 172.21.15.136:0/3682861531 conn(0x7fb6180c7e90 msgr2=0x7fb6180c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7f7e42d9d640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4406de90 0x7f7e441f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 -- 172.21.15.136:0/3682861531 shutdown_connections 2024-02-17T12:58:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fb61d5c7640 1 -- 172.21.15.136:0/3682861531 wait complete. 2024-02-17T12:58:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fa0ceb6c640 1 Processor -- start 2024-02-17T12:58:36.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.108+0000 7fa0ceb6c640 1 -- start start 2024-02-17T12:58:36.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7f7e41d9b640 1 -- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e4406b000 msgr2=0x7f7e44155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7f7e41d9b640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e4406b000 0x7f7e44155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7f7e41d9b640 1 -- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4406de90 msgr2=0x7f7e441f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7f7e41d9b640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4406de90 0x7f7e441f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7f7e41d9b640 1 -- 172.21.15.136:0/283077176 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34007d80 con 0x7f7e4406dab0 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7fa0ceb6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7fa0ceb6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 0x7fa0c8154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7fa0ceb6c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0c8151b80 0x7fa0c8152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7fa0ceb6c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8152540 con 0x7fa0c8151b80 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7fa0ceb6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8154240 con 0x7fa0c80c31d0 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.109+0000 7fa0ceb6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c81f3e20 con 0x7fa0c8070120 2024-02-17T12:58:36.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fb61d5c7640 1 Processor -- start 2024-02-17T12:58:36.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fb61d5c7640 1 -- start start 2024-02-17T12:58:36.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7f0385b58640 1 --2- 172.21.15.136:0/371201846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800c72f0 0x7f03800b17b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097a0 tx=0x7f037c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac551223d8e2685e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fb61d5c7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb61806dce0 0x7fb618145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fb61d5c7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 0x7fb618146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fb61d5c7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb618157fd0 0x7fb61812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fa90e7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9100c5df0 0x7fa9101ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.110+0000 7fb61d5c7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618134890 con 0x7fb61806dce0 2024-02-17T12:58:36.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.111+0000 7fb61d5c7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61806d370 con 0x7fb618157fd0 2024-02-17T12:58:36.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.111+0000 7fb61d5c7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61814aa70 con 0x7fb6180c6480 2024-02-17T12:58:36.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.111+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 0x7fa0c8154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.112+0000 7fa90effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 0x7fa9101e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.112+0000 7ff9e9d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff9ec0c76d0 0x7ff9ec0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.112+0000 7fa90effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 0x7fa9101e4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50410/0 (socket says 172.21.15.136:50410) 2024-02-17T12:58:36.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.112+0000 7fa90effd640 1 -- 172.21.15.136:0/1438487749 learned_addr learned my addr 172.21.15.136:0/1438487749 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.113+0000 7ff9e9d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff9ec0c76d0 0x7ff9ec0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50418/0 (socket says 172.21.15.136:50418) 2024-02-17T12:58:36.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.113+0000 7ff9e9d9b640 1 -- 172.21.15.136:0/366777360 learned_addr learned my addr 172.21.15.136:0/366777360 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.113+0000 7f7e41d9b640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 0x7f7e441f3af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00efc0 tx=0x7f7e3c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.114+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 0x7fa0c8154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59228/0 (socket says 172.21.15.136:59228) 2024-02-17T12:58:36.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.114+0000 7fa0c7fff640 1 -- 172.21.15.136:0/1715814630 learned_addr learned my addr 172.21.15.136:0/1715814630 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.116+0000 7fa90f7fe640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa910151ac0 0x7fa9101edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.117+0000 7fa90effd640 1 -- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa910151ac0 msgr2=0x7fa9101edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.117+0000 7fa90effd640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa910151ac0 0x7fa9101edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.117+0000 7fa90effd640 1 -- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9100c5df0 msgr2=0x7fa9101ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.117+0000 7fa90effd640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9100c5df0 0x7fa9101ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.109 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.117+0000 7fa90effd640 1 -- 172.21.15.136:0/1438487749 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904009400 con 0x7fa91006c300 2024-02-17T12:58:36.109 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.118+0000 7ff9ea59c640 1 --2- 172.21.15.136:0/366777360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec151e70 0x7ff9ec0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.109 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.119+0000 7ff9e9d9b640 1 -- 172.21.15.136:0/366777360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec151e70 msgr2=0x7ff9ec0c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.110 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.119+0000 7ff9e9d9b640 1 --2- 172.21.15.136:0/366777360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec151e70 0x7ff9ec0c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.110 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.119+0000 7ff9e9d9b640 1 -- 172.21.15.136:0/366777360 >> v1:172.21.15.136:6789/0 conn(0x7ff9ec0c7d30 legacy=0x7ff9ec0b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.110 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.119+0000 7ff9e9d9b640 1 -- 172.21.15.136:0/366777360 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0c8b10 con 0x7ff9ec0c76d0 2024-02-17T12:58:36.110 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c014480 con 0x7f7e4406dab0 2024-02-17T12:58:36.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00f040 con 0x7f7e4406dab0 2024-02-17T12:58:36.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c014800 con 0x7f7e4406dab0 2024-02-17T12:58:36.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e44142870 con 0x7f7e4406dab0 2024-02-17T12:58:36.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fb6167fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 0x7fb618146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e44142e30 con 0x7f7e4406dab0 2024-02-17T12:58:36.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fa0cc908640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fa0c7fff640 1 -- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 msgr2=0x7fa0c8153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fa0c7fff640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fa0c7fff640 1 -- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0c8151b80 msgr2=0x7fa0c8152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fa0c7fff640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0c8151b80 0x7fa0c8152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.120+0000 7fa0c7fff640 1 -- 172.21.15.136:0/1715814630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0009a70 con 0x7fa0c80c31d0 2024-02-17T12:58:36.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.121+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e440c6f90 con 0x7f7e4406dab0 2024-02-17T12:58:36.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.121+0000 7fb6167fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 0x7fb618146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39958/0 (socket says 172.21.15.136:39958) 2024-02-17T12:58:36.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.121+0000 7fb6167fc640 1 -- 172.21.15.136:0/423733788 learned_addr learned my addr 172.21.15.136:0/423733788 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.126+0000 7fa90effd640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 0x7fa9101e4160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa90402c030 tx=0x7fa904004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.127+0000 7ff9e9d9b640 1 --2- 172.21.15.136:0/366777360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec0c76d0 0x7ff9ec0c9660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009870 tx=0x7ff9e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f0f9d48f81ba40 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.127+0000 7fb616ffd640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb61806dce0 0x7fb618145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.128+0000 7fb6167fc640 1 -- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb618157fd0 msgr2=0x7fb61812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.128+0000 7fb6167fc640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb618157fd0 0x7fb61812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.128+0000 7fb6167fc640 1 -- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb61806dce0 msgr2=0x7fb618145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.128+0000 7fb6167fc640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb61806dce0 0x7fb618145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.128+0000 7fb6167fc640 1 -- 172.21.15.136:0/423733788 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009b30 con 0x7fb6180c6480 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.129+0000 7f0384b56640 1 -- 172.21.15.136:0/371201846 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c030610 con 0x7f03800c72f0 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.129+0000 7f0384b56640 1 -- 172.21.15.136:0/371201846 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c030770 con 0x7f03800c72f0 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.129+0000 7f0384b56640 1 -- 172.21.15.136:0/371201846 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c030b00 con 0x7f03800c72f0 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 -- 172.21.15.136:0/371201846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800c72f0 msgr2=0x7f03800b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 --2- 172.21.15.136:0/371201846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800c72f0 0x7f03800b17b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097a0 tx=0x7f037c02b960 comp rx=0 tx=0).stop 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 -- 172.21.15.136:0/371201846 shutdown_connections 2024-02-17T12:58:36.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 --2- 172.21.15.136:0/371201846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800c72f0 0x7f03800b17b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 -- 172.21.15.136:0/371201846 >> 172.21.15.136:0/371201846 conn(0x7f03800706e0 msgr2=0x7f0380070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 -- 172.21.15.136:0/371201846 shutdown_connections 2024-02-17T12:58:36.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7f0387dbc640 1 -- 172.21.15.136:0/371201846 wait complete. 2024-02-17T12:58:36.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.130+0000 7fa0c7fff640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 0x7fa0c8154b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c430 tx=0x7fa0b400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.131+0000 7f0387dbc640 1 Processor -- start 2024-02-17T12:58:36.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.131+0000 7f0387dbc640 1 -- start start 2024-02-17T12:58:36.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.132+0000 7f0387dbc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 0x7f03800c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.132+0000 7f0387dbc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03800c72f0 0x7f0380157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.132+0000 7f0387dbc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03800c7cc0 0x7f03800c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.132+0000 7f0387dbc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801570d0 con 0x7f03800c72f0 2024-02-17T12:58:36.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.132+0000 7f0387dbc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801ef460 con 0x7f03800b30a0 2024-02-17T12:58:36.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.132+0000 7f0387dbc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03801eebf0 con 0x7f03800c7cc0 2024-02-17T12:58:36.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.140+0000 7f0385b58640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 0x7f03800c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.140+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90403c040 con 0x7fa91006c300 2024-02-17T12:58:36.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.140+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904037bc0 con 0x7fa91006c300 2024-02-17T12:58:36.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.140+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9101e3280 con 0x7fa91006c300 2024-02-17T12:58:36.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.140+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040423f0 con 0x7fa91006c300 2024-02-17T12:58:36.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.140+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91014cc10 con 0x7fa91006c300 2024-02-17T12:58:36.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.141+0000 7ff9e959a640 1 -- 172.21.15.136:0/366777360 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0030840 con 0x7ff9ec0c76d0 2024-02-17T12:58:36.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.141+0000 7ff9e959a640 1 -- 172.21.15.136:0/366777360 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e00309a0 con 0x7ff9ec0c76d0 2024-02-17T12:58:36.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.141+0000 7ff9e959a640 1 -- 172.21.15.136:0/366777360 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0030d30 con 0x7ff9ec0c76d0 2024-02-17T12:58:36.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.141+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9100706f0 con 0x7fa91006c300 2024-02-17T12:58:36.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.141+0000 7f0385b58640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 0x7f03800c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59250/0 (socket says 172.21.15.136:59250) 2024-02-17T12:58:36.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 -- 172.21.15.136:0/366777360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec0c76d0 msgr2=0x7ff9ec0c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/366777360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec0c76d0 0x7ff9ec0c9660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009870 tx=0x7ff9e002b980 comp rx=0 tx=0).stop 2024-02-17T12:58:36.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.141+0000 7f0385b58640 1 -- 172.21.15.136:0/4155403339 learned_addr learned my addr 172.21.15.136:0/4155403339 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 -- 172.21.15.136:0/366777360 shutdown_connections 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/366777360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec0c76d0 0x7ff9ec0c9660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/366777360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec151e70 0x7ff9ec0c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 -- 172.21.15.136:0/366777360 >> 172.21.15.136:0/366777360 conn(0x7ff9ec070790 msgr2=0x7ff9ec070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 -- 172.21.15.136:0/366777360 shutdown_connections 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7ff9f0e98640 1 -- 172.21.15.136:0/366777360 wait complete. 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40035f0 con 0x7fa0c80c31d0 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4003750 con 0x7fa0c80c31d0 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4003b00 con 0x7fa0c80c31d0 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c80cca20 con 0x7fa0c80c31d0 2024-02-17T12:58:36.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.142+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c8152160 con 0x7fa0c80c31d0 2024-02-17T12:58:36.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.143+0000 7f0385357640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03800c72f0 0x7f0380157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.144+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c8152680 con 0x7fa0c80c31d0 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.144+0000 7ff9f0e98640 1 Processor -- start 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.144+0000 7ff9f0e98640 1 -- start start 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.145+0000 7ff9f0e98640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9ec0c76d0 0x7ff9ec1e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.145+0000 7ff9f0e98640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec0c7d30 0x7ff9ec154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.145+0000 7ff9f0e98640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 0x7ff9ec1e3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.145+0000 7ff9f0e98640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1e2f60 con 0x7ff9ec151e70 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.145+0000 7ff9f0e98640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1eeaa0 con 0x7ff9ec0c76d0 2024-02-17T12:58:36.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.145+0000 7ff9f0e98640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1edf20 con 0x7ff9ec0c7d30 2024-02-17T12:58:36.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.148+0000 7f0385b58640 1 -- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03800c7cc0 msgr2=0x7f03800c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.148+0000 7f0385b58640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03800c7cc0 0x7f03800c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.148+0000 7f0385b58640 1 -- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03800c72f0 msgr2=0x7f0380157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.148+0000 7f0385b58640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03800c72f0 0x7f0380157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.148+0000 7f0385b58640 1 -- 172.21.15.136:0/4155403339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c009400 con 0x7f03800b30a0 2024-02-17T12:58:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.174+0000 7f0a9c535640 1 Processor -- start 2024-02-17T12:58:36.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.174+0000 7f0a9c535640 1 -- start start 2024-02-17T12:58:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.175+0000 7f0a9c535640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 0x7f0a9406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.175+0000 7f0a9c535640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0a940ca4e0 0x7f0a940cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.175+0000 7f0a9c535640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940cb470 con 0x7f0a940cc520 2024-02-17T12:58:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.175+0000 7f0a9c535640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a940cc930 con 0x7f0a940ca4e0 2024-02-17T12:58:36.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.175+0000 7f0a9c535640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940cb750 con 0x7f0a940cbc00 2024-02-17T12:58:36.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.184+0000 7f37d8584640 1 Processor -- start 2024-02-17T12:58:36.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.184+0000 7f37d8584640 1 -- start start 2024-02-17T12:58:36.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.185+0000 7f37d8584640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f37d0066a00 0x7f37d01583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.185+0000 7f37d8584640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.185+0000 7f37d8584640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d00716a0 con 0x7f37d0151b70 2024-02-17T12:58:36.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.185+0000 7f37d8584640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d01588e0 con 0x7f37d0066a00 2024-02-17T12:58:36.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.185+0000 7f37d8584640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d006c4a0 con 0x7f37d0072ec0 2024-02-17T12:58:36.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.225+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa0b4003c60 con 0x7fa0c80c31d0 2024-02-17T12:58:36.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.225+0000 7fa0c57fa640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa0ac06b810 0x7fa0ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.226+0000 7fa0cc908640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa0ac06b810 0x7fa0ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.226+0000 7fa0cc908640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa0ac06b810 0x7fa0ac06dcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc000f60 tx=0x7fa0bc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.232+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fa0b40010e0 con 0x7fa0c80c31d0 2024-02-17T12:58:36.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.384+0000 7f37d6b21640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.385+0000 7fb6167fc640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 0x7fb618146500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb610009e50 tx=0x7fb610004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.385+0000 7f37d6b21640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39990/0 (socket says 172.21.15.136:39990) 2024-02-17T12:58:36.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.385+0000 7f37d6b21640 1 -- 172.21.15.136:0/3461831504 learned_addr learned my addr 172.21.15.136:0/3461831504 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.407+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa90402d3d0 con 0x7fa91006c300 2024-02-17T12:58:36.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.408+0000 7fa8f77fe640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa8fc06b810 0x7fa8fc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.408+0000 7fa90e7fc640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa8fc06b810 0x7fa8fc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.408+0000 7fa90e7fc640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa8fc06b810 0x7fa8fc06dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa900007fd0 tx=0x7fa900009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.409+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7e3c014960 con 0x7f7e4406dab0 2024-02-17T12:58:36.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.409+0000 7f7e32ffd640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7e2406b890 0x7f7e2406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.409+0000 7f7e4259c640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7e2406b890 0x7f7e2406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.410+0000 7f7e4259c640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7e2406b890 0x7f7e2406dd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009870 tx=0x7f7e38008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.416+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f7e3c05a3f0 con 0x7f7e4406dab0 2024-02-17T12:58:36.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.430+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fa90404ee40 con 0x7fa91006c300 2024-02-17T12:58:36.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.430+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa904077460 con 0x7fa91006c300 2024-02-17T12:58:36.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.435+0000 7f37d6b21640 1 -- 172.21.15.136:0/3461831504 >> v2:172.21.15.160:3300/0 conn(0x7f37d0066a00 msgr2=0x7f37d01583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.435+0000 7f37d6b21640 1 --2- 172.21.15.136:0/3461831504 >> v2:172.21.15.160:3300/0 conn(0x7f37d0066a00 0x7f37d01583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.435+0000 7f37d6b21640 1 -- 172.21.15.136:0/3461831504 >> v1:172.21.15.136:6789/0 conn(0x7f37d0151b70 legacy=0x7f37d00c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.435+0000 7f37d6b21640 1 -- 172.21.15.136:0/3461831504 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d006bee0 con 0x7f37d0072ec0 2024-02-17T12:58:36.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.437+0000 7ff9ead9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 0x7ff9ec1e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.438+0000 7ff9ead9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 0x7ff9ec1e3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50442/0 (socket says 172.21.15.136:50442) 2024-02-17T12:58:36.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.438+0000 7ff9ead9d640 1 -- 172.21.15.136:0/1129109121 learned_addr learned my addr 172.21.15.136:0/1129109121 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.439+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e3c055f90 con 0x7f7e4406dab0 2024-02-17T12:58:36.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.440+0000 7ff9e9d9b640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec0c7d30 0x7ff9ec154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.442+0000 7ff9ead9d640 1 -- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec0c7d30 msgr2=0x7ff9ec154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.442+0000 7ff9ead9d640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec0c7d30 0x7ff9ec154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.442+0000 7ff9ead9d640 1 -- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9ec0c76d0 msgr2=0x7ff9ec1e23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.442+0000 7ff9ead9d640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9ec0c76d0 0x7ff9ec1e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.442+0000 7ff9ead9d640 1 -- 172.21.15.136:0/1129109121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00094d0 con 0x7ff9ec151e70 2024-02-17T12:58:36.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.445+0000 7ff9ead9d640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 0x7ff9ec1e3380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400c780 tx=0x7ff9e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.446+0000 7f37d6b21640 1 --2- 172.21.15.136:0/3461831504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c71d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009e50 tx=0x7f37c802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b959ec1e9a7c7a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.448+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4003d80 con 0x7ff9ec151e70 2024-02-17T12:58:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.448+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e400ce90 con 0x7ff9ec151e70 2024-02-17T12:58:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.448+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40052b0 con 0x7ff9ec151e70 2024-02-17T12:58:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.448+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec1ee200 con 0x7ff9ec151e70 2024-02-17T12:58:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.448+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec1ee7c0 con 0x7ff9ec151e70 2024-02-17T12:58:36.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.449+0000 7f0a9a2d1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 0x7f0a9406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.449+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec1e30a0 con 0x7ff9ec151e70 2024-02-17T12:58:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.451+0000 7f0a9a2d1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 0x7f0a9406acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39978/0 (socket says 172.21.15.136:39978) 2024-02-17T12:58:36.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.451+0000 7f0a9a2d1640 1 -- 172.21.15.136:0/4944407 learned_addr learned my addr 172.21.15.136:0/4944407 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.452+0000 7f37d531e640 1 -- 172.21.15.136:0/3461831504 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c802ca70 con 0x7f37d0072ec0 2024-02-17T12:58:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.452+0000 7f37d531e640 1 -- 172.21.15.136:0/3461831504 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c802cbd0 con 0x7f37d0072ec0 2024-02-17T12:58:36.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.452+0000 7f37d531e640 1 -- 172.21.15.136:0/3461831504 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c80343f0 con 0x7f37d0072ec0 2024-02-17T12:58:36.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 -- 172.21.15.136:0/3461831504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 msgr2=0x7f37d00c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 --2- 172.21.15.136:0/3461831504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c71d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009e50 tx=0x7f37c802bed0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 -- 172.21.15.136:0/3461831504 shutdown_connections 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 --2- 172.21.15.136:0/3461831504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c71d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 --2- 172.21.15.136:0/3461831504 >> v2:172.21.15.160:3300/0 conn(0x7f37d0066a00 0x7f37d01583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 -- 172.21.15.136:0/3461831504 >> 172.21.15.136:0/3461831504 conn(0x7f37d00c83d0 msgr2=0x7f37d00c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 -- 172.21.15.136:0/3461831504 shutdown_connections 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.453+0000 7f37d8584640 1 -- 172.21.15.136:0/3461831504 wait complete. 2024-02-17T12:58:36.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.454+0000 7f0a9a2d1640 1 -- 172.21.15.136:0/4944407 >> v2:172.21.15.160:3300/0 conn(0x7f0a940ca4e0 msgr2=0x7f0a940cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.454+0000 7f0a9a2d1640 1 --2- 172.21.15.136:0/4944407 >> v2:172.21.15.160:3300/0 conn(0x7f0a940ca4e0 0x7f0a940cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.454+0000 7f0a9a2d1640 1 -- 172.21.15.136:0/4944407 >> v1:172.21.15.160:6789/0 conn(0x7f0a940cc520 legacy=0x7f0a94159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:36.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.454+0000 7f0a9a2d1640 1 -- 172.21.15.136:0/4944407 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9415d1f0 con 0x7f0a940cbc00 2024-02-17T12:58:36.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.455+0000 7f37d8584640 1 Processor -- start 2024-02-17T12:58:36.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.455+0000 7f37d8584640 1 -- start start 2024-02-17T12:58:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.456+0000 7f37d8584640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37d0066a00 0x7f37d0152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.456+0000 7f37d8584640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.456+0000 7f37d8584640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37d0151b70 0x7f37d01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.456+0000 7f37d8584640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d01435a0 con 0x7f37d0151b70 2024-02-17T12:58:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.456+0000 7f37d8584640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00c26f0 con 0x7f37d0066a00 2024-02-17T12:58:36.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.456+0000 7f37d8584640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d0156ac0 con 0x7f37d0072ec0 2024-02-17T12:58:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.458+0000 7f0a9a2d1640 1 --2- 172.21.15.136:0/4944407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 0x7f0a9406acd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009870 tx=0x7f0a8402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=804e1fae10cd8173 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.458+0000 7f37d5b1f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.459+0000 7f37d5b1f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:39992/0 (socket says 172.21.15.136:39992) 2024-02-17T12:58:36.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.459+0000 7f37d5b1f640 1 -- 172.21.15.136:0/3824638914 learned_addr learned my addr 172.21.15.136:0/3824638914 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.463+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610009510 con 0x7fb6180c6480 2024-02-17T12:58:36.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.463+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61003e450 con 0x7fb6180c6480 2024-02-17T12:58:36.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.463+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb618157af0 con 0x7fb6180c6480 2024-02-17T12:58:36.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.463+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61003e7e0 con 0x7fb6180c6480 2024-02-17T12:58:36.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.463+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61806ca40 con 0x7fb6180c6480 2024-02-17T12:58:36.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.464+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0b4054380 con 0x7fa0c80c31d0 2024-02-17T12:58:36.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.464+0000 7f0385b58640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 0x7f03800c1d70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f037c02bf70 tx=0x7f037c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.465+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6180c2420 con 0x7fb6180c6480 2024-02-17T12:58:36.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.467+0000 7f37d5b1f640 1 -- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37d0066a00 msgr2=0x7f37d0152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.467+0000 7f37d5b1f640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37d0066a00 0x7f37d0152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.467+0000 7f37d5b1f640 1 -- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37d0151b70 msgr2=0x7f37d01574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.467+0000 7f37d5b1f640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37d0151b70 0x7f37d01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.467+0000 7f37d5b1f640 1 -- 172.21.15.136:0/3824638914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8009b30 con 0x7f37d0072ec0 2024-02-17T12:58:36.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.470+0000 7f37d5b1f640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c3f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37c000b3f0 tx=0x7f37c000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.480+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c03e040 con 0x7f03800b30a0 2024-02-17T12:58:36.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.480+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c039cf0 con 0x7f03800b30a0 2024-02-17T12:58:36.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.480+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0380158900 con 0x7f03800b30a0 2024-02-17T12:58:36.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.480+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0380158340 con 0x7f03800b30a0 2024-02-17T12:58:36.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.480+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c044630 con 0x7f03800b30a0 2024-02-17T12:58:36.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.481+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0368005290 con 0x7f03800b30a0 2024-02-17T12:58:36.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.622+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7e4404efc0 con 0x7f7e4406dab0 2024-02-17T12:58:36.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.670+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa9101ed240 con 0x7fa91006c300 2024-02-17T12:58:36.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.705+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa0c806fb50 con 0x7fa0c80c31d0 2024-02-17T12:58:36.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.716+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff9e4005410 con 0x7ff9ec151e70 2024-02-17T12:58:36.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.716+0000 7ff9daffd640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9cc06b860 0x7ff9cc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.717+0000 7ff9ea59c640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9cc06b860 0x7ff9cc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.717+0000 7ff9ea59c640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9cc06b860 0x7ff9cc06dd20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00a810 tx=0x7ff9dc008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.733+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7ff9e4058bf0 con 0x7ff9ec151e70 2024-02-17T12:58:36.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.733+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9e4054790 con 0x7ff9ec151e70 2024-02-17T12:58:36.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.742+0000 7fa8f77fe640 1 -- 172.21.15.136:0/1438487749 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa904047020 con 0x7fa91006c300 2024-02-17T12:58:36.732 INFO:teuthology.orchestra.run.smithi136.stdout:55834574861 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa8fc06b810 msgr2=0x7fa8fc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa8fc06b810 0x7fa8fc06dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa900007fd0 tx=0x7fa900009040 comp rx=0 tx=0).stop 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 msgr2=0x7fa9101e4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 0x7fa9101e4160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa90402c030 tx=0x7fa904004730 comp rx=0 tx=0).stop 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 shutdown_connections 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa8fc06b810 0x7fa8fc06dcd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa910151ac0 0x7fa9101edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9100c5df0 0x7fa9101ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 --2- 172.21.15.136:0/1438487749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa91006c300 0x7fa9101e4160 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 >> 172.21.15.136:0/1438487749 conn(0x7fa9100cb0d0 msgr2=0x7fa9100c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 shutdown_connections 2024-02-17T12:58:36.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.744+0000 7fa90ffff640 1 -- 172.21.15.136:0/1438487749 wait complete. 2024-02-17T12:58:36.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2024-02-17T12:58:36.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.760+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f037c04d3b0 con 0x7f03800b30a0 2024-02-17T12:58:36.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.760+0000 7f03767fc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f036406b860 0x7f036406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.761+0000 7f0385357640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f036406b860 0x7f036406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.761+0000 7f0385357640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f036406b860 0x7f036406dd20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f037000a750 tx=0x7f0370008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.766+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f037c07bab0 con 0x7f03800b30a0 2024-02-17T12:58:36.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f0a992cf640 1 -- 172.21.15.136:0/4944407 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84030840 con 0x7f0a940cbc00 2024-02-17T12:58:36.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f0a992cf640 1 -- 172.21.15.136:0/4944407 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a840309a0 con 0x7f0a940cbc00 2024-02-17T12:58:36.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f0a992cf640 1 -- 172.21.15.136:0/4944407 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84030d30 con 0x7f0a940cbc00 2024-02-17T12:58:36.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f0a9c535640 1 -- 172.21.15.136:0/4944407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 msgr2=0x7f0a9406acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f0a9c535640 1 --2- 172.21.15.136:0/4944407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 0x7f0a9406acd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009870 tx=0x7f0a8402b980 comp rx=0 tx=0).stop 2024-02-17T12:58:36.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f037c077650 con 0x7f03800b30a0 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.783+0000 7f0a9c535640 1 -- 172.21.15.136:0/4944407 shutdown_connections 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.784+0000 7f0a9c535640 1 --2- 172.21.15.136:0/4944407 >> v2:172.21.15.160:3300/0 conn(0x7f0a940ca4e0 0x7f0a940cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.784+0000 7f0a9c535640 1 --2- 172.21.15.136:0/4944407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cbc00 0x7f0a9406acd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.784+0000 7f0a9c535640 1 -- 172.21.15.136:0/4944407 >> 172.21.15.136:0/4944407 conn(0x7f0a940721f0 msgr2=0x7f0a940725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.784+0000 7f0a9c535640 1 -- 172.21.15.136:0/4944407 shutdown_connections 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.784+0000 7f0a9c535640 1 -- 172.21.15.136:0/4944407 wait complete. 2024-02-17T12:58:36.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.785+0000 7fa0c57fa640 1 -- 172.21.15.136:0/1715814630 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0b4017070 con 0x7fa0c80c31d0 2024-02-17T12:58:36.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.785+0000 7f0a9c535640 1 Processor -- start 2024-02-17T12:58:36.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.785+0000 7f0a9c535640 1 -- start start 2024-02-17T12:58:36.776 INFO:teuthology.orchestra.run.smithi136.stdout:55834574861 2024-02-17T12:58:36.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a9c535640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a940ca4e0 0x7f0a94155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a9c535640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 0x7f0a9406af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0005970 con 0x7f37d0072ec0 2024-02-17T12:58:36.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0005ad0 con 0x7f37d0072ec0 2024-02-17T12:58:36.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a9c535640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cc520 0x7f0a941ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0005e80 con 0x7f37d0072ec0 2024-02-17T12:58:36.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d0156ff0 con 0x7f37d0072ec0 2024-02-17T12:58:36.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a9c535640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9414df70 con 0x7f0a940cbc00 2024-02-17T12:58:36.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a9c535640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941548c0 con 0x7f0a940ca4e0 2024-02-17T12:58:36.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a9c535640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941f2c40 con 0x7f0a940cc520 2024-02-17T12:58:36.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d01ed080 con 0x7f37d0072ec0 2024-02-17T12:58:36.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.787+0000 7f0a99ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 0x7f0a9406af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa0ac06b810 msgr2=0x7fa0ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d0163090 con 0x7f37d0072ec0 2024-02-17T12:58:36.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa0ac06b810 0x7fa0ac06dcd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc000f60 tx=0x7fa0bc009040 comp rx=0 tx=0).stop 2024-02-17T12:58:36.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 msgr2=0x7fa0c8154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 0x7fa0c8154b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c430 tx=0x7fa0b400c8f0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7f0a99ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 0x7f0a9406af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50468/0 (socket says 172.21.15.136:50468) 2024-02-17T12:58:36.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7f0a99ad0640 1 -- 172.21.15.136:0/1477995226 learned_addr learned my addr 172.21.15.136:0/1477995226 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 shutdown_connections 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa0ac06b810 0x7fa0ac06dcd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0c8151b80 0x7fa0c8152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0c80c31d0 0x7fa0c8154b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 --2- 172.21.15.136:0/1715814630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0c8070120 0x7fa0c8153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 >> 172.21.15.136:0/1715814630 conn(0x7fa0c806bbd0 msgr2=0x7fa0c814e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 shutdown_connections 2024-02-17T12:58:36.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7fa0ceb6c640 1 -- 172.21.15.136:0/1715814630 wait complete. 2024-02-17T12:58:36.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.788+0000 7f0a9a2d1640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a940ca4e0 0x7f0a94155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.794+0000 7f0a99ad0640 1 -- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cc520 msgr2=0x7f0a941ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.794+0000 7f0a99ad0640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cc520 0x7f0a941ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.794+0000 7f0a99ad0640 1 -- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a940ca4e0 msgr2=0x7f0a94155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.794+0000 7f0a99ad0640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a940ca4e0 0x7f0a94155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.794+0000 7f0a99ad0640 1 -- 172.21.15.136:0/1477995226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840094d0 con 0x7f0a940cbc00 2024-02-17T12:58:36.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.798+0000 7f0a99ad0640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 0x7f0a9406af40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000b4a0 tx=0x7f0a9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.1 2024-02-17T12:58:36.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.808+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb61002cd50 con 0x7fb6180c6480 2024-02-17T12:58:36.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.809+0000 7fb5ff7fe640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb60406b810 0x7fb60406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:36.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.809+0000 7fb616ffd640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb60406b810 0x7fb60406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:36.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.809+0000 7fb616ffd640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb60406b810 0x7fb60406dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00a730 tx=0x7fb60c008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:36.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.811+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb61007c400 con 0x7fb6180c6480 2024-02-17T12:58:36.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.822+0000 7f7e32ffd640 1 -- 172.21.15.136:0/283077176 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e3c059650 con 0x7f7e4406dab0 2024-02-17T12:58:36.813 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:36.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.823+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb610077fa0 con 0x7fb6180c6480 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7e2406b890 msgr2=0x7f7e2406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7e2406b890 0x7f7e2406dd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009870 tx=0x7f7e38008040 comp rx=0 tx=0).stop 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 msgr2=0x7f7e441f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 0x7f7e441f3af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00efc0 tx=0x7f7e3c00c490 comp rx=0 tx=0).stop 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 shutdown_connections 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f7e2406b890 0x7f7e2406dd50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e4406de90 0x7f7e441f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e4406dab0 0x7f7e441f3af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 --2- 172.21.15.136:0/283077176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e4406b000 0x7f7e44155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 >> 172.21.15.136:0/283077176 conn(0x7f7e440c7e90 msgr2=0x7f7e4414e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:36.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 shutdown_connections 2024-02-17T12:58:36.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.824+0000 7f7e48ed0640 1 -- 172.21.15.136:0/283077176 wait complete. 2024-02-17T12:58:36.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574862 for osd.7 2024-02-17T12:58:36.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.884+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90005a10 con 0x7f0a940cbc00 2024-02-17T12:58:36.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.884+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90005b70 con 0x7f0a940cbc00 2024-02-17T12:58:36.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.884+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90010610 con 0x7f0a940cbc00 2024-02-17T12:58:36.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.884+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a941f2f20 con 0x7f0a940cbc00 2024-02-17T12:58:36.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.884+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a941f34e0 con 0x7f0a940cbc00 2024-02-17T12:58:36.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.885+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9404efc0 con 0x7f0a940cbc00 2024-02-17T12:58:36.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:36.976+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff9ec1e30a0 con 0x7ff9ec151e70 2024-02-17T12:58:37.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.021+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0368005810 con 0x7f03800b30a0 2024-02-17T12:58:37.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.026+0000 7f03767fc640 1 -- 172.21.15.136:0/4155403339 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f037c049090 con 0x7f03800b30a0 2024-02-17T12:58:37.017 INFO:teuthology.orchestra.run.smithi136.stdout:55834574861 2024-02-17T12:58:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f036406b860 msgr2=0x7f036406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f036406b860 0x7f036406dd20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f037000a750 tx=0x7f0370008040 comp rx=0 tx=0).stop 2024-02-17T12:58:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 msgr2=0x7f03800c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 0x7f03800c1d70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f037c02bf70 tx=0x7f037c004730 comp rx=0 tx=0).stop 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 shutdown_connections 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f036406b860 0x7f036406dd20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03800c7cc0 0x7f03800c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03800c72f0 0x7f0380157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 --2- 172.21.15.136:0/4155403339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03800b30a0 0x7f03800c1d70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 >> 172.21.15.136:0/4155403339 conn(0x7f03800706e0 msgr2=0x7f03800c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 shutdown_connections 2024-02-17T12:58:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.029+0000 7f0387dbc640 1 -- 172.21.15.136:0/4155403339 wait complete. 2024-02-17T12:58:37.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.5 2024-02-17T12:58:37.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.054+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb61804efc0 con 0x7fb6180c6480 2024-02-17T12:58:37.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.109+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f37c0011630 con 0x7f37d0072ec0 2024-02-17T12:58:37.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.110+0000 7f37c6ffd640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f37b406b860 0x7f37b406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.110+0000 7f37d6320640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f37b406b860 0x7f37b406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.110+0000 7f37d6320640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f37b406b860 0x7f37b406dd20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009650 tx=0x7f37cc006ba0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.113+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f37c00595f0 con 0x7f37d0072ec0 2024-02-17T12:58:37.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.124+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37c0055190 con 0x7f37d0072ec0 2024-02-17T12:58:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.178+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0a90010770 con 0x7f0a940cbc00 2024-02-17T12:58:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.178+0000 7f0a8affd640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a7806b840 0x7f0a7806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.178+0000 7f0a9a2d1640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a7806b840 0x7f0a7806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.179+0000 7f0a9a2d1640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a7806b840 0x7f0a7806dd00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a84036000 tx=0x7f0a84008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.203+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0a90058740 con 0x7f0a940cbc00 2024-02-17T12:58:37.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.203+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a900549e0 con 0x7f0a940cbc00 2024-02-17T12:58:37.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.208+0000 7ff9daffd640 1 -- 172.21.15.136:0/1129109121 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9ec1e30a0 con 0x7ff9ec151e70 2024-02-17T12:58:37.198 INFO:teuthology.orchestra.run.smithi136.stdout:55834574861 2024-02-17T12:58:37.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9cc06b860 msgr2=0x7ff9cc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9cc06b860 0x7ff9cc06dd20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00a810 tx=0x7ff9dc008040 comp rx=0 tx=0).stop 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 msgr2=0x7ff9ec1e3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 0x7ff9ec1e3380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400c780 tx=0x7ff9e400cc40 comp rx=0 tx=0).stop 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 shutdown_connections 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff9cc06b860 0x7ff9cc06dd20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ec151e70 0x7ff9ec1e3380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9ec0c7d30 0x7ff9ec154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 --2- 172.21.15.136:0/1129109121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9ec0c76d0 0x7ff9ec1e23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 >> 172.21.15.136:0/1129109121 conn(0x7ff9ec070790 msgr2=0x7ff9ec1509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 shutdown_connections 2024-02-17T12:58:37.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.210+0000 7ff9f0e98640 1 -- 172.21.15.136:0/1129109121 wait complete. 2024-02-17T12:58:37.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.211+0000 7fb5ff7fe640 1 -- 172.21.15.136:0/423733788 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb610043090 con 0x7fb6180c6480 2024-02-17T12:58:37.202 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb60406b810 msgr2=0x7fb60406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb60406b810 0x7fb60406dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00a730 tx=0x7fb60c008040 comp rx=0 tx=0).stop 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 msgr2=0x7fb618146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 0x7fb618146500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb610009e50 tx=0x7fb610004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 shutdown_connections 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb60406b810 0x7fb60406dcd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb618157fd0 0x7fb61812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6180c6480 0x7fb618146500 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 --2- 172.21.15.136:0/423733788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb61806dce0 0x7fb618145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 >> 172.21.15.136:0/423733788 conn(0x7fb6180c7e90 msgr2=0x7fb61806aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 shutdown_connections 2024-02-17T12:58:37.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.215+0000 7fb61d5c7640 1 -- 172.21.15.136:0/423733788 wait complete. 2024-02-17T12:58:37.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.4 2024-02-17T12:58:37.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574862 for osd.3 2024-02-17T12:58:37.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.334+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37d004efc0 con 0x7f37d0072ec0 2024-02-17T12:58:37.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.338+0000 7f37c6ffd640 1 -- 172.21.15.136:0/3824638914 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37c0015090 con 0x7f37d0072ec0 2024-02-17T12:58:37.328 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:37.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.339+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f37b406b860 msgr2=0x7f37b406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.339+0000 7f37d8584640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f37b406b860 0x7f37b406dd20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009650 tx=0x7f37cc006ba0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.339+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 msgr2=0x7f37d00c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.339+0000 7f37d8584640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c3f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37c000b3f0 tx=0x7f37c000b8b0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 shutdown_connections 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f37b406b860 0x7f37b406dd20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37d0151b70 0x7f37d01574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37d0072ec0 0x7f37d00c3f90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 --2- 172.21.15.136:0/3824638914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37d0066a00 0x7f37d0152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 >> 172.21.15.136:0/3824638914 conn(0x7f37d00c83d0 msgr2=0x7f37d00c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 shutdown_connections 2024-02-17T12:58:37.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.340+0000 7f37d8584640 1 -- 172.21.15.136:0/3824638914 wait complete. 2024-02-17T12:58:37.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.2 2024-02-17T12:58:37.342 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:37.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.424+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0a940caea0 con 0x7f0a940cbc00 2024-02-17T12:58:37.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.428+0000 7f0a8affd640 1 -- 172.21.15.136:0/1477995226 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a9001d070 con 0x7f0a940cbc00 2024-02-17T12:58:37.418 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a7806b840 msgr2=0x7f0a7806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a7806b840 0x7f0a7806dd00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a84036000 tx=0x7f0a84008030 comp rx=0 tx=0).stop 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 msgr2=0x7f0a9406af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 0x7f0a9406af40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000b4a0 tx=0x7f0a9000b960 comp rx=0 tx=0).stop 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 shutdown_connections 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a7806b840 0x7f0a7806dd00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a940cc520 0x7f0a941ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a940cbc00 0x7f0a9406af40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 --2- 172.21.15.136:0/1477995226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a940ca4e0 0x7f0a94155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 >> 172.21.15.136:0/1477995226 conn(0x7f0a940721f0 msgr2=0x7f0a94152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 shutdown_connections 2024-02-17T12:58:37.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.430+0000 7f0a9c535640 1 -- 172.21.15.136:0/1477995226 wait complete. 2024-02-17T12:58:37.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.6 2024-02-17T12:58:37.432 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:37.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T12:58:37.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T12:58:37.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T12:58:37.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.864+0000 7f0392155640 1 Processor -- start 2024-02-17T12:58:37.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.864+0000 7f0392155640 1 -- start start 2024-02-17T12:58:37.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.865+0000 7f0392155640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f038c150c20 0x7f038c0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.865+0000 7f0392155640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.865+0000 7f0392155640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0711c0 con 0x7f038c0c0e40 2024-02-17T12:58:37.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.865+0000 7f0392155640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c0c2d10 con 0x7f038c150c20 2024-02-17T12:58:37.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.865+0000 7f0392155640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c1290 con 0x7f038c0c1760 2024-02-17T12:58:37.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.877+0000 7f038b7fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f038c150c20 0x7f038c0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.877+0000 7f038b7fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f038c150c20 0x7f038c0c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59320/0 (socket says 172.21.15.136:59320) 2024-02-17T12:58:37.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.877+0000 7f038b7fe640 1 -- 172.21.15.136:0/538538260 learned_addr learned my addr 172.21.15.136:0/538538260 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:37.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.881+0000 7f038bfff640 1 --2- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.882+0000 7f038b7fe640 1 -- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 msgr2=0x7f038c0c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:37.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.882+0000 7f038b7fe640 1 --2- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.882+0000 7f038b7fe640 1 -- 172.21.15.136:0/538538260 >> v1:172.21.15.136:6789/0 conn(0x7f038c0c0e40 legacy=0x7f038c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:37.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.882+0000 7f038b7fe640 1 -- 172.21.15.136:0/538538260 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0c20f0 con 0x7f038c150c20 2024-02-17T12:58:37.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.885+0000 7f038b7fe640 1 --2- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c150c20 0x7f038c0c8070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f037c00bb10 tx=0x7f037c02e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22c50674df74a6f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.889+0000 7f038a7fc640 1 -- 172.21.15.136:0/538538260 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c02ee70 con 0x7f038c150c20 2024-02-17T12:58:37.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.889+0000 7f038a7fc640 1 -- 172.21.15.136:0/538538260 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c036440 con 0x7f038c150c20 2024-02-17T12:58:37.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.889+0000 7f038a7fc640 1 -- 172.21.15.136:0/538538260 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0367d0 con 0x7f038c150c20 2024-02-17T12:58:37.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 -- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c150c20 msgr2=0x7f038c0c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 --2- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c150c20 0x7f038c0c8070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f037c00bb10 tx=0x7f037c02e0c0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 -- 172.21.15.136:0/538538260 shutdown_connections 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 --2- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 --2- 172.21.15.136:0/538538260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c150c20 0x7f038c0c8070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 -- 172.21.15.136:0/538538260 >> 172.21.15.136:0/538538260 conn(0x7f038c06f170 msgr2=0x7f038c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 -- 172.21.15.136:0/538538260 shutdown_connections 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.890+0000 7f0392155640 1 -- 172.21.15.136:0/538538260 wait complete. 2024-02-17T12:58:37.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.891+0000 7f0392155640 1 Processor -- start 2024-02-17T12:58:37.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.891+0000 7f0392155640 1 -- start start 2024-02-17T12:58:37.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.892+0000 7f0392155640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c0c0e40 0x7f038c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.892+0000 7f0392155640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.892+0000 7f0392155640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f038c150c20 0x7f038c144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.892+0000 7f0392155640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c4db0 con 0x7f038c150c20 2024-02-17T12:58:37.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.892+0000 7f0392155640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c13f230 con 0x7f038c0c0e40 2024-02-17T12:58:37.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.892+0000 7f0392155640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c13e920 con 0x7f038c0c1760 2024-02-17T12:58:37.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.893+0000 7f038affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.893+0000 7f038affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:40022/0 (socket says 172.21.15.136:40022) 2024-02-17T12:58:37.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.893+0000 7f038affd640 1 -- 172.21.15.136:0/626175856 learned_addr learned my addr 172.21.15.136:0/626175856 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:37.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.893+0000 7f038b7fe640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c0c0e40 0x7f038c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.897+0000 7f038affd640 1 -- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c0c0e40 msgr2=0x7f038c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.897+0000 7f038affd640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c0c0e40 0x7f038c0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.897+0000 7f038affd640 1 -- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f038c150c20 msgr2=0x7f038c144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.897+0000 7f038affd640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f038c150c20 0x7f038c144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.897+0000 7f038affd640 1 -- 172.21.15.136:0/626175856 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c00b770 con 0x7f038c0c1760 2024-02-17T12:58:37.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.900+0000 7f038affd640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c2e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f038000b3e0 tx=0x7f038000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.904+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011830 con 0x7f038c0c1760 2024-02-17T12:58:37.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.904+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03800119b0 con 0x7f038c0c1760 2024-02-17T12:58:37.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.904+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c0c3690 con 0x7f038c0c1760 2024-02-17T12:58:37.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.904+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011d60 con 0x7f038c0c1760 2024-02-17T12:58:37.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.904+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c13ebe0 con 0x7f038c0c1760 2024-02-17T12:58:37.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.905+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c13f370 con 0x7f038c0c1760 2024-02-17T12:58:37.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.915+0000 7feeba16c640 1 Processor -- start 2024-02-17T12:58:37.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.915+0000 7feeba16c640 1 -- start start 2024-02-17T12:58:37.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.915+0000 7feeba16c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feeb40c62d0 0x7feeb415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.915+0000 7feeba16c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb40c6720 con 0x7feeb4153f40 2024-02-17T12:58:37.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.915+0000 7feeba16c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb40c7fb0 con 0x7feeb4071ad0 2024-02-17T12:58:37.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.915+0000 7feeba16c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb415aa10 con 0x7feeb40c62d0 2024-02-17T12:58:37.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.916+0000 7feeb37fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7feeb4153f40 0x7feeb406aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38028/0 (socket says 172.21.15.136:38028) 2024-02-17T12:58:37.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.916+0000 7feeb37fe640 1 -- 172.21.15.136:0/149342596 learned_addr learned my addr 172.21.15.136:0/149342596 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:37.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.916+0000 7feeb2ffd640 1 --2- 172.21.15.136:0/149342596 >> v2:172.21.15.160:3300/0 conn(0x7feeb40c62d0 0x7feeb415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.918+0000 7feeb27fc640 1 -- 172.21.15.136:0/149342596 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478913492 0 0) 0x7feeb40c6720 con 0x7feeb4153f40 2024-02-17T12:58:37.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.918+0000 7feeb27fc640 1 -- 172.21.15.136:0/149342596 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c003520 con 0x7feeb4153f40 2024-02-17T12:58:37.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.920+0000 7feeb2ffd640 1 -- 172.21.15.136:0/149342596 >> v1:172.21.15.160:6789/0 conn(0x7feeb4071ad0 legacy=0x7feeb41643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.920+0000 7feeb2ffd640 1 -- 172.21.15.136:0/149342596 >> v1:172.21.15.136:6789/0 conn(0x7feeb4153f40 legacy=0x7feeb406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.920+0000 7feeb2ffd640 1 -- 172.21.15.136:0/149342596 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40c6f10 con 0x7feeb40c62d0 2024-02-17T12:58:37.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.924+0000 7feeb2ffd640 1 --2- 172.21.15.136:0/149342596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40c62d0 0x7feeb415a4d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feea4009790 tx=0x7feea402b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90743e933ddef93 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.926+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0380023430 con 0x7f038c0c1760 2024-02-17T12:58:37.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.926+0000 7f0373fff640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f037806b860 0x7f037806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.926+0000 7f038b7fe640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f037806b860 0x7f037806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.927+0000 7f038b7fe640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f037806b860 0x7f037806dd20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f037c038000 tx=0x7f037c008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.928+0000 7feeb27fc640 1 -- 172.21.15.136:0/149342596 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4030890 con 0x7feeb40c62d0 2024-02-17T12:58:37.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.928+0000 7feeb27fc640 1 -- 172.21.15.136:0/149342596 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea40309f0 con 0x7feeb40c62d0 2024-02-17T12:58:37.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.928+0000 7feeb27fc640 1 -- 172.21.15.136:0/149342596 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4030d80 con 0x7feeb40c62d0 2024-02-17T12:58:37.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 -- 172.21.15.136:0/149342596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40c62d0 msgr2=0x7feeb415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 --2- 172.21.15.136:0/149342596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40c62d0 0x7feeb415a4d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feea4009790 tx=0x7feea402b9d0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 -- 172.21.15.136:0/149342596 shutdown_connections 2024-02-17T12:58:37.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 --2- 172.21.15.136:0/149342596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40c62d0 0x7feeb415a4d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 -- 172.21.15.136:0/149342596 >> 172.21.15.136:0/149342596 conn(0x7feeb40c83d0 msgr2=0x7feeb40c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 -- 172.21.15.136:0/149342596 shutdown_connections 2024-02-17T12:58:37.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.929+0000 7feeba16c640 1 -- 172.21.15.136:0/149342596 wait complete. 2024-02-17T12:58:37.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.930+0000 7feeba16c640 1 Processor -- start 2024-02-17T12:58:37.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.930+0000 7feeba16c640 1 -- start start 2024-02-17T12:58:37.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeba16c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb4071ad0 0x7feeb41e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeba16c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feeb40c62d0 0x7feeb414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeba16c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 0x7feeb414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeba16c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb414e190 con 0x7feeb40c62d0 2024-02-17T12:58:37.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeba16c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40c5640 con 0x7feeb4153f40 2024-02-17T12:58:37.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeba16c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb414e3e0 con 0x7feeb4071ad0 2024-02-17T12:58:37.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.931+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 0x7feeb414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.932+0000 7feeb2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feeb40c62d0 0x7feeb414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.932+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 0x7feeb414f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59352/0 (socket says 172.21.15.136:59352) 2024-02-17T12:58:37.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.932+0000 7feeb3fff640 1 -- 172.21.15.136:0/219640872 learned_addr learned my addr 172.21.15.136:0/219640872 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:37.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.933+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0380059240 con 0x7f038c0c1760 2024-02-17T12:58:37.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.935+0000 7feeb3fff640 1 -- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb4071ad0 msgr2=0x7feeb41e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.935+0000 7feeb3fff640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb4071ad0 0x7feeb41e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.936+0000 7feeb3fff640 1 -- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feeb40c62d0 msgr2=0x7feeb414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.936+0000 7feeb3fff640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feeb40c62d0 0x7feeb414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.936+0000 7feeb3fff640 1 -- 172.21.15.136:0/219640872 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40093a0 con 0x7feeb4153f40 2024-02-17T12:58:37.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.938+0000 7feeb3fff640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 0x7feeb414f6e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feeac00c7a0 tx=0x7feeac00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.941+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003b70 con 0x7feeb4153f40 2024-02-17T12:58:37.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.941+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac003cf0 con 0x7feeb4153f40 2024-02-17T12:58:37.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.941+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb414e6c0 con 0x7feeb4153f40 2024-02-17T12:58:37.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.941+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003ea0 con 0x7feeb4153f40 2024-02-17T12:58:37.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.941+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb414ec80 con 0x7feeb4153f40 2024-02-17T12:58:37.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.942+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb414ee70 con 0x7feeb4153f40 2024-02-17T12:58:37.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.960+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7feeac00aa90 con 0x7feeb4153f40 2024-02-17T12:58:37.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.961+0000 7fee9bfff640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feea006b860 0x7feea006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.961+0000 7feeb37fe640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feea006b860 0x7feea006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.962+0000 7feeb37fe640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feea006b860 0x7feea006dd20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feea8001570 tx=0x7feea8007930 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.962+0000 7f804798c640 1 Processor -- start 2024-02-17T12:58:37.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.962+0000 7f804798c640 1 -- start start 2024-02-17T12:58:37.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.963+0000 7f804798c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f804015a5b0 0x7f80400c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.963+0000 7f804798c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80400c3d00 con 0x7f80400c6630 2024-02-17T12:58:37.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.963+0000 7f804798c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8040070400 con 0x7f8040150c70 2024-02-17T12:58:37.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.963+0000 7f804798c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80400c4d90 con 0x7f804015a5b0 2024-02-17T12:58:37.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.963+0000 7f8045f29640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f80400c6630 0x7f80400c9120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38034/0 (socket says 172.21.15.136:38034) 2024-02-17T12:58:37.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.963+0000 7f8045f29640 1 -- 172.21.15.136:0/1437317221 learned_addr learned my addr 172.21.15.136:0/1437317221 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:37.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.964+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7feeac059910 con 0x7feeb4153f40 2024-02-17T12:58:37.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.966+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245423607 0 0) 0x7f80400c3d00 con 0x7f80400c6630 2024-02-17T12:58:37.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.966+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c003520 con 0x7f80400c6630 2024-02-17T12:58:37.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896190753 0 0) 0x7f802c003520 con 0x7f80400c6630 2024-02-17T12:58:37.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 >> v2:172.21.15.160:3300/0 conn(0x7f804015a5b0 msgr2=0x7f80400c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:37.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 --2- 172.21.15.136:0/1437317221 >> v2:172.21.15.160:3300/0 conn(0x7f804015a5b0 0x7f80400c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 >> v1:172.21.15.160:6789/0 conn(0x7f8040150c70 legacy=0x7f8040159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:37.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400c39d0 con 0x7f80400c6630 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3338030640 0 0) 0x7f80380019f0 con 0x7f80400c6630 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 >> v1:172.21.15.136:6789/0 conn(0x7f80400c6630 legacy=0x7f80400c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f802c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.969+0000 7f8037fff640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f802c0047c0 0x7f802c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.970+0000 7f8037fff640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f802c0052a0 0x7f802c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.970+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400c4d90 con 0x7f802c0039c0 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.970+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c00e400 con 0x7f802c0052a0 2024-02-17T12:58:37.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.970+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c00e5c0 con 0x7f802c0047c0 2024-02-17T12:58:37.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.972+0000 7f8045728640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f802c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.975+0000 7f8045728640 1 -- 172.21.15.136:0/1437317221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f802c0047c0 msgr2=0x7f802c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:37.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.975+0000 7f8045728640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f802c0047c0 0x7f802c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.975+0000 7f8045728640 1 -- 172.21.15.136:0/1437317221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f802c0052a0 msgr2=0x7f802c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:37.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.975+0000 7f8045728640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f802c0052a0 0x7f802c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.975+0000 7f8045728640 1 -- 172.21.15.136:0/1437317221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c003520 con 0x7f802c0039c0 2024-02-17T12:58:37.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.975+0000 7f8045f29640 1 -- 172.21.15.136:0/1437317221 reap_dead start 2024-02-17T12:58:37.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.977+0000 7f8045728640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f802c003dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f803c001620 tx=0x7f802c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d49e49a477b6ab server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:37.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c005070 con 0x7f802c0039c0 2024-02-17T12:58:37.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c02e070 con 0x7f802c0039c0 2024-02-17T12:58:37.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f8037fff640 1 -- 172.21.15.136:0/1437317221 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c005430 con 0x7f802c0039c0 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f804798c640 1 -- 172.21.15.136:0/1437317221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 msgr2=0x7f802c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f804798c640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f802c003dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f803c001620 tx=0x7f802c0057f0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f804798c640 1 -- 172.21.15.136:0/1437317221 shutdown_connections 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f804798c640 1 --2- 172.21.15.136:0/1437317221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f802c003dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.981+0000 7f804798c640 1 -- 172.21.15.136:0/1437317221 >> 172.21.15.136:0/1437317221 conn(0x7f8040071a20 msgr2=0x7f8040071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.982+0000 7f804798c640 1 -- 172.21.15.136:0/1437317221 shutdown_connections 2024-02-17T12:58:37.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.982+0000 7f804798c640 1 -- 172.21.15.136:0/1437317221 wait complete. 2024-02-17T12:58:37.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.983+0000 7f804798c640 1 Processor -- start 2024-02-17T12:58:37.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.983+0000 7f804798c640 1 -- start start 2024-02-17T12:58:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f804798c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f80400cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f804798c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8040154570 0x7f8040156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f804798c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80401ec5b0 0x7f8040158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:37.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f804798c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804006f890 con 0x7f802c0039c0 2024-02-17T12:58:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f804798c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80401549d0 con 0x7f80401ec5b0 2024-02-17T12:58:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f804798c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80401551e0 con 0x7f8040154570 2024-02-17T12:58:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f8045728640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f80400cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f8045728640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f80400cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50500/0 (socket says 172.21.15.136:50500) 2024-02-17T12:58:37.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.984+0000 7f8045728640 1 -- 172.21.15.136:0/1247553831 learned_addr learned my addr 172.21.15.136:0/1247553831 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:37.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.987+0000 7f8045728640 1 -- 172.21.15.136:0/1247553831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8040154570 msgr2=0x7f8040156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.987+0000 7f8045728640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8040154570 0x7f8040156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.987+0000 7f8045728640 1 -- 172.21.15.136:0/1247553831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80401ec5b0 msgr2=0x7f8040158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:37.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.987+0000 7f8045728640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80401ec5b0 0x7f8040158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:37.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.988+0000 7f8045728640 1 -- 172.21.15.136:0/1247553831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8040154c20 con 0x7f802c0039c0 2024-02-17T12:58:37.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:37.990+0000 7f8045728640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f80400cab80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f803c02bb90 tx=0x7f803c000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.010+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c007240 con 0x7f802c0039c0 2024-02-17T12:58:38.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.010+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c0073a0 con 0x7f802c0039c0 2024-02-17T12:58:38.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.010+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0054a0 con 0x7f802c0039c0 2024-02-17T12:58:38.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.010+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8040154f00 con 0x7f802c0039c0 2024-02-17T12:58:38.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.010+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8040155950 con 0x7f802c0039c0 2024-02-17T12:58:38.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.011+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804014eaa0 con 0x7f802c0039c0 2024-02-17T12:58:38.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.029+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f803c030030 con 0x7f802c0039c0 2024-02-17T12:58:38.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.030+0000 7f8035ffb640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f802406b810 0x7f802406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.030+0000 7f8044f27640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f802406b810 0x7f802406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.030+0000 7f8044f27640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f802406b810 0x7f802406dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f804014e220 tx=0x7f8030006d00 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.032+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f803c079aa0 con 0x7f802c0039c0 2024-02-17T12:58:38.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T12:58:38.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.144+0000 7fee35302640 1 Processor -- start 2024-02-17T12:58:38.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.144+0000 7fee35302640 1 -- start start 2024-02-17T12:58:38.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.145+0000 7fee35302640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 0x7fee300cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.145+0000 7fee35302640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fee300c6470 0x7fee300cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.145+0000 7fee35302640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee300c77c0 con 0x7fee3006fd90 2024-02-17T12:58:38.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.145+0000 7fee35302640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300c7140 con 0x7fee300c6470 2024-02-17T12:58:38.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.145+0000 7fee35302640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3006efa0 con 0x7fee30070170 2024-02-17T12:58:38.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.184+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0380054de0 con 0x7f038c0c1760 2024-02-17T12:58:38.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.209+0000 7fee27fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 0x7fee300cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.210+0000 7fee27fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 0x7fee300cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:40048/0 (socket says 172.21.15.136:40048) 2024-02-17T12:58:38.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.211+0000 7fee27fff640 1 -- 172.21.15.136:0/3627833644 learned_addr learned my addr 172.21.15.136:0/3627833644 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:38.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.214+0000 7fee27fff640 1 -- 172.21.15.136:0/3627833644 >> v2:172.21.15.160:3300/0 conn(0x7fee300c6470 msgr2=0x7fee300cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.214+0000 7fee27fff640 1 --2- 172.21.15.136:0/3627833644 >> v2:172.21.15.160:3300/0 conn(0x7fee300c6470 0x7fee300cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.214+0000 7fee27fff640 1 -- 172.21.15.136:0/3627833644 >> v1:172.21.15.136:6789/0 conn(0x7fee3006fd90 legacy=0x7fee300c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.214+0000 7fee27fff640 1 -- 172.21.15.136:0/3627833644 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3006f280 con 0x7fee30070170 2024-02-17T12:58:38.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.216+0000 7fee27fff640 1 --2- 172.21.15.136:0/3627833644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 0x7fee300cc2a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee18009870 tx=0x7fee1802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729630257a0ed91f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.211 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.221+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feeac0554b0 con 0x7feeb4153f40 2024-02-17T12:58:38.211 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.221+0000 7fee2e7fc640 1 -- 172.21.15.136:0/3627833644 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18030840 con 0x7fee30070170 2024-02-17T12:58:38.211 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.221+0000 7fee2e7fc640 1 -- 172.21.15.136:0/3627833644 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee180309a0 con 0x7fee30070170 2024-02-17T12:58:38.211 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.221+0000 7fee2e7fc640 1 -- 172.21.15.136:0/3627833644 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18030d30 con 0x7fee30070170 2024-02-17T12:58:38.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 -- 172.21.15.136:0/3627833644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 msgr2=0x7fee300cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 --2- 172.21.15.136:0/3627833644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 0x7fee300cc2a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee18009870 tx=0x7fee1802b980 comp rx=0 tx=0).stop 2024-02-17T12:58:38.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 -- 172.21.15.136:0/3627833644 shutdown_connections 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 --2- 172.21.15.136:0/3627833644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee30070170 0x7fee300cc2a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 --2- 172.21.15.136:0/3627833644 >> v2:172.21.15.160:3300/0 conn(0x7fee300c6470 0x7fee300cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 -- 172.21.15.136:0/3627833644 >> 172.21.15.136:0/3627833644 conn(0x7fee300719f0 msgr2=0x7fee30071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 -- 172.21.15.136:0/3627833644 shutdown_connections 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.222+0000 7fee35302640 1 -- 172.21.15.136:0/3627833644 wait complete. 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.223+0000 7fee35302640 1 Processor -- start 2024-02-17T12:58:38.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.223+0000 7fee35302640 1 -- start start 2024-02-17T12:58:38.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee35302640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee3006fd90 0x7fee301f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee35302640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee30070170 0x7fee300bc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee35302640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 0x7fee3014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee35302640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee300bd2d0 con 0x7fee3006fd90 2024-02-17T12:58:38.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee35302640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3014d210 con 0x7fee30070170 2024-02-17T12:58:38.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee35302640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee301f0b30 con 0x7fee300c6470 2024-02-17T12:58:38.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.224+0000 7fee2f7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 0x7fee3014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.225+0000 7fee2f7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 0x7fee3014dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:40056/0 (socket says 172.21.15.136:40056) 2024-02-17T12:58:38.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.225+0000 7fee2f7fe640 1 -- 172.21.15.136:0/1859993494 learned_addr learned my addr 172.21.15.136:0/1859993494 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:38.216 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T12:58:38.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.228+0000 7fee2f7fe640 1 -- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee30070170 msgr2=0x7fee300bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.228+0000 7fee2f7fe640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee30070170 0x7fee300bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.228+0000 7fee2f7fe640 1 -- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee3006fd90 msgr2=0x7fee301f05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.228+0000 7fee2f7fe640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee3006fd90 0x7fee301f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.228+0000 7fee2f7fe640 1 -- 172.21.15.136:0/1859993494 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180094d0 con 0x7fee300c6470 2024-02-17T12:58:38.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.230+0000 7fee2f7fe640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 0x7fee3014dc20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee2800ba10 tx=0x7fee2800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T12:58:38.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.236+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2800cb40 con 0x7fee300c6470 2024-02-17T12:58:38.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.236+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2800cca0 con 0x7fee300c6470 2024-02-17T12:58:38.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.236+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee300be150 con 0x7fee300c6470 2024-02-17T12:58:38.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.236+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28014680 con 0x7fee300c6470 2024-02-17T12:58:38.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.236+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee300be6a0 con 0x7fee300c6470 2024-02-17T12:58:38.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.237+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee300c8620 con 0x7fee300c6470 2024-02-17T12:58:38.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.286+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f803c075640 con 0x7f802c0039c0 2024-02-17T12:58:38.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.343+0000 7fb476fa0640 1 Processor -- start 2024-02-17T12:58:38.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.343+0000 7fb476fa0640 1 -- start start 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.344+0000 7fb476fa0640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4700ca370 0x7fb47015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.344+0000 7fb476fa0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb47006bbd0 0x7fb47006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.344+0000 7fb476fa0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb47015d150 0x7fb47015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.344+0000 7fb476fa0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47006fde0 con 0x7fb47006bbd0 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.344+0000 7fb476fa0640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47006d970 con 0x7fb4700ca370 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.344+0000 7fb476fa0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700ca750 con 0x7fb47015d150 2024-02-17T12:58:38.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.345+0000 7fb475f9e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4700ca370 0x7fb47015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.345+0000 7fb475f9e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4700ca370 0x7fb47015dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59388/0 (socket says 172.21.15.136:59388) 2024-02-17T12:58:38.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.345+0000 7fb475f9e640 1 -- 172.21.15.136:0/681505042 learned_addr learned my addr 172.21.15.136:0/681505042 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:38.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.345+0000 7fb47579d640 1 --2- 172.21.15.136:0/681505042 >> v2:172.21.15.136:3300/0 conn(0x7fb47006bbd0 0x7fb47006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.347+0000 7fb475f9e640 1 -- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb47015d150 msgr2=0x7fb47015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.347+0000 7fb475f9e640 1 --2- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb47015d150 0x7fb47015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.347+0000 7fb475f9e640 1 -- 172.21.15.136:0/681505042 >> v2:172.21.15.136:3300/0 conn(0x7fb47006bbd0 msgr2=0x7fb47006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.347+0000 7fb475f9e640 1 --2- 172.21.15.136:0/681505042 >> v2:172.21.15.136:3300/0 conn(0x7fb47006bbd0 0x7fb47006c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.347+0000 7fb475f9e640 1 -- 172.21.15.136:0/681505042 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700c2ac0 con 0x7fb4700ca370 2024-02-17T12:58:38.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.350+0000 7fb475f9e640 1 --2- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca370 0x7fb47015dce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb470074c90 tx=0x7fb46c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c63f83dfcee2cc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.354+0000 7fb474f9c640 1 -- 172.21.15.136:0/681505042 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c030860 con 0x7fb4700ca370 2024-02-17T12:58:38.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.354+0000 7fb474f9c640 1 -- 172.21.15.136:0/681505042 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0309c0 con 0x7fb4700ca370 2024-02-17T12:58:38.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.354+0000 7fb474f9c640 1 -- 172.21.15.136:0/681505042 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c030d50 con 0x7fb4700ca370 2024-02-17T12:58:38.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 -- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca370 msgr2=0x7fb47015dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 --2- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca370 0x7fb47015dce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb470074c90 tx=0x7fb46c02b9a0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 -- 172.21.15.136:0/681505042 shutdown_connections 2024-02-17T12:58:38.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 --2- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb47015d150 0x7fb47015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 --2- 172.21.15.136:0/681505042 >> v2:172.21.15.136:3300/0 conn(0x7fb47006bbd0 0x7fb47006c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 --2- 172.21.15.136:0/681505042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca370 0x7fb47015dce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 -- 172.21.15.136:0/681505042 >> 172.21.15.136:0/681505042 conn(0x7fb470070390 msgr2=0x7fb4700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 -- 172.21.15.136:0/681505042 shutdown_connections 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.355+0000 7fb476fa0640 1 -- 172.21.15.136:0/681505042 wait complete. 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.356+0000 7fb476fa0640 1 Processor -- start 2024-02-17T12:58:38.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.356+0000 7fb476fa0640 1 -- start start 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb476fa0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 0x7fb4700c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb476fa0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4700ca370 0x7fb4701f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb476fa0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb47015d150 0x7fb4700c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb476fa0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47014fef0 con 0x7fb47015d150 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb476fa0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4701efc30 con 0x7fb47006bbd0 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb476fa0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb470150980 con 0x7fb4700ca370 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.357+0000 7fb475f9e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 0x7fb4700c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.358+0000 7fb47679f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb47015d150 0x7fb4700c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.358+0000 7fb475f9e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 0x7fb4700c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59404/0 (socket says 172.21.15.136:59404) 2024-02-17T12:58:38.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.358+0000 7fb475f9e640 1 -- 172.21.15.136:0/2324316755 learned_addr learned my addr 172.21.15.136:0/2324316755 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:38.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.361+0000 7fb475f9e640 1 -- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4700ca370 msgr2=0x7fb4701f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.361+0000 7fb475f9e640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4700ca370 0x7fb4701f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.361+0000 7fb475f9e640 1 -- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb47015d150 msgr2=0x7fb4700c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.361+0000 7fb475f9e640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb47015d150 0x7fb4700c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.361+0000 7fb475f9e640 1 -- 172.21.15.136:0/2324316755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0094d0 con 0x7fb47006bbd0 2024-02-17T12:58:38.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.363+0000 7fb475f9e640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 0x7fb4700c6e70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000c00 tx=0x7fb46c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.368+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c039c90 con 0x7fb47006bbd0 2024-02-17T12:58:38.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.368+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c039df0 con 0x7fb47006bbd0 2024-02-17T12:58:38.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.368+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c043640 con 0x7fb47006bbd0 2024-02-17T12:58:38.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.368+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb470150120 con 0x7fb47006bbd0 2024-02-17T12:58:38.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.368+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4701503c0 con 0x7fb47006bbd0 2024-02-17T12:58:38.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.369+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4701ef760 con 0x7fb47006bbd0 2024-02-17T12:58:38.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.387+0000 7fe04c215640 1 Processor -- start 2024-02-17T12:58:38.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.387+0000 7fe04c215640 1 -- start start 2024-02-17T12:58:38.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.388+0000 7fe04c215640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe0440ca4e0 0x7fe0440cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.388+0000 7fe04c215640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04406b3e0 con 0x7fe0440cbc00 2024-02-17T12:58:38.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.388+0000 7fe04c215640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440cb470 con 0x7fe0440cc520 2024-02-17T12:58:38.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.388+0000 7fe04c215640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0440cc940 con 0x7fe0440ca4e0 2024-02-17T12:58:38.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.389+0000 7fe049fb1640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe0440cbc00 0x7fe04406acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38050/0 (socket says 172.21.15.136:38050) 2024-02-17T12:58:38.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.389+0000 7fe049fb1640 1 -- 172.21.15.136:0/3314556277 learned_addr learned my addr 172.21.15.136:0/3314556277 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:38.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.392+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957263320 0 0) 0x7fe04406b3e0 con 0x7fe0440cbc00 2024-02-17T12:58:38.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.392+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe030003520 con 0x7fe0440cbc00 2024-02-17T12:58:38.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.393+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb46c0437a0 con 0x7fb47006bbd0 2024-02-17T12:58:38.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.393+0000 7fb4667fc640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb45406b860 0x7fb45406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.393+0000 7fb47579d640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb45406b860 0x7fb45406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.394+0000 7fb47579d640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb45406b860 0x7fb45406dd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb460006a90 tx=0x7fb460006a20 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719709463 0 0) 0x7fe030003520 con 0x7fe0440cbc00 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 >> v2:172.21.15.160:3300/0 conn(0x7fe0440ca4e0 msgr2=0x7fe0440cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 --2- 172.21.15.136:0/3314556277 >> v2:172.21.15.160:3300/0 conn(0x7fe0440ca4e0 0x7fe0440cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 >> v1:172.21.15.160:6789/0 conn(0x7fe0440cc520 legacy=0x7fe0441644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440cb750 con 0x7fe0440cbc00 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3338030640 0 0) 0x7fe040001670 con 0x7fe0440cbc00 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 >> v1:172.21.15.136:6789/0 conn(0x7fe0440cbc00 legacy=0x7fe04406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0300039c0 0x7fe030003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300047c0 0x7fe030004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0300052a0 0x7fe03000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440cc940 con 0x7fe0300052a0 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03000c1f0 con 0x7fe0300039c0 2024-02-17T12:58:38.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.398+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03000c3b0 con 0x7fe0300047c0 2024-02-17T12:58:38.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.401+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0300052a0 0x7fe03000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.408+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3314556277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300047c0 msgr2=0x7fe030004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.408+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300047c0 0x7fe030004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.408+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3314556277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0300039c0 msgr2=0x7fe030003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:38.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.408+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0300039c0 0x7fe030003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.408+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3314556277 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030003520 con 0x7fe0300052a0 2024-02-17T12:58:38.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.409+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3314556277 reap_dead start 2024-02-17T12:58:38.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.411+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0300052a0 0x7fe03000b980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe03c001d20 tx=0x7fe0300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74fee9ce438199b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.415+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c003b90 con 0x7fe0300052a0 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.415+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c003cf0 con 0x7fe0300052a0 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.415+0000 7fe048faf640 1 -- 172.21.15.136:0/3314556277 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0052b0 con 0x7fe0300052a0 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.416+0000 7fe04c215640 1 -- 172.21.15.136:0/3314556277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0300052a0 msgr2=0x7fe03000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.416+0000 7fe04c215640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0300052a0 0x7fe03000b980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe03c001d20 tx=0x7fe0300057f0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.416+0000 7fe04c215640 1 -- 172.21.15.136:0/3314556277 shutdown_connections 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.416+0000 7fe04c215640 1 --2- 172.21.15.136:0/3314556277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0300052a0 0x7fe03000b980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.416+0000 7fe04c215640 1 -- 172.21.15.136:0/3314556277 >> 172.21.15.136:0/3314556277 conn(0x7fe0440721f0 msgr2=0x7fe0440725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.417+0000 7fe04c215640 1 -- 172.21.15.136:0/3314556277 shutdown_connections 2024-02-17T12:58:38.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.417+0000 7fe04c215640 1 -- 172.21.15.136:0/3314556277 wait complete. 2024-02-17T12:58:38.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.418+0000 7fe04c215640 1 Processor -- start 2024-02-17T12:58:38.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.419+0000 7fe04c215640 1 -- start start 2024-02-17T12:58:38.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.420+0000 7fe04c215640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300052a0 0x7fe04414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.420+0000 7fe04c215640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0441f2b70 0x7fe04415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.420+0000 7fe04c215640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 0x7fe0440cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.420+0000 7fe04c215640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440ce4e0 con 0x7fe04415ba40 2024-02-17T12:58:38.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.420+0000 7fe04c215640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440c5b80 con 0x7fe0441f2b70 2024-02-17T12:58:38.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.420+0000 7fe04c215640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440c60b0 con 0x7fe0300052a0 2024-02-17T12:58:38.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.421+0000 7fe04a7b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 0x7fe0440cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.421+0000 7fe04a7b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 0x7fe0440cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50528/0 (socket says 172.21.15.136:50528) 2024-02-17T12:58:38.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.421+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3374367321 learned_addr learned my addr 172.21.15.136:0/3374367321 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:38.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.422+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feeb404efc0 con 0x7feeb4153f40 2024-02-17T12:58:38.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.426+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3374367321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300052a0 msgr2=0x7fe04414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.426+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300052a0 0x7fe04414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.426+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3374367321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0441f2b70 msgr2=0x7fe04415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.426+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0441f2b70 0x7fe04415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.426+0000 7fe04a7b2640 1 -- 172.21.15.136:0/3374367321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04414ee50 con 0x7fe04415ba40 2024-02-17T12:58:38.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.430+0000 7fe04a7b2640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 0x7fe0440cd280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe03c001e40 tx=0x7fe03c001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.435+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f038c04efc0 con 0x7f038c0c1760 2024-02-17T12:58:38.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.435+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c03f070 con 0x7fe04415ba40 2024-02-17T12:58:38.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.435+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c006b30 con 0x7fe04415ba40 2024-02-17T12:58:38.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.435+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c006ea0 con 0x7fe04415ba40 2024-02-17T12:58:38.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.435+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0440c5dd0 con 0x7fe04415ba40 2024-02-17T12:58:38.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.435+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04415a660 con 0x7fe04415ba40 2024-02-17T12:58:38.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.436+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04404efc0 con 0x7fe04415ba40 2024-02-17T12:58:38.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.466+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe03c007000 con 0x7fe04415ba40 2024-02-17T12:58:38.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.466+0000 7fe03a7fc640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe02806b860 0x7fe02806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.466+0000 7fe049fb1640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe02806b860 0x7fe02806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.467+0000 7fe049fb1640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe02806b860 0x7fe02806dd20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0400079b0 tx=0x7fe0400015c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.471+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fe03c07b400 con 0x7fe04415ba40 2024-02-17T12:58:38.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.521+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fee2801d3b0 con 0x7fee300c6470 2024-02-17T12:58:38.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.521+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8040145fc0 con 0x7f802c0039c0 2024-02-17T12:58:38.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.521+0000 7fee277fe640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fee1006b860 0x7fee1006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:38.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.522+0000 7fee2effd640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fee1006b860 0x7fee1006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:38.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.522+0000 7fee2effd640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fee1006b860 0x7fee1006dd20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee20001560 tx=0x7fee20007990 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:38.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.526+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fee28059460 con 0x7fee300c6470 2024-02-17T12:58:38.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.544+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee28055000 con 0x7fee300c6470 2024-02-17T12:58:38.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.562+0000 7f0373fff640 1 -- 172.21.15.136:0/626175856 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0380015090 con 0x7f038c0c1760 2024-02-17T12:58:38.553 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:38.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f037806b860 msgr2=0x7f037806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f037806b860 0x7f037806dd20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f037c038000 tx=0x7f037c008040 comp rx=0 tx=0).stop 2024-02-17T12:58:38.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 msgr2=0x7f038c0c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c2e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f038000b3e0 tx=0x7f038000b8a0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 shutdown_connections 2024-02-17T12:58:38.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f037806b860 0x7f037806dd20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f038c150c20 0x7f038c144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f038c0c1760 0x7f038c0c2e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 --2- 172.21.15.136:0/626175856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f038c0c0e40 0x7f038c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 >> 172.21.15.136:0/626175856 conn(0x7f038c06f170 msgr2=0x7f038c06b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 shutdown_connections 2024-02-17T12:58:38.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.565+0000 7f0392155640 1 -- 172.21.15.136:0/626175856 wait complete. 2024-02-17T12:58:38.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.0 2024-02-17T12:58:38.566 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:38.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.663+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb46c03e070 con 0x7fb47006bbd0 2024-02-17T12:58:38.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.674+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb46c078510 con 0x7fb47006bbd0 2024-02-17T12:58:38.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.677+0000 7fee9bfff640 1 -- 172.21.15.136:0/219640872 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feeac058b70 con 0x7feeb4153f40 2024-02-17T12:58:38.667 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feea006b860 msgr2=0x7feea006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feea006b860 0x7feea006dd20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feea8001570 tx=0x7feea8007930 comp rx=0 tx=0).stop 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 msgr2=0x7feeb414f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 0x7feeb414f6e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feeac00c7a0 tx=0x7feeac00cc60 comp rx=0 tx=0).stop 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 shutdown_connections 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7feea006b860 0x7feea006dd20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb4153f40 0x7feeb414f6e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feeb40c62d0 0x7feeb414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 --2- 172.21.15.136:0/219640872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb4071ad0 0x7feeb41e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 >> 172.21.15.136:0/219640872 conn(0x7feeb40c83d0 msgr2=0x7feeb4159030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 shutdown_connections 2024-02-17T12:58:38.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.679+0000 7feeba16c640 1 -- 172.21.15.136:0/219640872 wait complete. 2024-02-17T12:58:38.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.1 2024-02-17T12:58:38.681 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:38.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.715+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe03c076fa0 con 0x7fe04415ba40 2024-02-17T12:58:38.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.720+0000 7f8035ffb640 1 -- 172.21.15.136:0/1247553831 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f803c078d00 con 0x7f802c0039c0 2024-02-17T12:58:38.710 INFO:teuthology.orchestra.run.smithi136.stdout:55834574863 2024-02-17T12:58:38.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f802406b810 msgr2=0x7f802406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f802406b810 0x7f802406dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f804014e220 tx=0x7f8030006d00 comp rx=0 tx=0).stop 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 msgr2=0x7f80400cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f80400cab80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f803c02bb90 tx=0x7f803c000fb0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 shutdown_connections 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f802406b810 0x7f802406dcd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80401ec5b0 0x7f8040158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8040154570 0x7f8040156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 --2- 172.21.15.136:0/1247553831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802c0039c0 0x7f80400cab80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 >> 172.21.15.136:0/1247553831 conn(0x7f8040071a20 msgr2=0x7f80400c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 shutdown_connections 2024-02-17T12:58:38.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.723+0000 7f804798c640 1 -- 172.21.15.136:0/1247553831 wait complete. 2024-02-17T12:58:38.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.7 2024-02-17T12:58:38.729 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:38.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.772+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fee30152830 con 0x7fee300c6470 2024-02-17T12:58:38.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.805+0000 7fee277fe640 1 -- 172.21.15.136:0/1859993494 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee28019020 con 0x7fee300c6470 2024-02-17T12:58:38.796 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fee1006b860 msgr2=0x7fee1006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fee1006b860 0x7fee1006dd20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee20001560 tx=0x7fee20007990 comp rx=0 tx=0).stop 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 msgr2=0x7fee3014dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 0x7fee3014dc20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee2800ba10 tx=0x7fee2800bed0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 shutdown_connections 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fee1006b860 0x7fee1006dd20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee300c6470 0x7fee3014dc20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee30070170 0x7fee300bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.807+0000 7fee35302640 1 --2- 172.21.15.136:0/1859993494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee3006fd90 0x7fee301f05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.808+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 >> 172.21.15.136:0/1859993494 conn(0x7fee300719f0 msgr2=0x7fee300c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.808+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 shutdown_connections 2024-02-17T12:58:38.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.808+0000 7fee35302640 1 -- 172.21.15.136:0/1859993494 wait complete. 2024-02-17T12:58:38.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.5 2024-02-17T12:58:38.810 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:38.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.892+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb4701ef760 con 0x7fb47006bbd0 2024-02-17T12:58:38.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.916+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe044068140 con 0x7fe04415ba40 2024-02-17T12:58:38.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.919+0000 7fe03a7fc640 1 -- 172.21.15.136:0/3374367321 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe03c07a660 con 0x7fe04415ba40 2024-02-17T12:58:38.910 INFO:teuthology.orchestra.run.smithi136.stdout:55834574864 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe02806b860 msgr2=0x7fe02806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe02806b860 0x7fe02806dd20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0400079b0 tx=0x7fe0400015c0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 msgr2=0x7fe0440cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 0x7fe0440cd280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe03c001e40 tx=0x7fe03c001330 comp rx=0 tx=0).stop 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 shutdown_connections 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe02806b860 0x7fe02806dd20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04415ba40 0x7fe0440cd280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0441f2b70 0x7fe04415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 --2- 172.21.15.136:0/3374367321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0300052a0 0x7fe04414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 >> 172.21.15.136:0/3374367321 conn(0x7fe0440721f0 msgr2=0x7fe0440725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 shutdown_connections 2024-02-17T12:58:38.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.922+0000 7fe04c215640 1 -- 172.21.15.136:0/3374367321 wait complete. 2024-02-17T12:58:38.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574864 for osd.3 2024-02-17T12:58:38.924 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:38.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.977+0000 7fb4667fc640 1 -- 172.21.15.136:0/2324316755 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4701ef760 con 0x7fb47006bbd0 2024-02-17T12:58:38.968 INFO:teuthology.orchestra.run.smithi136.stdout:55834574862 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb45406b860 msgr2=0x7fb45406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb45406b860 0x7fb45406dd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb460006a90 tx=0x7fb460006a20 comp rx=0 tx=0).stop 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 msgr2=0x7fb4700c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 0x7fb4700c6e70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000c00 tx=0x7fb46c004730 comp rx=0 tx=0).stop 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 shutdown_connections 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb45406b860 0x7fb45406dd20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb47015d150 0x7fb4700c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4700ca370 0x7fb4701f00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 --2- 172.21.15.136:0/2324316755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb47006bbd0 0x7fb4700c6e70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:38.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 >> 172.21.15.136:0/2324316755 conn(0x7fb470070390 msgr2=0x7fb4700cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:38.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 shutdown_connections 2024-02-17T12:58:38.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:38.979+0000 7fb476fa0640 1 -- 172.21.15.136:0/2324316755 wait complete. 2024-02-17T12:58:38.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.4 2024-02-17T12:58:38.981 DEBUG:teuthology.parallel:result is None 2024-02-17T12:58:38.981 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T12:58:38.982 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:39.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.092+0000 7f6bc3e8d640 1 Processor -- start 2024-02-17T12:58:39.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.092+0000 7f6bc3e8d640 1 -- start start 2024-02-17T12:58:39.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc3e8d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6bbc153dc0 0x7f6bbc0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc3e8d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c9460 0x7f6bbc0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc3e8d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc159bd0 con 0x7f6bbc0c99d0 2024-02-17T12:58:39.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc3e8d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc06fe10 con 0x7f6bbc153dc0 2024-02-17T12:58:39.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc3e8d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0700f0 con 0x7f6bbc0c9460 2024-02-17T12:58:39.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc1c29640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6bbc153dc0 0x7f6bbc0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc1428640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6bbc0c99d0 0x7f6bbc15d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:52154/0 (socket says 172.21.15.136:52154) 2024-02-17T12:58:39.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.093+0000 7f6bc1428640 1 -- 172.21.15.136:0/1803231173 learned_addr learned my addr 172.21.15.136:0/1803231173 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:39.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.094+0000 7f6bc242a640 1 --2- 172.21.15.136:0/1803231173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c9460 0x7f6bbc0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.096+0000 7f6bc1c29640 1 -- 172.21.15.136:0/1803231173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c9460 msgr2=0x7f6bbc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:39.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.096+0000 7f6bc1c29640 1 --2- 172.21.15.136:0/1803231173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c9460 0x7f6bbc0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.096+0000 7f6bc1c29640 1 -- 172.21.15.136:0/1803231173 >> v1:172.21.15.160:6789/0 conn(0x7f6bbc0c99d0 legacy=0x7f6bbc15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.096+0000 7f6bc1c29640 1 -- 172.21.15.136:0/1803231173 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc159e90 con 0x7f6bbc153dc0 2024-02-17T12:58:39.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.097+0000 7f6bc1c29640 1 --2- 172.21.15.136:0/1803231173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc0ca970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097a0 tx=0x7f6bb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df669e5796b44315 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:39.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.101+0000 7f6bc0c27640 1 -- 172.21.15.136:0/1803231173 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8031830 con 0x7f6bbc153dc0 2024-02-17T12:58:39.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.101+0000 7f6bc0c27640 1 -- 172.21.15.136:0/1803231173 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8031990 con 0x7f6bbc153dc0 2024-02-17T12:58:39.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.101+0000 7f6bc0c27640 1 -- 172.21.15.136:0/1803231173 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8031d20 con 0x7f6bbc153dc0 2024-02-17T12:58:39.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/1803231173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc153dc0 msgr2=0x7f6bbc0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/1803231173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc0ca970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097a0 tx=0x7f6bb802b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/1803231173 shutdown_connections 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/1803231173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c9460 0x7f6bbc0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/1803231173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc0ca970 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/1803231173 >> 172.21.15.136:0/1803231173 conn(0x7f6bbc066d00 msgr2=0x7f6bbc067110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/1803231173 shutdown_connections 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.102+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/1803231173 wait complete. 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.103+0000 7f6bc3e8d640 1 Processor -- start 2024-02-17T12:58:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.103+0000 7f6bc3e8d640 1 -- start start 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc3e8d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 0x7f6bbc1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc3e8d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c99d0 0x7f6bbc0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc3e8d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc3e8d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0c6e10 con 0x7f6bbc0c9460 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc3e8d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc14dbf0 con 0x7f6bbc153dc0 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc3e8d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0c69d0 con 0x7f6bbc0c99d0 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc1c29640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 0x7f6bbc1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc1c29640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 0x7f6bbc1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50538/0 (socket says 172.21.15.136:50538) 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc1c29640 1 -- 172.21.15.136:0/4199580494 learned_addr learned my addr 172.21.15.136:0/4199580494 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.104+0000 7f6bc1428640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c99d0 0x7f6bbc0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.105+0000 7f6bc242a640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.108+0000 7f6bc1c29640 1 -- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c99d0 msgr2=0x7f6bbc0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.108+0000 7f6bc1c29640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c99d0 0x7f6bbc0aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.108+0000 7f6bc1c29640 1 -- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc153dc0 msgr2=0x7f6bbc14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.108+0000 7f6bc1c29640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc14e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.108+0000 7f6bc1c29640 1 -- 172.21.15.136:0/4199580494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009400 con 0x7f6bbc0c9460 2024-02-17T12:58:39.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.110+0000 7f6bc1c29640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 0x7f6bbc1507e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802bee0 tx=0x7f6bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:39.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.113+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb803b9f0 con 0x7f6bbc0c9460 2024-02-17T12:58:39.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.113+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb803bb70 con 0x7f6bbc0c9460 2024-02-17T12:58:39.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.113+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80453f0 con 0x7f6bbc0c9460 2024-02-17T12:58:39.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.113+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc15aaf0 con 0x7f6bbc0c9460 2024-02-17T12:58:39.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.113+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc14f410 con 0x7f6bbc0c9460 2024-02-17T12:58:39.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.114+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc153870 con 0x7f6bbc0c9460 2024-02-17T12:58:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.133+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6bb804e450 con 0x7f6bbc0c9460 2024-02-17T12:58:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.133+0000 7f6bb27fc640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6ba006b860 0x7f6ba006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.134+0000 7f6bc1428640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6ba006b860 0x7f6ba006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.134+0000 7f6bc1428640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6ba006b860 0x7f6ba006dd20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc14dac0 tx=0x7f6bac007e80 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:39.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.371+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f6bb807ad40 con 0x7f6bbc0c9460 2024-02-17T12:58:39.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.371+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6bb8076fe0 con 0x7f6bbc0c9460 2024-02-17T12:58:39.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.538+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bbc15a970 con 0x7f6ba006b860 2024-02-17T12:58:39.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.547+0000 7f6bb27fc640 1 -- 172.21.15.136:0/4199580494 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345323 (secure 0 0 0) 0x7f6bac001460 con 0x7f6ba006b860 2024-02-17T12:58:39.541 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:39.543 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:39.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6ba006b860 msgr2=0x7f6ba006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6ba006b860 0x7f6ba006dd20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc14dac0 tx=0x7f6bac007e80 comp rx=0 tx=0).stop 2024-02-17T12:58:39.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 msgr2=0x7f6bbc1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 0x7f6bbc1507e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802bee0 tx=0x7f6bb80046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 shutdown_connections 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f6ba006b860 0x7f6ba006dd20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc153dc0 0x7f6bbc14e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc0c99d0 0x7f6bbc0aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 --2- 172.21.15.136:0/4199580494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bbc0c9460 0x7f6bbc1507e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 >> 172.21.15.136:0/4199580494 conn(0x7f6bbc066d00 msgr2=0x7f6bbc0c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 shutdown_connections 2024-02-17T12:58:39.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.550+0000 7f6bc3e8d640 1 -- 172.21.15.136:0/4199580494 wait complete. 2024-02-17T12:58:39.552 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-02-17T12:58:37.991235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600542,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":360,"num_write_kb":2482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":3579904,"data_stored":2071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5534,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001993"},"pg_stats":[{"pgid":"2.1f","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447797+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:35.447797+0000","last_peered":"2024-02-17T12:58:35.447797+0000","last_clean":"2024-02-17T12:58:35.447797+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:35.447797+0000","last_undegraded":"2024-02-17T12:58:35.447797+0000","last_fullsized":"2024-02-17T12:58:35.447797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449786+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:35.449786+0000","last_peered":"2024-02-17T12:58:35.449786+0000","last_clean":"2024-02-17T12:58:35.449786+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:35.449786+0000","last_undegraded":"2024-02-17T12:58:35.449786+0000","last_fullsized":"2024-02-17T12:58:35.449786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252135+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:37.252135+0000","last_peered":"2024-02-17T12:58:37.252135+0000","last_clean":"2024-02-17T12:58:37.252135+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:37.252135+0000","last_undegraded":"2024-02-17T12:58:37.252135+0000","last_fullsized":"2024-02-17T12:58:37.252135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449995+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:35.449995+0000","last_peered":"2024-02-17T12:58:35.449995+0000","last_clean":"2024-02-17T12:58:35.449995+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:35.449995+0000","last_undegraded":"2024-02-17T12:58:35.449995+0000","last_fullsized":"2024-02-17T12:58:35.449995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450004+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:35.450004+0000","last_peered":"2024-02-17T12:58:35.450004+0000","last_clean":"2024-02-17T12:58:35.450004+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:35.450004+0000","last_undegraded":"2024-02-17T12:58:35.450004+0000","last_fullsized":"2024-02-17T12:58:35.450004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250259+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:37.250259+0000","last_peered":"2024-02-17T12:58:37.250259+0000","last_clean":"2024-02-17T12:58:37.250259+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:37.250259+0000","last_undegraded":"2024-02-17T12:58:37.250259+0000","last_fullsized":"2024-02-17T12:58:37.250259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363936+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:37.363936+0000","last_peered":"2024-02-17T12:58:37.363936+0000","last_clean":"2024-02-17T12:58:37.363936+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:37.363936+0000","last_undegraded":"2024-02-17T12:58:37.363936+0000","last_fullsized":"2024-02-17T12:58:37.363936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454386+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:35.454386+0000","last_peered":"2024-02-17T12:58:35.454386+0000","last_clean":"2024-02-17T12:58:35.454386+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:35.454386+0000","last_undegraded":"2024-02-17T12:58:35.454386+0000","last_fullsized":"2024-02-17T12:58:35.454386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.324543+0000","last_change":"2024-02-17T12:58:37.250456+0000","last_active":"2024-02-17T12:58:35.446593+0000","last_peered":"2024-02-17T12:58:03.437264+0000","last_clean":"2024-02-17T12:58:03.437264+0000","last_became_active":"2024-02-17T12:58:02.529672+0000","last_became_peered":"2024-02-17T12:58:02.529672+0000","last_unstale":"2024-02-17T12:58:37.324543+0000","last_undegraded":"2024-02-17T12:58:37.324543+0000","last_fullsized":"2024-02-17T12:58:37.324543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":["2(0)","0(2)","3(2)","5(1)","6(3)"],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364065+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:37.364065+0000","last_peered":"2024-02-17T12:58:37.364065+0000","last_clean":"2024-02-17T12:58:37.364065+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:37.364065+0000","last_undegraded":"2024-02-17T12:58:37.364065+0000","last_fullsized":"2024-02-17T12:58:37.364065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248354+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:37.248354+0000","last_peered":"2024-02-17T12:58:37.248354+0000","last_clean":"2024-02-17T12:58:37.248354+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:37.248354+0000","last_undegraded":"2024-02-17T12:58:37.248354+0000","last_fullsized":"2024-02-17T12:58:37.248354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251301+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:37.251301+0000","last_peered":"2024-02-17T12:58:37.251301+0000","last_clean":"2024-02-17T12:58:37.251301+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:37.251301+0000","last_undegraded":"2024-02-17T12:58:37.251301+0000","last_fullsized":"2024-02-17T12:58:37.251301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248286+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:37.248286+0000","last_peered":"2024-02-17T12:58:37.248286+0000","last_clean":"2024-02-17T12:58:37.248286+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:37.248286+0000","last_undegraded":"2024-02-17T12:58:37.248286+0000","last_fullsized":"2024-02-17T12:58:37.248286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248415+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:37.248415+0000","last_peered":"2024-02-17T12:58:37.248415+0000","last_clean":"2024-02-17T12:58:37.248415+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:37.248415+0000","last_undegraded":"2024-02-17T12:58:37.248415+0000","last_fullsized":"2024-02-17T12:58:37.248415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248122+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:37.248122+0000","last_peered":"2024-02-17T12:58:37.248122+0000","last_clean":"2024-02-17T12:58:37.248122+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:37.248122+0000","last_undegraded":"2024-02-17T12:58:37.248122+0000","last_fullsized":"2024-02-17T12:58:37.248122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251582+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:37.251582+0000","last_peered":"2024-02-17T12:58:37.251582+0000","last_clean":"2024-02-17T12:58:37.251582+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:37.251582+0000","last_undegraded":"2024-02-17T12:58:37.251582+0000","last_fullsized":"2024-02-17T12:58:37.251582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324439+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:37.324439+0000","last_peered":"2024-02-17T12:58:37.324439+0000","last_clean":"2024-02-17T12:58:37.324439+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:37.324439+0000","last_undegraded":"2024-02-17T12:58:37.324439+0000","last_fullsized":"2024-02-17T12:58:37.324439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363560+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:37.363560+0000","last_peered":"2024-02-17T12:58:37.363560+0000","last_clean":"2024-02-17T12:58:37.363560+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:37.363560+0000","last_undegraded":"2024-02-17T12:58:37.363560+0000","last_fullsized":"2024-02-17T12:58:37.363560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446619+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:35.446619+0000","last_peered":"2024-02-17T12:58:35.446619+0000","last_clean":"2024-02-17T12:58:35.446619+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:35.446619+0000","last_undegraded":"2024-02-17T12:58:35.446619+0000","last_fullsized":"2024-02-17T12:58:35.446619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447017+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:35.447017+0000","last_peered":"2024-02-17T12:58:35.447017+0000","last_clean":"2024-02-17T12:58:35.447017+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:35.447017+0000","last_undegraded":"2024-02-17T12:58:35.447017+0000","last_fullsized":"2024-02-17T12:58:35.447017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252567+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:37.252567+0000","last_peered":"2024-02-17T12:58:37.252567+0000","last_clean":"2024-02-17T12:58:37.252567+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:37.252567+0000","last_undegraded":"2024-02-17T12:58:37.252567+0000","last_fullsized":"2024-02-17T12:58:37.252567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247975+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:37.247975+0000","last_peered":"2024-02-17T12:58:37.247975+0000","last_clean":"2024-02-17T12:58:37.247975+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:37.247975+0000","last_undegraded":"2024-02-17T12:58:37.247975+0000","last_fullsized":"2024-02-17T12:58:37.247975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363471+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:37.363471+0000","last_peered":"2024-02-17T12:58:37.363471+0000","last_clean":"2024-02-17T12:58:37.363471+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:37.363471+0000","last_undegraded":"2024-02-17T12:58:37.363471+0000","last_fullsized":"2024-02-17T12:58:37.363471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251135+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:37.251135+0000","last_peered":"2024-02-17T12:58:37.251135+0000","last_clean":"2024-02-17T12:58:37.251135+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:37.251135+0000","last_undegraded":"2024-02-17T12:58:37.251135+0000","last_fullsized":"2024-02-17T12:58:37.251135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447387+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:35.447387+0000","last_peered":"2024-02-17T12:58:35.447387+0000","last_clean":"2024-02-17T12:58:35.447387+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:35.447387+0000","last_undegraded":"2024-02-17T12:58:35.447387+0000","last_fullsized":"2024-02-17T12:58:35.447387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248929+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:37.248929+0000","last_peered":"2024-02-17T12:58:37.248929+0000","last_clean":"2024-02-17T12:58:37.248929+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:37.248929+0000","last_undegraded":"2024-02-17T12:58:37.248929+0000","last_fullsized":"2024-02-17T12:58:37.248929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250402+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:37.250402+0000","last_peered":"2024-02-17T12:58:37.250402+0000","last_clean":"2024-02-17T12:58:37.250402+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:37.250402+0000","last_undegraded":"2024-02-17T12:58:37.250402+0000","last_fullsized":"2024-02-17T12:58:37.250402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447772+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:35.447772+0000","last_peered":"2024-02-17T12:58:35.447772+0000","last_clean":"2024-02-17T12:58:35.447772+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:35.447772+0000","last_undegraded":"2024-02-17T12:58:35.447772+0000","last_fullsized":"2024-02-17T12:58:35.447772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447557+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:35.447557+0000","last_peered":"2024-02-17T12:58:35.447557+0000","last_clean":"2024-02-17T12:58:35.447557+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:35.447557+0000","last_undegraded":"2024-02-17T12:58:35.447557+0000","last_fullsized":"2024-02-17T12:58:35.447557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446610+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:35.446610+0000","last_peered":"2024-02-17T12:58:35.446610+0000","last_clean":"2024-02-17T12:58:35.446610+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:35.446610+0000","last_undegraded":"2024-02-17T12:58:35.446610+0000","last_fullsized":"2024-02-17T12:58:35.446610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324493+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:37.324493+0000","last_peered":"2024-02-17T12:58:37.324493+0000","last_clean":"2024-02-17T12:58:37.324493+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:37.324493+0000","last_undegraded":"2024-02-17T12:58:37.324493+0000","last_fullsized":"2024-02-17T12:58:37.324493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248623+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:37.248623+0000","last_peered":"2024-02-17T12:58:37.248623+0000","last_clean":"2024-02-17T12:58:37.248623+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:37.248623+0000","last_undegraded":"2024-02-17T12:58:37.248623+0000","last_fullsized":"2024-02-17T12:58:37.248623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324212+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:37.324212+0000","last_peered":"2024-02-17T12:58:37.324212+0000","last_clean":"2024-02-17T12:58:37.324212+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:37.324212+0000","last_undegraded":"2024-02-17T12:58:37.324212+0000","last_fullsized":"2024-02-17T12:58:37.324212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250988+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:37.250988+0000","last_peered":"2024-02-17T12:58:37.250988+0000","last_clean":"2024-02-17T12:58:37.250988+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:37.250988+0000","last_undegraded":"2024-02-17T12:58:37.250988+0000","last_fullsized":"2024-02-17T12:58:37.250988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450301+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:35.450301+0000","last_peered":"2024-02-17T12:58:35.450301+0000","last_clean":"2024-02-17T12:58:35.450301+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:35.450301+0000","last_undegraded":"2024-02-17T12:58:35.450301+0000","last_fullsized":"2024-02-17T12:58:35.450301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324026+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:37.324026+0000","last_peered":"2024-02-17T12:58:37.324026+0000","last_clean":"2024-02-17T12:58:37.324026+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:37.324026+0000","last_undegraded":"2024-02-17T12:58:37.324026+0000","last_fullsized":"2024-02-17T12:58:37.324026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363882+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:37.363882+0000","last_peered":"2024-02-17T12:58:37.363882+0000","last_clean":"2024-02-17T12:58:37.363882+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:37.363882+0000","last_undegraded":"2024-02-17T12:58:37.363882+0000","last_fullsized":"2024-02-17T12:58:37.363882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248625+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:37.248625+0000","last_peered":"2024-02-17T12:58:37.248625+0000","last_clean":"2024-02-17T12:58:37.248625+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:37.248625+0000","last_undegraded":"2024-02-17T12:58:37.248625+0000","last_fullsized":"2024-02-17T12:58:37.248625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324381+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:37.324381+0000","last_peered":"2024-02-17T12:58:37.324381+0000","last_clean":"2024-02-17T12:58:37.324381+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:37.324381+0000","last_undegraded":"2024-02-17T12:58:37.324381+0000","last_fullsized":"2024-02-17T12:58:37.324381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449065+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:35.449065+0000","last_peered":"2024-02-17T12:58:35.449065+0000","last_clean":"2024-02-17T12:58:35.449065+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:35.449065+0000","last_undegraded":"2024-02-17T12:58:35.449065+0000","last_fullsized":"2024-02-17T12:58:35.449065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251333+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:37.251333+0000","last_peered":"2024-02-17T12:58:37.251333+0000","last_clean":"2024-02-17T12:58:37.251333+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:37.251333+0000","last_undegraded":"2024-02-17T12:58:37.251333+0000","last_fullsized":"2024-02-17T12:58:37.251333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324268+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:37.324268+0000","last_peered":"2024-02-17T12:58:37.324268+0000","last_clean":"2024-02-17T12:58:37.324268+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:37.324268+0000","last_undegraded":"2024-02-17T12:58:37.324268+0000","last_fullsized":"2024-02-17T12:58:37.324268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.323981+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:37.323981+0000","last_peered":"2024-02-17T12:58:37.323981+0000","last_clean":"2024-02-17T12:58:37.323981+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:37.323981+0000","last_undegraded":"2024-02-17T12:58:37.323981+0000","last_fullsized":"2024-02-17T12:58:37.323981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247892+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:37.247892+0000","last_peered":"2024-02-17T12:58:37.247892+0000","last_clean":"2024-02-17T12:58:37.247892+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:37.247892+0000","last_undegraded":"2024-02-17T12:58:37.247892+0000","last_fullsized":"2024-02-17T12:58:37.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449414+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:35.449414+0000","last_peered":"2024-02-17T12:58:35.449414+0000","last_clean":"2024-02-17T12:58:35.449414+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:35.449414+0000","last_undegraded":"2024-02-17T12:58:35.449414+0000","last_fullsized":"2024-02-17T12:58:35.449414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446932+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:35.446932+0000","last_peered":"2024-02-17T12:58:35.446932+0000","last_clean":"2024-02-17T12:58:35.446932+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:35.446932+0000","last_undegraded":"2024-02-17T12:58:35.446932+0000","last_fullsized":"2024-02-17T12:58:35.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453996+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:35.453996+0000","last_peered":"2024-02-17T12:58:35.453996+0000","last_clean":"2024-02-17T12:58:35.453996+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:35.453996+0000","last_undegraded":"2024-02-17T12:58:35.453996+0000","last_fullsized":"2024-02-17T12:58:35.453996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324559+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:37.324559+0000","last_peered":"2024-02-17T12:58:37.324559+0000","last_clean":"2024-02-17T12:58:37.324559+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:37.324559+0000","last_undegraded":"2024-02-17T12:58:37.324559+0000","last_fullsized":"2024-02-17T12:58:37.324559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250612+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:37.250612+0000","last_peered":"2024-02-17T12:58:37.250612+0000","last_clean":"2024-02-17T12:58:37.250612+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:37.250612+0000","last_undegraded":"2024-02-17T12:58:37.250612+0000","last_fullsized":"2024-02-17T12:58:37.250612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363999+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:37.363999+0000","last_peered":"2024-02-17T12:58:37.363999+0000","last_clean":"2024-02-17T12:58:37.363999+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:37.363999+0000","last_undegraded":"2024-02-17T12:58:37.363999+0000","last_fullsized":"2024-02-17T12:58:37.363999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450641+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:35.450641+0000","last_peered":"2024-02-17T12:58:35.450641+0000","last_clean":"2024-02-17T12:58:35.450641+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:35.450641+0000","last_undegraded":"2024-02-17T12:58:35.450641+0000","last_fullsized":"2024-02-17T12:58:35.450641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449570+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:35.449570+0000","last_peered":"2024-02-17T12:58:35.449570+0000","last_clean":"2024-02-17T12:58:35.449570+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:35.449570+0000","last_undegraded":"2024-02-17T12:58:35.449570+0000","last_fullsized":"2024-02-17T12:58:35.449570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363983+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:37.363983+0000","last_peered":"2024-02-17T12:58:37.363983+0000","last_clean":"2024-02-17T12:58:37.363983+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:37.363983+0000","last_undegraded":"2024-02-17T12:58:37.363983+0000","last_fullsized":"2024-02-17T12:58:37.363983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447469+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:35.447469+0000","last_peered":"2024-02-17T12:58:35.447469+0000","last_clean":"2024-02-17T12:58:35.447469+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:35.447469+0000","last_undegraded":"2024-02-17T12:58:35.447469+0000","last_fullsized":"2024-02-17T12:58:35.447469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247666+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:37.247666+0000","last_peered":"2024-02-17T12:58:37.247666+0000","last_clean":"2024-02-17T12:58:37.247666+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:37.247666+0000","last_undegraded":"2024-02-17T12:58:37.247666+0000","last_fullsized":"2024-02-17T12:58:37.247666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251231+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:37.251231+0000","last_peered":"2024-02-17T12:58:37.251231+0000","last_clean":"2024-02-17T12:58:37.251231+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:37.251231+0000","last_undegraded":"2024-02-17T12:58:37.251231+0000","last_fullsized":"2024-02-17T12:58:37.251231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364174+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:37.364174+0000","last_peered":"2024-02-17T12:58:37.364174+0000","last_clean":"2024-02-17T12:58:37.364174+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:37.364174+0000","last_undegraded":"2024-02-17T12:58:37.364174+0000","last_fullsized":"2024-02-17T12:58:37.364174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453399+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:35.453399+0000","last_peered":"2024-02-17T12:58:35.453399+0000","last_clean":"2024-02-17T12:58:35.453399+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:35.453399+0000","last_undegraded":"2024-02-17T12:58:35.453399+0000","last_fullsized":"2024-02-17T12:58:35.453399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247880+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:37.247880+0000","last_peered":"2024-02-17T12:58:37.247880+0000","last_clean":"2024-02-17T12:58:37.247880+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:37.247880+0000","last_undegraded":"2024-02-17T12:58:37.247880+0000","last_fullsized":"2024-02-17T12:58:37.247880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'16","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446726+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:35.446726+0000","last_peered":"2024-02-17T12:58:35.446726+0000","last_clean":"2024-02-17T12:58:35.446726+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:35.446726+0000","last_undegraded":"2024-02-17T12:58:35.446726+0000","last_fullsized":"2024-02-17T12:58:35.446726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449691+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:35.449691+0000","last_peered":"2024-02-17T12:58:35.449691+0000","last_clean":"2024-02-17T12:58:35.449691+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:35.449691+0000","last_undegraded":"2024-02-17T12:58:35.449691+0000","last_fullsized":"2024-02-17T12:58:35.449691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453774+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:35.453774+0000","last_peered":"2024-02-17T12:58:35.453774+0000","last_clean":"2024-02-17T12:58:35.453774+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:35.453774+0000","last_undegraded":"2024-02-17T12:58:35.453774+0000","last_fullsized":"2024-02-17T12:58:35.453774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363771+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:37.363771+0000","last_peered":"2024-02-17T12:58:37.363771+0000","last_clean":"2024-02-17T12:58:37.363771+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:37.363771+0000","last_undegraded":"2024-02-17T12:58:37.363771+0000","last_fullsized":"2024-02-17T12:58:37.363771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449906+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:35.449906+0000","last_peered":"2024-02-17T12:58:35.449906+0000","last_clean":"2024-02-17T12:58:35.449906+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:35.449906+0000","last_undegraded":"2024-02-17T12:58:35.449906+0000","last_fullsized":"2024-02-17T12:58:35.449906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248256+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:37.248256+0000","last_peered":"2024-02-17T12:58:37.248256+0000","last_clean":"2024-02-17T12:58:37.248256+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:37.248256+0000","last_undegraded":"2024-02-17T12:58:37.248256+0000","last_fullsized":"2024-02-17T12:58:37.248256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248528+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:37.248528+0000","last_peered":"2024-02-17T12:58:37.248528+0000","last_clean":"2024-02-17T12:58:37.248528+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:37.248528+0000","last_undegraded":"2024-02-17T12:58:37.248528+0000","last_fullsized":"2024-02-17T12:58:37.248528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324198+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:37.324198+0000","last_peered":"2024-02-17T12:58:37.324198+0000","last_clean":"2024-02-17T12:58:37.324198+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:37.324198+0000","last_undegraded":"2024-02-17T12:58:37.324198+0000","last_fullsized":"2024-02-17T12:58:37.324198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324160+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:37.324160+0000","last_peered":"2024-02-17T12:58:37.324160+0000","last_clean":"2024-02-17T12:58:37.324160+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:37.324160+0000","last_undegraded":"2024-02-17T12:58:37.324160+0000","last_fullsized":"2024-02-17T12:58:37.324160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251902+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:37.251902+0000","last_peered":"2024-02-17T12:58:37.251902+0000","last_clean":"2024-02-17T12:58:37.251902+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:37.251902+0000","last_undegraded":"2024-02-17T12:58:37.251902+0000","last_fullsized":"2024-02-17T12:58:37.251902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248263+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:37.248263+0000","last_peered":"2024-02-17T12:58:37.248263+0000","last_clean":"2024-02-17T12:58:37.248263+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:37.248263+0000","last_undegraded":"2024-02-17T12:58:37.248263+0000","last_fullsized":"2024-02-17T12:58:37.248263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363833+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:37.363833+0000","last_peered":"2024-02-17T12:58:37.363833+0000","last_clean":"2024-02-17T12:58:37.363833+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:37.363833+0000","last_undegraded":"2024-02-17T12:58:37.363833+0000","last_fullsized":"2024-02-17T12:58:37.363833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250807+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:37.250807+0000","last_peered":"2024-02-17T12:58:37.250807+0000","last_clean":"2024-02-17T12:58:37.250807+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:37.250807+0000","last_undegraded":"2024-02-17T12:58:37.250807+0000","last_fullsized":"2024-02-17T12:58:37.250807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446826+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:35.446826+0000","last_peered":"2024-02-17T12:58:35.446826+0000","last_clean":"2024-02-17T12:58:35.446826+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:35.446826+0000","last_undegraded":"2024-02-17T12:58:35.446826+0000","last_fullsized":"2024-02-17T12:58:35.446826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248015+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:37.248015+0000","last_peered":"2024-02-17T12:58:37.248015+0000","last_clean":"2024-02-17T12:58:37.248015+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:37.248015+0000","last_undegraded":"2024-02-17T12:58:37.248015+0000","last_fullsized":"2024-02-17T12:58:37.248015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252276+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:37.252276+0000","last_peered":"2024-02-17T12:58:37.252276+0000","last_clean":"2024-02-17T12:58:37.252276+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:37.252276+0000","last_undegraded":"2024-02-17T12:58:37.252276+0000","last_fullsized":"2024-02-17T12:58:37.252276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250675+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:37.250675+0000","last_peered":"2024-02-17T12:58:37.250675+0000","last_clean":"2024-02-17T12:58:37.250675+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:37.250675+0000","last_undegraded":"2024-02-17T12:58:37.250675+0000","last_fullsized":"2024-02-17T12:58:37.250675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450071+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.450071+0000","last_peered":"2024-02-17T12:58:35.450071+0000","last_clean":"2024-02-17T12:58:35.450071+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:35.450071+0000","last_undegraded":"2024-02-17T12:58:35.450071+0000","last_fullsized":"2024-02-17T12:58:35.450071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364124+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:37.364124+0000","last_peered":"2024-02-17T12:58:37.364124+0000","last_clean":"2024-02-17T12:58:37.364124+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:37.364124+0000","last_undegraded":"2024-02-17T12:58:37.364124+0000","last_fullsized":"2024-02-17T12:58:37.364124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251083+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:37.251083+0000","last_peered":"2024-02-17T12:58:37.251083+0000","last_clean":"2024-02-17T12:58:37.251083+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:37.251083+0000","last_undegraded":"2024-02-17T12:58:37.251083+0000","last_fullsized":"2024-02-17T12:58:37.251083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251217+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:37.251217+0000","last_peered":"2024-02-17T12:58:37.251217+0000","last_clean":"2024-02-17T12:58:37.251217+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:37.251217+0000","last_undegraded":"2024-02-17T12:58:37.251217+0000","last_fullsized":"2024-02-17T12:58:37.251217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454832+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:35.454832+0000","last_peered":"2024-02-17T12:58:35.454832+0000","last_clean":"2024-02-17T12:58:35.454832+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:35.454832+0000","last_undegraded":"2024-02-17T12:58:35.454832+0000","last_fullsized":"2024-02-17T12:58:35.454832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446907+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:35.446907+0000","last_peered":"2024-02-17T12:58:35.446907+0000","last_clean":"2024-02-17T12:58:35.446907+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:35.446907+0000","last_undegraded":"2024-02-17T12:58:35.446907+0000","last_fullsized":"2024-02-17T12:58:35.446907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447300+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:35.447300+0000","last_peered":"2024-02-17T12:58:35.447300+0000","last_clean":"2024-02-17T12:58:35.447300+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:35.447300+0000","last_undegraded":"2024-02-17T12:58:35.447300+0000","last_fullsized":"2024-02-17T12:58:35.447300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446948+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:35.446948+0000","last_peered":"2024-02-17T12:58:35.446948+0000","last_clean":"2024-02-17T12:58:35.446948+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:35.446948+0000","last_undegraded":"2024-02-17T12:58:35.446948+0000","last_fullsized":"2024-02-17T12:58:35.446948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247856+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:37.247856+0000","last_peered":"2024-02-17T12:58:37.247856+0000","last_clean":"2024-02-17T12:58:37.247856+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:37.247856+0000","last_undegraded":"2024-02-17T12:58:37.247856+0000","last_fullsized":"2024-02-17T12:58:37.247856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248706+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:37.248706+0000","last_peered":"2024-02-17T12:58:37.248706+0000","last_clean":"2024-02-17T12:58:37.248706+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:37.248706+0000","last_undegraded":"2024-02-17T12:58:37.248706+0000","last_fullsized":"2024-02-17T12:58:37.248706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449178+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:35.449178+0000","last_peered":"2024-02-17T12:58:35.449178+0000","last_clean":"2024-02-17T12:58:35.449178+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:35.449178+0000","last_undegraded":"2024-02-17T12:58:35.449178+0000","last_fullsized":"2024-02-17T12:58:35.449178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324017+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:37.324017+0000","last_peered":"2024-02-17T12:58:37.324017+0000","last_clean":"2024-02-17T12:58:37.324017+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:37.324017+0000","last_undegraded":"2024-02-17T12:58:37.324017+0000","last_fullsized":"2024-02-17T12:58:37.324017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447093+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:35.447093+0000","last_peered":"2024-02-17T12:58:35.447093+0000","last_clean":"2024-02-17T12:58:35.447093+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:35.447093+0000","last_undegraded":"2024-02-17T12:58:35.447093+0000","last_fullsized":"2024-02-17T12:58:35.447093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447152+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:35.447152+0000","last_peered":"2024-02-17T12:58:35.447152+0000","last_clean":"2024-02-17T12:58:35.447152+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:35.447152+0000","last_undegraded":"2024-02-17T12:58:35.447152+0000","last_fullsized":"2024-02-17T12:58:35.447152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449679+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:35.449679+0000","last_peered":"2024-02-17T12:58:35.449679+0000","last_clean":"2024-02-17T12:58:35.449679+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:35.449679+0000","last_undegraded":"2024-02-17T12:58:35.449679+0000","last_fullsized":"2024-02-17T12:58:35.449679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454124+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:35.454124+0000","last_peered":"2024-02-17T12:58:35.454124+0000","last_clean":"2024-02-17T12:58:35.454124+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:35.454124+0000","last_undegraded":"2024-02-17T12:58:35.454124+0000","last_fullsized":"2024-02-17T12:58:35.454124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":5,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.250879+0000","last_change":"2024-02-17T12:58:37.250879+0000","last_active":"2024-02-17T12:58:01.234263+0000","last_peered":"2024-02-17T12:58:01.234263+0000","last_clean":"2024-02-17T12:58:01.234263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:58:37.250879+0000","last_undegraded":"2024-02-17T12:58:37.250879+0000","last_fullsized":"2024-02-17T12:58:37.250879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":["2(0)","0(3)","1(2)","5(1)","7(0)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250452+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:37.250452+0000","last_peered":"2024-02-17T12:58:37.250452+0000","last_clean":"2024-02-17T12:58:37.250452+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:37.250452+0000","last_undegraded":"2024-02-17T12:58:37.250452+0000","last_fullsized":"2024-02-17T12:58:37.250452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251224+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:37.251224+0000","last_peered":"2024-02-17T12:58:37.251224+0000","last_clean":"2024-02-17T12:58:37.251224+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:37.251224+0000","last_undegraded":"2024-02-17T12:58:37.251224+0000","last_fullsized":"2024-02-17T12:58:37.251224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248199+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:37.248199+0000","last_peered":"2024-02-17T12:58:37.248199+0000","last_clean":"2024-02-17T12:58:37.248199+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:37.248199+0000","last_undegraded":"2024-02-17T12:58:37.248199+0000","last_fullsized":"2024-02-17T12:58:37.248199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449596+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:35.449596+0000","last_peered":"2024-02-17T12:58:35.449596+0000","last_clean":"2024-02-17T12:58:35.449596+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:35.449596+0000","last_undegraded":"2024-02-17T12:58:35.449596+0000","last_fullsized":"2024-02-17T12:58:35.449596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324471+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:37.324471+0000","last_peered":"2024-02-17T12:58:37.324471+0000","last_clean":"2024-02-17T12:58:37.324471+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:37.324471+0000","last_undegraded":"2024-02-17T12:58:37.324471+0000","last_fullsized":"2024-02-17T12:58:37.324471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324153+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:37.324153+0000","last_peered":"2024-02-17T12:58:37.324153+0000","last_clean":"2024-02-17T12:58:37.324153+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:37.324153+0000","last_undegraded":"2024-02-17T12:58:37.324153+0000","last_fullsized":"2024-02-17T12:58:37.324153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251155+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:37.251155+0000","last_peered":"2024-02-17T12:58:37.251155+0000","last_clean":"2024-02-17T12:58:37.251155+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:37.251155+0000","last_undegraded":"2024-02-17T12:58:37.251155+0000","last_fullsized":"2024-02-17T12:58:37.251155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449798+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.449798+0000","last_peered":"2024-02-17T12:58:35.449798+0000","last_clean":"2024-02-17T12:58:35.449798+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:35.449798+0000","last_undegraded":"2024-02-17T12:58:35.449798+0000","last_fullsized":"2024-02-17T12:58:35.449798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247786+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:37.247786+0000","last_peered":"2024-02-17T12:58:37.247786+0000","last_clean":"2024-02-17T12:58:37.247786+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:37.247786+0000","last_undegraded":"2024-02-17T12:58:37.247786+0000","last_fullsized":"2024-02-17T12:58:37.247786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449437+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:35.449437+0000","last_peered":"2024-02-17T12:58:35.449437+0000","last_clean":"2024-02-17T12:58:35.449437+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:35.449437+0000","last_undegraded":"2024-02-17T12:58:35.449437+0000","last_fullsized":"2024-02-17T12:58:35.449437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453645+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:35.453645+0000","last_peered":"2024-02-17T12:58:35.453645+0000","last_clean":"2024-02-17T12:58:35.453645+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:35.453645+0000","last_undegraded":"2024-02-17T12:58:35.453645+0000","last_fullsized":"2024-02-17T12:58:35.453645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446907+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:35.446907+0000","last_peered":"2024-02-17T12:58:35.446907+0000","last_clean":"2024-02-17T12:58:35.446907+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:35.446907+0000","last_undegraded":"2024-02-17T12:58:35.446907+0000","last_fullsized":"2024-02-17T12:58:35.446907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.741377+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T12:58:37.741377+0000","last_peered":"2024-02-17T12:58:37.741377+0000","last_clean":"2024-02-17T12:58:37.741377+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T12:58:37.741377+0000","last_undegraded":"2024-02-17T12:58:37.741377+0000","last_fullsized":"2024-02-17T12:58:37.741377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248600+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:37.248600+0000","last_peered":"2024-02-17T12:58:37.248600+0000","last_clean":"2024-02-17T12:58:37.248600+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:37.248600+0000","last_undegraded":"2024-02-17T12:58:37.248600+0000","last_fullsized":"2024-02-17T12:58:37.248600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252206+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:37.252206+0000","last_peered":"2024-02-17T12:58:37.252206+0000","last_clean":"2024-02-17T12:58:37.252206+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:37.252206+0000","last_undegraded":"2024-02-17T12:58:37.252206+0000","last_fullsized":"2024-02-17T12:58:37.252206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248852+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:37.248852+0000","last_peered":"2024-02-17T12:58:37.248852+0000","last_clean":"2024-02-17T12:58:37.248852+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:37.248852+0000","last_undegraded":"2024-02-17T12:58:37.248852+0000","last_fullsized":"2024-02-17T12:58:37.248852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247763+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:37.247763+0000","last_peered":"2024-02-17T12:58:37.247763+0000","last_clean":"2024-02-17T12:58:37.247763+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:37.247763+0000","last_undegraded":"2024-02-17T12:58:37.247763+0000","last_fullsized":"2024-02-17T12:58:37.247763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449274+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:35.449274+0000","last_peered":"2024-02-17T12:58:35.449274+0000","last_clean":"2024-02-17T12:58:35.449274+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:35.449274+0000","last_undegraded":"2024-02-17T12:58:35.449274+0000","last_fullsized":"2024-02-17T12:58:35.449274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324058+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:37.324058+0000","last_peered":"2024-02-17T12:58:37.324058+0000","last_clean":"2024-02-17T12:58:37.324058+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:37.324058+0000","last_undegraded":"2024-02-17T12:58:37.324058+0000","last_fullsized":"2024-02-17T12:58:37.324058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324329+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:37.324329+0000","last_peered":"2024-02-17T12:58:37.324329+0000","last_clean":"2024-02-17T12:58:37.324329+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:37.324329+0000","last_undegraded":"2024-02-17T12:58:37.324329+0000","last_fullsized":"2024-02-17T12:58:37.324329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363917+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:37.363917+0000","last_peered":"2024-02-17T12:58:37.363917+0000","last_clean":"2024-02-17T12:58:37.363917+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:37.363917+0000","last_undegraded":"2024-02-17T12:58:37.363917+0000","last_fullsized":"2024-02-17T12:58:37.363917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363804+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:37.363804+0000","last_peered":"2024-02-17T12:58:37.363804+0000","last_clean":"2024-02-17T12:58:37.363804+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:37.363804+0000","last_undegraded":"2024-02-17T12:58:37.363804+0000","last_fullsized":"2024-02-17T12:58:37.363804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363645+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:37.363645+0000","last_peered":"2024-02-17T12:58:37.363645+0000","last_clean":"2024-02-17T12:58:37.363645+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:37.363645+0000","last_undegraded":"2024-02-17T12:58:37.363645+0000","last_fullsized":"2024-02-17T12:58:37.363645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454803+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:35.454803+0000","last_peered":"2024-02-17T12:58:35.454803+0000","last_clean":"2024-02-17T12:58:35.454803+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:35.454803+0000","last_undegraded":"2024-02-17T12:58:35.454803+0000","last_fullsized":"2024-02-17T12:58:35.454803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449023+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:35.449023+0000","last_peered":"2024-02-17T12:58:35.449023+0000","last_clean":"2024-02-17T12:58:35.449023+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:35.449023+0000","last_undegraded":"2024-02-17T12:58:35.449023+0000","last_fullsized":"2024-02-17T12:58:35.449023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363643+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:37.363643+0000","last_peered":"2024-02-17T12:58:37.363643+0000","last_clean":"2024-02-17T12:58:37.363643+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:37.363643+0000","last_undegraded":"2024-02-17T12:58:37.363643+0000","last_fullsized":"2024-02-17T12:58:37.363643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251191+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:37.251191+0000","last_peered":"2024-02-17T12:58:37.251191+0000","last_clean":"2024-02-17T12:58:37.251191+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:37.251191+0000","last_undegraded":"2024-02-17T12:58:37.251191+0000","last_fullsized":"2024-02-17T12:58:37.251191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363883+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:37.363883+0000","last_peered":"2024-02-17T12:58:37.363883+0000","last_clean":"2024-02-17T12:58:37.363883+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:37.363883+0000","last_undegraded":"2024-02-17T12:58:37.363883+0000","last_fullsized":"2024-02-17T12:58:37.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250720+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:37.250720+0000","last_peered":"2024-02-17T12:58:37.250720+0000","last_clean":"2024-02-17T12:58:37.250720+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:37.250720+0000","last_undegraded":"2024-02-17T12:58:37.250720+0000","last_fullsized":"2024-02-17T12:58:37.250720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450393+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:35.450393+0000","last_peered":"2024-02-17T12:58:35.450393+0000","last_clean":"2024-02-17T12:58:35.450393+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:35.450393+0000","last_undegraded":"2024-02-17T12:58:35.450393+0000","last_fullsized":"2024-02-17T12:58:35.450393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449588+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:35.449588+0000","last_peered":"2024-02-17T12:58:35.449588+0000","last_clean":"2024-02-17T12:58:35.449588+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:35.449588+0000","last_undegraded":"2024-02-17T12:58:35.449588+0000","last_fullsized":"2024-02-17T12:58:35.449588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364223+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:37.364223+0000","last_peered":"2024-02-17T12:58:37.364223+0000","last_clean":"2024-02-17T12:58:37.364223+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:37.364223+0000","last_undegraded":"2024-02-17T12:58:37.364223+0000","last_fullsized":"2024-02-17T12:58:37.364223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10174,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":20348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":115059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":109550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":698364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":112670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":109090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":698952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":109712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":5500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:39.557 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:39.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.703+0000 7fce54343640 1 Processor -- start 2024-02-17T12:58:39.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.703+0000 7fce54343640 1 -- start start 2024-02-17T12:58:39.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.704+0000 7fce54343640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fce4c157430 0x7fce4c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.704+0000 7fce54343640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c7e30 0x7fce4c070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.704+0000 7fce54343640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0c9d20 con 0x7fce4c0c4340 2024-02-17T12:58:39.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.704+0000 7fce54343640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c06bf20 con 0x7fce4c157430 2024-02-17T12:58:39.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.704+0000 7fce54343640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c06cd20 con 0x7fce4c0c7e30 2024-02-17T12:58:39.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.705+0000 7fce528e0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c7e30 0x7fce4c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.705+0000 7fce518de640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fce4c0c4340 0x7fce4c15d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38066/0 (socket says 172.21.15.136:38066) 2024-02-17T12:58:39.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.705+0000 7fce518de640 1 -- 172.21.15.136:0/288765401 learned_addr learned my addr 172.21.15.136:0/288765401 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:39.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.705+0000 7fce520df640 1 --2- 172.21.15.136:0/288765401 >> v2:172.21.15.136:3300/0 conn(0x7fce4c157430 0x7fce4c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.707+0000 7fce528e0640 1 -- 172.21.15.136:0/288765401 >> v2:172.21.15.136:3300/0 conn(0x7fce4c157430 msgr2=0x7fce4c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:39.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.707+0000 7fce528e0640 1 --2- 172.21.15.136:0/288765401 >> v2:172.21.15.136:3300/0 conn(0x7fce4c157430 0x7fce4c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.707+0000 7fce528e0640 1 -- 172.21.15.136:0/288765401 >> v1:172.21.15.136:6789/0 conn(0x7fce4c0c4340 legacy=0x7fce4c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.707+0000 7fce528e0640 1 -- 172.21.15.136:0/288765401 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c06bbd0 con 0x7fce4c0c7e30 2024-02-17T12:58:39.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.709+0000 7fce528e0640 1 --2- 172.21.15.136:0/288765401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c7e30 0x7fce4c070720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce44009d90 tx=0x7fce4402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b675915ae760e10 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:39.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.713+0000 7fce510dd640 1 -- 172.21.15.136:0/288765401 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4402cc50 con 0x7fce4c0c7e30 2024-02-17T12:58:39.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.713+0000 7fce510dd640 1 -- 172.21.15.136:0/288765401 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4402cdb0 con 0x7fce4c0c7e30 2024-02-17T12:58:39.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.713+0000 7fce510dd640 1 -- 172.21.15.136:0/288765401 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44034660 con 0x7fce4c0c7e30 2024-02-17T12:58:39.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 -- 172.21.15.136:0/288765401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c7e30 msgr2=0x7fce4c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 --2- 172.21.15.136:0/288765401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c7e30 0x7fce4c070720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce44009d90 tx=0x7fce4402bea0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 -- 172.21.15.136:0/288765401 shutdown_connections 2024-02-17T12:58:39.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 --2- 172.21.15.136:0/288765401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c7e30 0x7fce4c070720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 --2- 172.21.15.136:0/288765401 >> v2:172.21.15.136:3300/0 conn(0x7fce4c157430 0x7fce4c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 -- 172.21.15.136:0/288765401 >> 172.21.15.136:0/288765401 conn(0x7fce4c06fe80 msgr2=0x7fce4c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:39.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 -- 172.21.15.136:0/288765401 shutdown_connections 2024-02-17T12:58:39.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.714+0000 7fce54343640 1 -- 172.21.15.136:0/288765401 wait complete. 2024-02-17T12:58:39.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 Processor -- start 2024-02-17T12:58:39.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 -- start start 2024-02-17T12:58:39.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c4340 0x7fce4c1f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce4c0c7e30 0x7fce4c14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 0x7fce4c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1f0e10 con 0x7fce4c157430 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c14ce10 con 0x7fce4c0c7e30 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.715+0000 7fce54343640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1e42c0 con 0x7fce4c0c4340 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.716+0000 7fce528e0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 0x7fce4c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.716+0000 7fce528e0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 0x7fce4c15c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50554/0 (socket says 172.21.15.136:50554) 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.716+0000 7fce528e0640 1 -- 172.21.15.136:0/703839994 learned_addr learned my addr 172.21.15.136:0/703839994 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.716+0000 7fce520df640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c4340 0x7fce4c1f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.716+0000 7fce518de640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce4c0c7e30 0x7fce4c14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.719+0000 7fce528e0640 1 -- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c4340 msgr2=0x7fce4c1f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.719+0000 7fce528e0640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c4340 0x7fce4c1f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.719+0000 7fce528e0640 1 -- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce4c0c7e30 msgr2=0x7fce4c14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:39.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.719+0000 7fce528e0640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce4c0c7e30 0x7fce4c14fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:39.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.719+0000 7fce528e0640 1 -- 172.21.15.136:0/703839994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44009a70 con 0x7fce4c157430 2024-02-17T12:58:39.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.722+0000 7fce528e0640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 0x7fce4c15c950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fce44009d90 tx=0x7fce44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:39.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.725+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44040650 con 0x7fce4c157430 2024-02-17T12:58:39.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.725+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440407b0 con 0x7fce4c157430 2024-02-17T12:58:39.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.725+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c14c8d0 con 0x7fce4c157430 2024-02-17T12:58:39.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.725+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44040b60 con 0x7fce4c157430 2024-02-17T12:58:39.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.725+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c1e36b0 con 0x7fce4c157430 2024-02-17T12:58:39.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.726+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c06c340 con 0x7fce4c157430 2024-02-17T12:58:39.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.970+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fce44040cc0 con 0x7fce4c157430 2024-02-17T12:58:39.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.970+0000 7fce42ffd640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fce3006b860 0x7fce3006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:39.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.970+0000 7fce520df640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fce3006b860 0x7fce3006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:39.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:39.970+0000 7fce520df640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fce3006b860 0x7fce3006dd20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009aa0 tx=0x7fce3c009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:39.991 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.001+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fce4407bda0 con 0x7fce4c157430 2024-02-17T12:58:39.991 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.001+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce44078040 con 0x7fce4c157430 2024-02-17T12:58:40.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.180+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce4c0ca900 con 0x7fce3006b860 2024-02-17T12:58:40.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.188+0000 7fce42ffd640 1 -- 172.21.15.136:0/703839994 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345323 (secure 0 0 0) 0x7fce3c011a00 con 0x7fce3006b860 2024-02-17T12:58:40.183 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:40.185 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:40.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fce3006b860 msgr2=0x7fce3006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fce3006b860 0x7fce3006dd20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009aa0 tx=0x7fce3c009190 comp rx=0 tx=0).stop 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 msgr2=0x7fce4c15c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 0x7fce4c15c950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fce44009d90 tx=0x7fce44004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 shutdown_connections 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fce3006b860 0x7fce3006dd20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce4c157430 0x7fce4c15c950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce4c0c7e30 0x7fce4c14fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 --2- 172.21.15.136:0/703839994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce4c0c4340 0x7fce4c1f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 >> 172.21.15.136:0/703839994 conn(0x7fce4c06fe80 msgr2=0x7fce4c153180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 shutdown_connections 2024-02-17T12:58:40.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.191+0000 7fce54343640 1 -- 172.21.15.136:0/703839994 wait complete. 2024-02-17T12:58:40.193 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-02-17T12:58:39.991730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600542,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":360,"num_write_kb":2482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":3579904,"data_stored":2071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5444,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002153"},"pg_stats":[{"pgid":"2.1f","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447797+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:35.447797+0000","last_peered":"2024-02-17T12:58:35.447797+0000","last_clean":"2024-02-17T12:58:35.447797+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:35.447797+0000","last_undegraded":"2024-02-17T12:58:35.447797+0000","last_fullsized":"2024-02-17T12:58:35.447797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449786+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:35.449786+0000","last_peered":"2024-02-17T12:58:35.449786+0000","last_clean":"2024-02-17T12:58:35.449786+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:35.449786+0000","last_undegraded":"2024-02-17T12:58:35.449786+0000","last_fullsized":"2024-02-17T12:58:35.449786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252135+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:37.252135+0000","last_peered":"2024-02-17T12:58:37.252135+0000","last_clean":"2024-02-17T12:58:37.252135+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:37.252135+0000","last_undegraded":"2024-02-17T12:58:37.252135+0000","last_fullsized":"2024-02-17T12:58:37.252135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449995+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:35.449995+0000","last_peered":"2024-02-17T12:58:35.449995+0000","last_clean":"2024-02-17T12:58:35.449995+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:35.449995+0000","last_undegraded":"2024-02-17T12:58:35.449995+0000","last_fullsized":"2024-02-17T12:58:35.449995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450004+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:35.450004+0000","last_peered":"2024-02-17T12:58:35.450004+0000","last_clean":"2024-02-17T12:58:35.450004+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:35.450004+0000","last_undegraded":"2024-02-17T12:58:35.450004+0000","last_fullsized":"2024-02-17T12:58:35.450004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250259+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:37.250259+0000","last_peered":"2024-02-17T12:58:37.250259+0000","last_clean":"2024-02-17T12:58:37.250259+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:37.250259+0000","last_undegraded":"2024-02-17T12:58:37.250259+0000","last_fullsized":"2024-02-17T12:58:37.250259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363936+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:37.363936+0000","last_peered":"2024-02-17T12:58:37.363936+0000","last_clean":"2024-02-17T12:58:37.363936+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:37.363936+0000","last_undegraded":"2024-02-17T12:58:37.363936+0000","last_fullsized":"2024-02-17T12:58:37.363936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454386+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:35.454386+0000","last_peered":"2024-02-17T12:58:35.454386+0000","last_clean":"2024-02-17T12:58:35.454386+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:35.454386+0000","last_undegraded":"2024-02-17T12:58:35.454386+0000","last_fullsized":"2024-02-17T12:58:35.454386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.324543+0000","last_change":"2024-02-17T12:58:37.250456+0000","last_active":"2024-02-17T12:58:35.446593+0000","last_peered":"2024-02-17T12:58:03.437264+0000","last_clean":"2024-02-17T12:58:03.437264+0000","last_became_active":"2024-02-17T12:58:02.529672+0000","last_became_peered":"2024-02-17T12:58:02.529672+0000","last_unstale":"2024-02-17T12:58:37.324543+0000","last_undegraded":"2024-02-17T12:58:37.324543+0000","last_fullsized":"2024-02-17T12:58:37.324543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":["2(0)","0(2)","3(2)","5(1)","6(3)"],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364065+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:37.364065+0000","last_peered":"2024-02-17T12:58:37.364065+0000","last_clean":"2024-02-17T12:58:37.364065+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:37.364065+0000","last_undegraded":"2024-02-17T12:58:37.364065+0000","last_fullsized":"2024-02-17T12:58:37.364065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248354+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:37.248354+0000","last_peered":"2024-02-17T12:58:37.248354+0000","last_clean":"2024-02-17T12:58:37.248354+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:37.248354+0000","last_undegraded":"2024-02-17T12:58:37.248354+0000","last_fullsized":"2024-02-17T12:58:37.248354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251301+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:37.251301+0000","last_peered":"2024-02-17T12:58:37.251301+0000","last_clean":"2024-02-17T12:58:37.251301+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:37.251301+0000","last_undegraded":"2024-02-17T12:58:37.251301+0000","last_fullsized":"2024-02-17T12:58:37.251301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248286+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:37.248286+0000","last_peered":"2024-02-17T12:58:37.248286+0000","last_clean":"2024-02-17T12:58:37.248286+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:37.248286+0000","last_undegraded":"2024-02-17T12:58:37.248286+0000","last_fullsized":"2024-02-17T12:58:37.248286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248415+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:37.248415+0000","last_peered":"2024-02-17T12:58:37.248415+0000","last_clean":"2024-02-17T12:58:37.248415+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:37.248415+0000","last_undegraded":"2024-02-17T12:58:37.248415+0000","last_fullsized":"2024-02-17T12:58:37.248415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248122+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:37.248122+0000","last_peered":"2024-02-17T12:58:37.248122+0000","last_clean":"2024-02-17T12:58:37.248122+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:37.248122+0000","last_undegraded":"2024-02-17T12:58:37.248122+0000","last_fullsized":"2024-02-17T12:58:37.248122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251582+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:37.251582+0000","last_peered":"2024-02-17T12:58:37.251582+0000","last_clean":"2024-02-17T12:58:37.251582+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:37.251582+0000","last_undegraded":"2024-02-17T12:58:37.251582+0000","last_fullsized":"2024-02-17T12:58:37.251582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324439+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:37.324439+0000","last_peered":"2024-02-17T12:58:37.324439+0000","last_clean":"2024-02-17T12:58:37.324439+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:37.324439+0000","last_undegraded":"2024-02-17T12:58:37.324439+0000","last_fullsized":"2024-02-17T12:58:37.324439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363560+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:37.363560+0000","last_peered":"2024-02-17T12:58:37.363560+0000","last_clean":"2024-02-17T12:58:37.363560+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:37.363560+0000","last_undegraded":"2024-02-17T12:58:37.363560+0000","last_fullsized":"2024-02-17T12:58:37.363560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446619+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:35.446619+0000","last_peered":"2024-02-17T12:58:35.446619+0000","last_clean":"2024-02-17T12:58:35.446619+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:35.446619+0000","last_undegraded":"2024-02-17T12:58:35.446619+0000","last_fullsized":"2024-02-17T12:58:35.446619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447017+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:35.447017+0000","last_peered":"2024-02-17T12:58:35.447017+0000","last_clean":"2024-02-17T12:58:35.447017+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:35.447017+0000","last_undegraded":"2024-02-17T12:58:35.447017+0000","last_fullsized":"2024-02-17T12:58:35.447017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252567+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:37.252567+0000","last_peered":"2024-02-17T12:58:37.252567+0000","last_clean":"2024-02-17T12:58:37.252567+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:37.252567+0000","last_undegraded":"2024-02-17T12:58:37.252567+0000","last_fullsized":"2024-02-17T12:58:37.252567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247975+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:37.247975+0000","last_peered":"2024-02-17T12:58:37.247975+0000","last_clean":"2024-02-17T12:58:37.247975+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:37.247975+0000","last_undegraded":"2024-02-17T12:58:37.247975+0000","last_fullsized":"2024-02-17T12:58:37.247975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363471+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:37.363471+0000","last_peered":"2024-02-17T12:58:37.363471+0000","last_clean":"2024-02-17T12:58:37.363471+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:37.363471+0000","last_undegraded":"2024-02-17T12:58:37.363471+0000","last_fullsized":"2024-02-17T12:58:37.363471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251135+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:37.251135+0000","last_peered":"2024-02-17T12:58:37.251135+0000","last_clean":"2024-02-17T12:58:37.251135+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:37.251135+0000","last_undegraded":"2024-02-17T12:58:37.251135+0000","last_fullsized":"2024-02-17T12:58:37.251135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447387+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:35.447387+0000","last_peered":"2024-02-17T12:58:35.447387+0000","last_clean":"2024-02-17T12:58:35.447387+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:35.447387+0000","last_undegraded":"2024-02-17T12:58:35.447387+0000","last_fullsized":"2024-02-17T12:58:35.447387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248929+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:37.248929+0000","last_peered":"2024-02-17T12:58:37.248929+0000","last_clean":"2024-02-17T12:58:37.248929+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:37.248929+0000","last_undegraded":"2024-02-17T12:58:37.248929+0000","last_fullsized":"2024-02-17T12:58:37.248929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250402+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:37.250402+0000","last_peered":"2024-02-17T12:58:37.250402+0000","last_clean":"2024-02-17T12:58:37.250402+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:37.250402+0000","last_undegraded":"2024-02-17T12:58:37.250402+0000","last_fullsized":"2024-02-17T12:58:37.250402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447772+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:35.447772+0000","last_peered":"2024-02-17T12:58:35.447772+0000","last_clean":"2024-02-17T12:58:35.447772+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:35.447772+0000","last_undegraded":"2024-02-17T12:58:35.447772+0000","last_fullsized":"2024-02-17T12:58:35.447772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447557+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:35.447557+0000","last_peered":"2024-02-17T12:58:35.447557+0000","last_clean":"2024-02-17T12:58:35.447557+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:35.447557+0000","last_undegraded":"2024-02-17T12:58:35.447557+0000","last_fullsized":"2024-02-17T12:58:35.447557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446610+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:35.446610+0000","last_peered":"2024-02-17T12:58:35.446610+0000","last_clean":"2024-02-17T12:58:35.446610+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:35.446610+0000","last_undegraded":"2024-02-17T12:58:35.446610+0000","last_fullsized":"2024-02-17T12:58:35.446610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324493+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:37.324493+0000","last_peered":"2024-02-17T12:58:37.324493+0000","last_clean":"2024-02-17T12:58:37.324493+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:37.324493+0000","last_undegraded":"2024-02-17T12:58:37.324493+0000","last_fullsized":"2024-02-17T12:58:37.324493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248623+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:37.248623+0000","last_peered":"2024-02-17T12:58:37.248623+0000","last_clean":"2024-02-17T12:58:37.248623+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:37.248623+0000","last_undegraded":"2024-02-17T12:58:37.248623+0000","last_fullsized":"2024-02-17T12:58:37.248623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324212+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:37.324212+0000","last_peered":"2024-02-17T12:58:37.324212+0000","last_clean":"2024-02-17T12:58:37.324212+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:37.324212+0000","last_undegraded":"2024-02-17T12:58:37.324212+0000","last_fullsized":"2024-02-17T12:58:37.324212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250988+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:37.250988+0000","last_peered":"2024-02-17T12:58:37.250988+0000","last_clean":"2024-02-17T12:58:37.250988+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:37.250988+0000","last_undegraded":"2024-02-17T12:58:37.250988+0000","last_fullsized":"2024-02-17T12:58:37.250988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450301+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:35.450301+0000","last_peered":"2024-02-17T12:58:35.450301+0000","last_clean":"2024-02-17T12:58:35.450301+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:35.450301+0000","last_undegraded":"2024-02-17T12:58:35.450301+0000","last_fullsized":"2024-02-17T12:58:35.450301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324026+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:37.324026+0000","last_peered":"2024-02-17T12:58:37.324026+0000","last_clean":"2024-02-17T12:58:37.324026+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:37.324026+0000","last_undegraded":"2024-02-17T12:58:37.324026+0000","last_fullsized":"2024-02-17T12:58:37.324026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363882+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:37.363882+0000","last_peered":"2024-02-17T12:58:37.363882+0000","last_clean":"2024-02-17T12:58:37.363882+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:37.363882+0000","last_undegraded":"2024-02-17T12:58:37.363882+0000","last_fullsized":"2024-02-17T12:58:37.363882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248625+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:37.248625+0000","last_peered":"2024-02-17T12:58:37.248625+0000","last_clean":"2024-02-17T12:58:37.248625+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:37.248625+0000","last_undegraded":"2024-02-17T12:58:37.248625+0000","last_fullsized":"2024-02-17T12:58:37.248625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324381+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:37.324381+0000","last_peered":"2024-02-17T12:58:37.324381+0000","last_clean":"2024-02-17T12:58:37.324381+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:37.324381+0000","last_undegraded":"2024-02-17T12:58:37.324381+0000","last_fullsized":"2024-02-17T12:58:37.324381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449065+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:35.449065+0000","last_peered":"2024-02-17T12:58:35.449065+0000","last_clean":"2024-02-17T12:58:35.449065+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:35.449065+0000","last_undegraded":"2024-02-17T12:58:35.449065+0000","last_fullsized":"2024-02-17T12:58:35.449065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251333+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:37.251333+0000","last_peered":"2024-02-17T12:58:37.251333+0000","last_clean":"2024-02-17T12:58:37.251333+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:37.251333+0000","last_undegraded":"2024-02-17T12:58:37.251333+0000","last_fullsized":"2024-02-17T12:58:37.251333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324268+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:37.324268+0000","last_peered":"2024-02-17T12:58:37.324268+0000","last_clean":"2024-02-17T12:58:37.324268+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:37.324268+0000","last_undegraded":"2024-02-17T12:58:37.324268+0000","last_fullsized":"2024-02-17T12:58:37.324268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.323981+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:37.323981+0000","last_peered":"2024-02-17T12:58:37.323981+0000","last_clean":"2024-02-17T12:58:37.323981+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:37.323981+0000","last_undegraded":"2024-02-17T12:58:37.323981+0000","last_fullsized":"2024-02-17T12:58:37.323981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247892+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:37.247892+0000","last_peered":"2024-02-17T12:58:37.247892+0000","last_clean":"2024-02-17T12:58:37.247892+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:37.247892+0000","last_undegraded":"2024-02-17T12:58:37.247892+0000","last_fullsized":"2024-02-17T12:58:37.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449414+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:35.449414+0000","last_peered":"2024-02-17T12:58:35.449414+0000","last_clean":"2024-02-17T12:58:35.449414+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:35.449414+0000","last_undegraded":"2024-02-17T12:58:35.449414+0000","last_fullsized":"2024-02-17T12:58:35.449414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446932+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:35.446932+0000","last_peered":"2024-02-17T12:58:35.446932+0000","last_clean":"2024-02-17T12:58:35.446932+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:35.446932+0000","last_undegraded":"2024-02-17T12:58:35.446932+0000","last_fullsized":"2024-02-17T12:58:35.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453996+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:35.453996+0000","last_peered":"2024-02-17T12:58:35.453996+0000","last_clean":"2024-02-17T12:58:35.453996+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:35.453996+0000","last_undegraded":"2024-02-17T12:58:35.453996+0000","last_fullsized":"2024-02-17T12:58:35.453996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324559+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:37.324559+0000","last_peered":"2024-02-17T12:58:37.324559+0000","last_clean":"2024-02-17T12:58:37.324559+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:37.324559+0000","last_undegraded":"2024-02-17T12:58:37.324559+0000","last_fullsized":"2024-02-17T12:58:37.324559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250612+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:37.250612+0000","last_peered":"2024-02-17T12:58:37.250612+0000","last_clean":"2024-02-17T12:58:37.250612+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:37.250612+0000","last_undegraded":"2024-02-17T12:58:37.250612+0000","last_fullsized":"2024-02-17T12:58:37.250612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363999+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:37.363999+0000","last_peered":"2024-02-17T12:58:37.363999+0000","last_clean":"2024-02-17T12:58:37.363999+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:37.363999+0000","last_undegraded":"2024-02-17T12:58:37.363999+0000","last_fullsized":"2024-02-17T12:58:37.363999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450641+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:35.450641+0000","last_peered":"2024-02-17T12:58:35.450641+0000","last_clean":"2024-02-17T12:58:35.450641+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:35.450641+0000","last_undegraded":"2024-02-17T12:58:35.450641+0000","last_fullsized":"2024-02-17T12:58:35.450641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449570+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:35.449570+0000","last_peered":"2024-02-17T12:58:35.449570+0000","last_clean":"2024-02-17T12:58:35.449570+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:35.449570+0000","last_undegraded":"2024-02-17T12:58:35.449570+0000","last_fullsized":"2024-02-17T12:58:35.449570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363983+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:37.363983+0000","last_peered":"2024-02-17T12:58:37.363983+0000","last_clean":"2024-02-17T12:58:37.363983+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:37.363983+0000","last_undegraded":"2024-02-17T12:58:37.363983+0000","last_fullsized":"2024-02-17T12:58:37.363983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447469+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:35.447469+0000","last_peered":"2024-02-17T12:58:35.447469+0000","last_clean":"2024-02-17T12:58:35.447469+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:35.447469+0000","last_undegraded":"2024-02-17T12:58:35.447469+0000","last_fullsized":"2024-02-17T12:58:35.447469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247666+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:37.247666+0000","last_peered":"2024-02-17T12:58:37.247666+0000","last_clean":"2024-02-17T12:58:37.247666+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:37.247666+0000","last_undegraded":"2024-02-17T12:58:37.247666+0000","last_fullsized":"2024-02-17T12:58:37.247666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251231+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:37.251231+0000","last_peered":"2024-02-17T12:58:37.251231+0000","last_clean":"2024-02-17T12:58:37.251231+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:37.251231+0000","last_undegraded":"2024-02-17T12:58:37.251231+0000","last_fullsized":"2024-02-17T12:58:37.251231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364174+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:37.364174+0000","last_peered":"2024-02-17T12:58:37.364174+0000","last_clean":"2024-02-17T12:58:37.364174+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:37.364174+0000","last_undegraded":"2024-02-17T12:58:37.364174+0000","last_fullsized":"2024-02-17T12:58:37.364174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453399+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:35.453399+0000","last_peered":"2024-02-17T12:58:35.453399+0000","last_clean":"2024-02-17T12:58:35.453399+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:35.453399+0000","last_undegraded":"2024-02-17T12:58:35.453399+0000","last_fullsized":"2024-02-17T12:58:35.453399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247880+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:37.247880+0000","last_peered":"2024-02-17T12:58:37.247880+0000","last_clean":"2024-02-17T12:58:37.247880+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:37.247880+0000","last_undegraded":"2024-02-17T12:58:37.247880+0000","last_fullsized":"2024-02-17T12:58:37.247880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'16","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446726+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:35.446726+0000","last_peered":"2024-02-17T12:58:35.446726+0000","last_clean":"2024-02-17T12:58:35.446726+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:35.446726+0000","last_undegraded":"2024-02-17T12:58:35.446726+0000","last_fullsized":"2024-02-17T12:58:35.446726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449691+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:35.449691+0000","last_peered":"2024-02-17T12:58:35.449691+0000","last_clean":"2024-02-17T12:58:35.449691+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:35.449691+0000","last_undegraded":"2024-02-17T12:58:35.449691+0000","last_fullsized":"2024-02-17T12:58:35.449691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453774+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:35.453774+0000","last_peered":"2024-02-17T12:58:35.453774+0000","last_clean":"2024-02-17T12:58:35.453774+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:35.453774+0000","last_undegraded":"2024-02-17T12:58:35.453774+0000","last_fullsized":"2024-02-17T12:58:35.453774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363771+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:37.363771+0000","last_peered":"2024-02-17T12:58:37.363771+0000","last_clean":"2024-02-17T12:58:37.363771+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:37.363771+0000","last_undegraded":"2024-02-17T12:58:37.363771+0000","last_fullsized":"2024-02-17T12:58:37.363771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449906+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:35.449906+0000","last_peered":"2024-02-17T12:58:35.449906+0000","last_clean":"2024-02-17T12:58:35.449906+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:35.449906+0000","last_undegraded":"2024-02-17T12:58:35.449906+0000","last_fullsized":"2024-02-17T12:58:35.449906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248256+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:37.248256+0000","last_peered":"2024-02-17T12:58:37.248256+0000","last_clean":"2024-02-17T12:58:37.248256+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:37.248256+0000","last_undegraded":"2024-02-17T12:58:37.248256+0000","last_fullsized":"2024-02-17T12:58:37.248256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248528+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:37.248528+0000","last_peered":"2024-02-17T12:58:37.248528+0000","last_clean":"2024-02-17T12:58:37.248528+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:37.248528+0000","last_undegraded":"2024-02-17T12:58:37.248528+0000","last_fullsized":"2024-02-17T12:58:37.248528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324198+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:37.324198+0000","last_peered":"2024-02-17T12:58:37.324198+0000","last_clean":"2024-02-17T12:58:37.324198+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:37.324198+0000","last_undegraded":"2024-02-17T12:58:37.324198+0000","last_fullsized":"2024-02-17T12:58:37.324198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324160+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:37.324160+0000","last_peered":"2024-02-17T12:58:37.324160+0000","last_clean":"2024-02-17T12:58:37.324160+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:37.324160+0000","last_undegraded":"2024-02-17T12:58:37.324160+0000","last_fullsized":"2024-02-17T12:58:37.324160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251902+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:37.251902+0000","last_peered":"2024-02-17T12:58:37.251902+0000","last_clean":"2024-02-17T12:58:37.251902+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:37.251902+0000","last_undegraded":"2024-02-17T12:58:37.251902+0000","last_fullsized":"2024-02-17T12:58:37.251902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248263+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:37.248263+0000","last_peered":"2024-02-17T12:58:37.248263+0000","last_clean":"2024-02-17T12:58:37.248263+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:37.248263+0000","last_undegraded":"2024-02-17T12:58:37.248263+0000","last_fullsized":"2024-02-17T12:58:37.248263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363833+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:37.363833+0000","last_peered":"2024-02-17T12:58:37.363833+0000","last_clean":"2024-02-17T12:58:37.363833+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:37.363833+0000","last_undegraded":"2024-02-17T12:58:37.363833+0000","last_fullsized":"2024-02-17T12:58:37.363833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250807+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:37.250807+0000","last_peered":"2024-02-17T12:58:37.250807+0000","last_clean":"2024-02-17T12:58:37.250807+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:37.250807+0000","last_undegraded":"2024-02-17T12:58:37.250807+0000","last_fullsized":"2024-02-17T12:58:37.250807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446826+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:35.446826+0000","last_peered":"2024-02-17T12:58:35.446826+0000","last_clean":"2024-02-17T12:58:35.446826+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:35.446826+0000","last_undegraded":"2024-02-17T12:58:35.446826+0000","last_fullsized":"2024-02-17T12:58:35.446826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248015+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:37.248015+0000","last_peered":"2024-02-17T12:58:37.248015+0000","last_clean":"2024-02-17T12:58:37.248015+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:37.248015+0000","last_undegraded":"2024-02-17T12:58:37.248015+0000","last_fullsized":"2024-02-17T12:58:37.248015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252276+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:37.252276+0000","last_peered":"2024-02-17T12:58:37.252276+0000","last_clean":"2024-02-17T12:58:37.252276+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:37.252276+0000","last_undegraded":"2024-02-17T12:58:37.252276+0000","last_fullsized":"2024-02-17T12:58:37.252276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250675+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:37.250675+0000","last_peered":"2024-02-17T12:58:37.250675+0000","last_clean":"2024-02-17T12:58:37.250675+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:37.250675+0000","last_undegraded":"2024-02-17T12:58:37.250675+0000","last_fullsized":"2024-02-17T12:58:37.250675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450071+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.450071+0000","last_peered":"2024-02-17T12:58:35.450071+0000","last_clean":"2024-02-17T12:58:35.450071+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:35.450071+0000","last_undegraded":"2024-02-17T12:58:35.450071+0000","last_fullsized":"2024-02-17T12:58:35.450071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364124+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:37.364124+0000","last_peered":"2024-02-17T12:58:37.364124+0000","last_clean":"2024-02-17T12:58:37.364124+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:37.364124+0000","last_undegraded":"2024-02-17T12:58:37.364124+0000","last_fullsized":"2024-02-17T12:58:37.364124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251083+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:37.251083+0000","last_peered":"2024-02-17T12:58:37.251083+0000","last_clean":"2024-02-17T12:58:37.251083+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:37.251083+0000","last_undegraded":"2024-02-17T12:58:37.251083+0000","last_fullsized":"2024-02-17T12:58:37.251083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251217+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:37.251217+0000","last_peered":"2024-02-17T12:58:37.251217+0000","last_clean":"2024-02-17T12:58:37.251217+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:37.251217+0000","last_undegraded":"2024-02-17T12:58:37.251217+0000","last_fullsized":"2024-02-17T12:58:37.251217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454832+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:35.454832+0000","last_peered":"2024-02-17T12:58:35.454832+0000","last_clean":"2024-02-17T12:58:35.454832+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:35.454832+0000","last_undegraded":"2024-02-17T12:58:35.454832+0000","last_fullsized":"2024-02-17T12:58:35.454832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446907+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:35.446907+0000","last_peered":"2024-02-17T12:58:35.446907+0000","last_clean":"2024-02-17T12:58:35.446907+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:35.446907+0000","last_undegraded":"2024-02-17T12:58:35.446907+0000","last_fullsized":"2024-02-17T12:58:35.446907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447300+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:35.447300+0000","last_peered":"2024-02-17T12:58:35.447300+0000","last_clean":"2024-02-17T12:58:35.447300+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:35.447300+0000","last_undegraded":"2024-02-17T12:58:35.447300+0000","last_fullsized":"2024-02-17T12:58:35.447300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446948+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:35.446948+0000","last_peered":"2024-02-17T12:58:35.446948+0000","last_clean":"2024-02-17T12:58:35.446948+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:35.446948+0000","last_undegraded":"2024-02-17T12:58:35.446948+0000","last_fullsized":"2024-02-17T12:58:35.446948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247856+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:37.247856+0000","last_peered":"2024-02-17T12:58:37.247856+0000","last_clean":"2024-02-17T12:58:37.247856+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:37.247856+0000","last_undegraded":"2024-02-17T12:58:37.247856+0000","last_fullsized":"2024-02-17T12:58:37.247856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248706+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:37.248706+0000","last_peered":"2024-02-17T12:58:37.248706+0000","last_clean":"2024-02-17T12:58:37.248706+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:37.248706+0000","last_undegraded":"2024-02-17T12:58:37.248706+0000","last_fullsized":"2024-02-17T12:58:37.248706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449178+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:35.449178+0000","last_peered":"2024-02-17T12:58:35.449178+0000","last_clean":"2024-02-17T12:58:35.449178+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:35.449178+0000","last_undegraded":"2024-02-17T12:58:35.449178+0000","last_fullsized":"2024-02-17T12:58:35.449178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324017+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:37.324017+0000","last_peered":"2024-02-17T12:58:37.324017+0000","last_clean":"2024-02-17T12:58:37.324017+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:37.324017+0000","last_undegraded":"2024-02-17T12:58:37.324017+0000","last_fullsized":"2024-02-17T12:58:37.324017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447093+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:35.447093+0000","last_peered":"2024-02-17T12:58:35.447093+0000","last_clean":"2024-02-17T12:58:35.447093+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:35.447093+0000","last_undegraded":"2024-02-17T12:58:35.447093+0000","last_fullsized":"2024-02-17T12:58:35.447093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447152+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:35.447152+0000","last_peered":"2024-02-17T12:58:35.447152+0000","last_clean":"2024-02-17T12:58:35.447152+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:35.447152+0000","last_undegraded":"2024-02-17T12:58:35.447152+0000","last_fullsized":"2024-02-17T12:58:35.447152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449679+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:35.449679+0000","last_peered":"2024-02-17T12:58:35.449679+0000","last_clean":"2024-02-17T12:58:35.449679+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:35.449679+0000","last_undegraded":"2024-02-17T12:58:35.449679+0000","last_fullsized":"2024-02-17T12:58:35.449679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454124+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:35.454124+0000","last_peered":"2024-02-17T12:58:35.454124+0000","last_clean":"2024-02-17T12:58:35.454124+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:35.454124+0000","last_undegraded":"2024-02-17T12:58:35.454124+0000","last_fullsized":"2024-02-17T12:58:35.454124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":5,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.250879+0000","last_change":"2024-02-17T12:58:37.250879+0000","last_active":"2024-02-17T12:58:01.234263+0000","last_peered":"2024-02-17T12:58:01.234263+0000","last_clean":"2024-02-17T12:58:01.234263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:58:37.250879+0000","last_undegraded":"2024-02-17T12:58:37.250879+0000","last_fullsized":"2024-02-17T12:58:37.250879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":["2(0)","0(3)","1(2)","5(1)","7(0)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250452+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:37.250452+0000","last_peered":"2024-02-17T12:58:37.250452+0000","last_clean":"2024-02-17T12:58:37.250452+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:37.250452+0000","last_undegraded":"2024-02-17T12:58:37.250452+0000","last_fullsized":"2024-02-17T12:58:37.250452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251224+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:37.251224+0000","last_peered":"2024-02-17T12:58:37.251224+0000","last_clean":"2024-02-17T12:58:37.251224+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:37.251224+0000","last_undegraded":"2024-02-17T12:58:37.251224+0000","last_fullsized":"2024-02-17T12:58:37.251224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248199+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:37.248199+0000","last_peered":"2024-02-17T12:58:37.248199+0000","last_clean":"2024-02-17T12:58:37.248199+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:37.248199+0000","last_undegraded":"2024-02-17T12:58:37.248199+0000","last_fullsized":"2024-02-17T12:58:37.248199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449596+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:35.449596+0000","last_peered":"2024-02-17T12:58:35.449596+0000","last_clean":"2024-02-17T12:58:35.449596+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:35.449596+0000","last_undegraded":"2024-02-17T12:58:35.449596+0000","last_fullsized":"2024-02-17T12:58:35.449596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324471+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:37.324471+0000","last_peered":"2024-02-17T12:58:37.324471+0000","last_clean":"2024-02-17T12:58:37.324471+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:37.324471+0000","last_undegraded":"2024-02-17T12:58:37.324471+0000","last_fullsized":"2024-02-17T12:58:37.324471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324153+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:37.324153+0000","last_peered":"2024-02-17T12:58:37.324153+0000","last_clean":"2024-02-17T12:58:37.324153+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:37.324153+0000","last_undegraded":"2024-02-17T12:58:37.324153+0000","last_fullsized":"2024-02-17T12:58:37.324153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251155+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:37.251155+0000","last_peered":"2024-02-17T12:58:37.251155+0000","last_clean":"2024-02-17T12:58:37.251155+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:37.251155+0000","last_undegraded":"2024-02-17T12:58:37.251155+0000","last_fullsized":"2024-02-17T12:58:37.251155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449798+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.449798+0000","last_peered":"2024-02-17T12:58:35.449798+0000","last_clean":"2024-02-17T12:58:35.449798+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:35.449798+0000","last_undegraded":"2024-02-17T12:58:35.449798+0000","last_fullsized":"2024-02-17T12:58:35.449798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247786+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:37.247786+0000","last_peered":"2024-02-17T12:58:37.247786+0000","last_clean":"2024-02-17T12:58:37.247786+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:37.247786+0000","last_undegraded":"2024-02-17T12:58:37.247786+0000","last_fullsized":"2024-02-17T12:58:37.247786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449437+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:35.449437+0000","last_peered":"2024-02-17T12:58:35.449437+0000","last_clean":"2024-02-17T12:58:35.449437+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:35.449437+0000","last_undegraded":"2024-02-17T12:58:35.449437+0000","last_fullsized":"2024-02-17T12:58:35.449437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453645+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:35.453645+0000","last_peered":"2024-02-17T12:58:35.453645+0000","last_clean":"2024-02-17T12:58:35.453645+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:35.453645+0000","last_undegraded":"2024-02-17T12:58:35.453645+0000","last_fullsized":"2024-02-17T12:58:35.453645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446907+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:35.446907+0000","last_peered":"2024-02-17T12:58:35.446907+0000","last_clean":"2024-02-17T12:58:35.446907+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:35.446907+0000","last_undegraded":"2024-02-17T12:58:35.446907+0000","last_fullsized":"2024-02-17T12:58:35.446907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.741377+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T12:58:37.741377+0000","last_peered":"2024-02-17T12:58:37.741377+0000","last_clean":"2024-02-17T12:58:37.741377+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T12:58:37.741377+0000","last_undegraded":"2024-02-17T12:58:37.741377+0000","last_fullsized":"2024-02-17T12:58:37.741377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248600+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:37.248600+0000","last_peered":"2024-02-17T12:58:37.248600+0000","last_clean":"2024-02-17T12:58:37.248600+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:37.248600+0000","last_undegraded":"2024-02-17T12:58:37.248600+0000","last_fullsized":"2024-02-17T12:58:37.248600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252206+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:37.252206+0000","last_peered":"2024-02-17T12:58:37.252206+0000","last_clean":"2024-02-17T12:58:37.252206+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:37.252206+0000","last_undegraded":"2024-02-17T12:58:37.252206+0000","last_fullsized":"2024-02-17T12:58:37.252206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248852+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:37.248852+0000","last_peered":"2024-02-17T12:58:37.248852+0000","last_clean":"2024-02-17T12:58:37.248852+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:37.248852+0000","last_undegraded":"2024-02-17T12:58:37.248852+0000","last_fullsized":"2024-02-17T12:58:37.248852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247763+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:37.247763+0000","last_peered":"2024-02-17T12:58:37.247763+0000","last_clean":"2024-02-17T12:58:37.247763+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:37.247763+0000","last_undegraded":"2024-02-17T12:58:37.247763+0000","last_fullsized":"2024-02-17T12:58:37.247763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449274+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:35.449274+0000","last_peered":"2024-02-17T12:58:35.449274+0000","last_clean":"2024-02-17T12:58:35.449274+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:35.449274+0000","last_undegraded":"2024-02-17T12:58:35.449274+0000","last_fullsized":"2024-02-17T12:58:35.449274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324058+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:37.324058+0000","last_peered":"2024-02-17T12:58:37.324058+0000","last_clean":"2024-02-17T12:58:37.324058+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:37.324058+0000","last_undegraded":"2024-02-17T12:58:37.324058+0000","last_fullsized":"2024-02-17T12:58:37.324058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324329+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:37.324329+0000","last_peered":"2024-02-17T12:58:37.324329+0000","last_clean":"2024-02-17T12:58:37.324329+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:37.324329+0000","last_undegraded":"2024-02-17T12:58:37.324329+0000","last_fullsized":"2024-02-17T12:58:37.324329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363917+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:37.363917+0000","last_peered":"2024-02-17T12:58:37.363917+0000","last_clean":"2024-02-17T12:58:37.363917+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:37.363917+0000","last_undegraded":"2024-02-17T12:58:37.363917+0000","last_fullsized":"2024-02-17T12:58:37.363917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363804+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:37.363804+0000","last_peered":"2024-02-17T12:58:37.363804+0000","last_clean":"2024-02-17T12:58:37.363804+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:37.363804+0000","last_undegraded":"2024-02-17T12:58:37.363804+0000","last_fullsized":"2024-02-17T12:58:37.363804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363645+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:37.363645+0000","last_peered":"2024-02-17T12:58:37.363645+0000","last_clean":"2024-02-17T12:58:37.363645+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:37.363645+0000","last_undegraded":"2024-02-17T12:58:37.363645+0000","last_fullsized":"2024-02-17T12:58:37.363645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454803+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:35.454803+0000","last_peered":"2024-02-17T12:58:35.454803+0000","last_clean":"2024-02-17T12:58:35.454803+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:35.454803+0000","last_undegraded":"2024-02-17T12:58:35.454803+0000","last_fullsized":"2024-02-17T12:58:35.454803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449023+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:35.449023+0000","last_peered":"2024-02-17T12:58:35.449023+0000","last_clean":"2024-02-17T12:58:35.449023+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:35.449023+0000","last_undegraded":"2024-02-17T12:58:35.449023+0000","last_fullsized":"2024-02-17T12:58:35.449023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363643+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:37.363643+0000","last_peered":"2024-02-17T12:58:37.363643+0000","last_clean":"2024-02-17T12:58:37.363643+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:37.363643+0000","last_undegraded":"2024-02-17T12:58:37.363643+0000","last_fullsized":"2024-02-17T12:58:37.363643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251191+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:37.251191+0000","last_peered":"2024-02-17T12:58:37.251191+0000","last_clean":"2024-02-17T12:58:37.251191+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:37.251191+0000","last_undegraded":"2024-02-17T12:58:37.251191+0000","last_fullsized":"2024-02-17T12:58:37.251191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363883+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:37.363883+0000","last_peered":"2024-02-17T12:58:37.363883+0000","last_clean":"2024-02-17T12:58:37.363883+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:37.363883+0000","last_undegraded":"2024-02-17T12:58:37.363883+0000","last_fullsized":"2024-02-17T12:58:37.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250720+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:37.250720+0000","last_peered":"2024-02-17T12:58:37.250720+0000","last_clean":"2024-02-17T12:58:37.250720+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:37.250720+0000","last_undegraded":"2024-02-17T12:58:37.250720+0000","last_fullsized":"2024-02-17T12:58:37.250720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450393+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:35.450393+0000","last_peered":"2024-02-17T12:58:35.450393+0000","last_clean":"2024-02-17T12:58:35.450393+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:35.450393+0000","last_undegraded":"2024-02-17T12:58:35.450393+0000","last_fullsized":"2024-02-17T12:58:35.450393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449588+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:35.449588+0000","last_peered":"2024-02-17T12:58:35.449588+0000","last_clean":"2024-02-17T12:58:35.449588+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:35.449588+0000","last_undegraded":"2024-02-17T12:58:35.449588+0000","last_fullsized":"2024-02-17T12:58:35.449588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364223+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:37.364223+0000","last_peered":"2024-02-17T12:58:37.364223+0000","last_clean":"2024-02-17T12:58:37.364223+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:37.364223+0000","last_undegraded":"2024-02-17T12:58:37.364223+0000","last_fullsized":"2024-02-17T12:58:37.364223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10174,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":20348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":115059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":109550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":698364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":112670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":109090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":698952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":109712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":5500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:40.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:40.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.345+0000 7f509b7ac640 1 Processor -- start 2024-02-17T12:58:40.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.345+0000 7f509b7ac640 1 -- start start 2024-02-17T12:58:40.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.346+0000 7f509b7ac640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5094150b50 0x7f50940726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.346+0000 7f509b7ac640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 0x7f509415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.346+0000 7f509b7ac640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940c3690 con 0x7f50940ca090 2024-02-17T12:58:40.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.346+0000 7f509b7ac640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5094159f50 con 0x7f5094150b50 2024-02-17T12:58:40.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.346+0000 7f509b7ac640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5094157890 con 0x7f50941573e0 2024-02-17T12:58:40.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.347+0000 7f5099d49640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 0x7f509415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.347+0000 7f5099548640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5094150b50 0x7f50940726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.347+0000 7f5099d49640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 0x7f509415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:40142/0 (socket says 172.21.15.136:40142) 2024-02-17T12:58:40.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.347+0000 7f5099d49640 1 -- 172.21.15.136:0/3060346580 learned_addr learned my addr 172.21.15.136:0/3060346580 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:40.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.347+0000 7f5098d47640 1 --1- 172.21.15.136:0/3060346580 >> v1:172.21.15.136:6789/0 conn(0x7f50940ca090 0x7f50940c51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38074/0 (socket says 172.21.15.136:38074) 2024-02-17T12:58:40.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.349+0000 7f5099d49640 1 -- 172.21.15.136:0/3060346580 >> v2:172.21.15.136:3300/0 conn(0x7f5094150b50 msgr2=0x7f50940726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:40.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.349+0000 7f5099d49640 1 --2- 172.21.15.136:0/3060346580 >> v2:172.21.15.136:3300/0 conn(0x7f5094150b50 0x7f50940726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.349+0000 7f5099d49640 1 -- 172.21.15.136:0/3060346580 >> v1:172.21.15.136:6789/0 conn(0x7f50940ca090 legacy=0x7f50940c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.349+0000 7f5099d49640 1 -- 172.21.15.136:0/3060346580 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940c38e0 con 0x7f50941573e0 2024-02-17T12:58:40.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.351+0000 7f5099d49640 1 --2- 172.21.15.136:0/3060346580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 0x7f509415a3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d150 tx=0x7f508c02e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77013089022fe4ea server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:40.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.354+0000 7f508bfff640 1 -- 172.21.15.136:0/3060346580 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00b0d0 con 0x7f50941573e0 2024-02-17T12:58:40.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f508bfff640 1 -- 172.21.15.136:0/3060346580 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c00b230 con 0x7f50941573e0 2024-02-17T12:58:40.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f508bfff640 1 -- 172.21.15.136:0/3060346580 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c009600 con 0x7f50941573e0 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 -- 172.21.15.136:0/3060346580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 msgr2=0x7f509415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 --2- 172.21.15.136:0/3060346580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 0x7f509415a3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d150 tx=0x7f508c02e160 comp rx=0 tx=0).stop 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 -- 172.21.15.136:0/3060346580 shutdown_connections 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 --2- 172.21.15.136:0/3060346580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50941573e0 0x7f509415a3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 --2- 172.21.15.136:0/3060346580 >> v2:172.21.15.136:3300/0 conn(0x7f5094150b50 0x7f50940726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 -- 172.21.15.136:0/3060346580 >> 172.21.15.136:0/3060346580 conn(0x7f509406bbd0 msgr2=0x7f509406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 -- 172.21.15.136:0/3060346580 shutdown_connections 2024-02-17T12:58:40.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.355+0000 7f509b7ac640 1 -- 172.21.15.136:0/3060346580 wait complete. 2024-02-17T12:58:40.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 Processor -- start 2024-02-17T12:58:40.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 -- start start 2024-02-17T12:58:40.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50940ca090 0x7f50940ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 0x7f509414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50941573e0 0x7f50941545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940cbd90 con 0x7f50940ca090 2024-02-17T12:58:40.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509414aa00 con 0x7f50941573e0 2024-02-17T12:58:40.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.357+0000 7f509b7ac640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50941f0fa0 con 0x7f5094150b50 2024-02-17T12:58:40.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.358+0000 7f5098d47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 0x7f509414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.358+0000 7f5099d49640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50941573e0 0x7f50941545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.358+0000 7f5098d47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 0x7f509414ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:40154/0 (socket says 172.21.15.136:40154) 2024-02-17T12:58:40.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.358+0000 7f5098d47640 1 -- 172.21.15.136:0/526833427 learned_addr learned my addr 172.21.15.136:0/526833427 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:40.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.358+0000 7f5099548640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50940ca090 0x7f50940ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.361+0000 7f5098d47640 1 -- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50941573e0 msgr2=0x7f50941545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.361+0000 7f5098d47640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50941573e0 0x7f50941545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.361+0000 7f5098d47640 1 -- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50940ca090 msgr2=0x7f50940ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.361+0000 7f5098d47640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50940ca090 0x7f50940ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.361+0000 7f5098d47640 1 -- 172.21.15.136:0/526833427 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c00bd40 con 0x7f5094150b50 2024-02-17T12:58:40.354 INFO:tasks.ceph.mds.a.smithi136.stderr:2024-02-17T12:58:40.362+0000 f5e3640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-02-17T12:58:40.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.364+0000 7f5098d47640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 0x7f509414ec70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f509000c3f0 tx=0x7f509000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.368+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900074e0 con 0x7f5094150b50 2024-02-17T12:58:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.368+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090007640 con 0x7f5094150b50 2024-02-17T12:58:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.368+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50940cab20 con 0x7f5094150b50 2024-02-17T12:58:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.368+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090004a00 con 0x7f5094150b50 2024-02-17T12:58:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.368+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50941f04c0 con 0x7f5094150b50 2024-02-17T12:58:40.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.369+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5094072d70 con 0x7f5094150b50 2024-02-17T12:58:40.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.387+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5090004b60 con 0x7f5094150b50 2024-02-17T12:58:40.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.388+0000 7f5089ffb640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f507806b860 0x7f507806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.388+0000 7f5099548640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f507806b860 0x7f507806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.388+0000 7f5099548640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f507806b860 0x7f507806dd20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5084009b40 tx=0x7f5084009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:40.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.390+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f50900589f0 con 0x7f5094150b50 2024-02-17T12:58:40.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.632+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5090054c90 con 0x7f5094150b50 2024-02-17T12:58:40.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.805+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5094072000 con 0x7f507806b860 2024-02-17T12:58:40.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.813+0000 7f5089ffb640 1 -- 172.21.15.136:0/526833427 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345323 (secure 0 0 0) 0x7f5084011a60 con 0x7f507806b860 2024-02-17T12:58:40.809 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:40.811 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:40.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f507806b860 msgr2=0x7f507806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f507806b860 0x7f507806dd20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5084009b40 tx=0x7f5084009190 comp rx=0 tx=0).stop 2024-02-17T12:58:40.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 msgr2=0x7f509414ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 0x7f509414ec70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f509000c3f0 tx=0x7f509000c8b0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 shutdown_connections 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f507806b860 0x7f507806dd20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50941573e0 0x7f50941545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5094150b50 0x7f509414ec70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 --2- 172.21.15.136:0/526833427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50940ca090 0x7f50940ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 >> 172.21.15.136:0/526833427 conn(0x7f509406bbd0 msgr2=0x7f509414c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 shutdown_connections 2024-02-17T12:58:40.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.817+0000 7f509b7ac640 1 -- 172.21.15.136:0/526833427 wait complete. 2024-02-17T12:58:40.819 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-02-17T12:58:39.991730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600542,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":360,"num_write_kb":2482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":3579904,"data_stored":2071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5444,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002153"},"pg_stats":[{"pgid":"2.1f","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447797+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:35.447797+0000","last_peered":"2024-02-17T12:58:35.447797+0000","last_clean":"2024-02-17T12:58:35.447797+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:35.447797+0000","last_undegraded":"2024-02-17T12:58:35.447797+0000","last_fullsized":"2024-02-17T12:58:35.447797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449786+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:35.449786+0000","last_peered":"2024-02-17T12:58:35.449786+0000","last_clean":"2024-02-17T12:58:35.449786+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:35.449786+0000","last_undegraded":"2024-02-17T12:58:35.449786+0000","last_fullsized":"2024-02-17T12:58:35.449786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252135+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:37.252135+0000","last_peered":"2024-02-17T12:58:37.252135+0000","last_clean":"2024-02-17T12:58:37.252135+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:37.252135+0000","last_undegraded":"2024-02-17T12:58:37.252135+0000","last_fullsized":"2024-02-17T12:58:37.252135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449995+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:35.449995+0000","last_peered":"2024-02-17T12:58:35.449995+0000","last_clean":"2024-02-17T12:58:35.449995+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:35.449995+0000","last_undegraded":"2024-02-17T12:58:35.449995+0000","last_fullsized":"2024-02-17T12:58:35.449995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450004+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:35.450004+0000","last_peered":"2024-02-17T12:58:35.450004+0000","last_clean":"2024-02-17T12:58:35.450004+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:35.450004+0000","last_undegraded":"2024-02-17T12:58:35.450004+0000","last_fullsized":"2024-02-17T12:58:35.450004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250259+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:37.250259+0000","last_peered":"2024-02-17T12:58:37.250259+0000","last_clean":"2024-02-17T12:58:37.250259+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:37.250259+0000","last_undegraded":"2024-02-17T12:58:37.250259+0000","last_fullsized":"2024-02-17T12:58:37.250259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363936+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:37.363936+0000","last_peered":"2024-02-17T12:58:37.363936+0000","last_clean":"2024-02-17T12:58:37.363936+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:37.363936+0000","last_undegraded":"2024-02-17T12:58:37.363936+0000","last_fullsized":"2024-02-17T12:58:37.363936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454386+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:35.454386+0000","last_peered":"2024-02-17T12:58:35.454386+0000","last_clean":"2024-02-17T12:58:35.454386+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:35.454386+0000","last_undegraded":"2024-02-17T12:58:35.454386+0000","last_fullsized":"2024-02-17T12:58:35.454386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.324543+0000","last_change":"2024-02-17T12:58:37.250456+0000","last_active":"2024-02-17T12:58:35.446593+0000","last_peered":"2024-02-17T12:58:03.437264+0000","last_clean":"2024-02-17T12:58:03.437264+0000","last_became_active":"2024-02-17T12:58:02.529672+0000","last_became_peered":"2024-02-17T12:58:02.529672+0000","last_unstale":"2024-02-17T12:58:37.324543+0000","last_undegraded":"2024-02-17T12:58:37.324543+0000","last_fullsized":"2024-02-17T12:58:37.324543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":["2(0)","0(2)","3(2)","5(1)","6(3)"],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364065+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:37.364065+0000","last_peered":"2024-02-17T12:58:37.364065+0000","last_clean":"2024-02-17T12:58:37.364065+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:37.364065+0000","last_undegraded":"2024-02-17T12:58:37.364065+0000","last_fullsized":"2024-02-17T12:58:37.364065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248354+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:37.248354+0000","last_peered":"2024-02-17T12:58:37.248354+0000","last_clean":"2024-02-17T12:58:37.248354+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:37.248354+0000","last_undegraded":"2024-02-17T12:58:37.248354+0000","last_fullsized":"2024-02-17T12:58:37.248354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251301+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:37.251301+0000","last_peered":"2024-02-17T12:58:37.251301+0000","last_clean":"2024-02-17T12:58:37.251301+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:37.251301+0000","last_undegraded":"2024-02-17T12:58:37.251301+0000","last_fullsized":"2024-02-17T12:58:37.251301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248286+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:37.248286+0000","last_peered":"2024-02-17T12:58:37.248286+0000","last_clean":"2024-02-17T12:58:37.248286+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:37.248286+0000","last_undegraded":"2024-02-17T12:58:37.248286+0000","last_fullsized":"2024-02-17T12:58:37.248286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248415+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:37.248415+0000","last_peered":"2024-02-17T12:58:37.248415+0000","last_clean":"2024-02-17T12:58:37.248415+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:37.248415+0000","last_undegraded":"2024-02-17T12:58:37.248415+0000","last_fullsized":"2024-02-17T12:58:37.248415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248122+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:37.248122+0000","last_peered":"2024-02-17T12:58:37.248122+0000","last_clean":"2024-02-17T12:58:37.248122+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:37.248122+0000","last_undegraded":"2024-02-17T12:58:37.248122+0000","last_fullsized":"2024-02-17T12:58:37.248122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251582+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:37.251582+0000","last_peered":"2024-02-17T12:58:37.251582+0000","last_clean":"2024-02-17T12:58:37.251582+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:37.251582+0000","last_undegraded":"2024-02-17T12:58:37.251582+0000","last_fullsized":"2024-02-17T12:58:37.251582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324439+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:37.324439+0000","last_peered":"2024-02-17T12:58:37.324439+0000","last_clean":"2024-02-17T12:58:37.324439+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:37.324439+0000","last_undegraded":"2024-02-17T12:58:37.324439+0000","last_fullsized":"2024-02-17T12:58:37.324439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363560+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:37.363560+0000","last_peered":"2024-02-17T12:58:37.363560+0000","last_clean":"2024-02-17T12:58:37.363560+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:37.363560+0000","last_undegraded":"2024-02-17T12:58:37.363560+0000","last_fullsized":"2024-02-17T12:58:37.363560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446619+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:35.446619+0000","last_peered":"2024-02-17T12:58:35.446619+0000","last_clean":"2024-02-17T12:58:35.446619+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:35.446619+0000","last_undegraded":"2024-02-17T12:58:35.446619+0000","last_fullsized":"2024-02-17T12:58:35.446619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447017+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:35.447017+0000","last_peered":"2024-02-17T12:58:35.447017+0000","last_clean":"2024-02-17T12:58:35.447017+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:35.447017+0000","last_undegraded":"2024-02-17T12:58:35.447017+0000","last_fullsized":"2024-02-17T12:58:35.447017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252567+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:37.252567+0000","last_peered":"2024-02-17T12:58:37.252567+0000","last_clean":"2024-02-17T12:58:37.252567+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:37.252567+0000","last_undegraded":"2024-02-17T12:58:37.252567+0000","last_fullsized":"2024-02-17T12:58:37.252567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247975+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:37.247975+0000","last_peered":"2024-02-17T12:58:37.247975+0000","last_clean":"2024-02-17T12:58:37.247975+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:37.247975+0000","last_undegraded":"2024-02-17T12:58:37.247975+0000","last_fullsized":"2024-02-17T12:58:37.247975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363471+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:37.363471+0000","last_peered":"2024-02-17T12:58:37.363471+0000","last_clean":"2024-02-17T12:58:37.363471+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:37.363471+0000","last_undegraded":"2024-02-17T12:58:37.363471+0000","last_fullsized":"2024-02-17T12:58:37.363471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251135+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:37.251135+0000","last_peered":"2024-02-17T12:58:37.251135+0000","last_clean":"2024-02-17T12:58:37.251135+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:37.251135+0000","last_undegraded":"2024-02-17T12:58:37.251135+0000","last_fullsized":"2024-02-17T12:58:37.251135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447387+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:35.447387+0000","last_peered":"2024-02-17T12:58:35.447387+0000","last_clean":"2024-02-17T12:58:35.447387+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:35.447387+0000","last_undegraded":"2024-02-17T12:58:35.447387+0000","last_fullsized":"2024-02-17T12:58:35.447387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248929+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:37.248929+0000","last_peered":"2024-02-17T12:58:37.248929+0000","last_clean":"2024-02-17T12:58:37.248929+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:37.248929+0000","last_undegraded":"2024-02-17T12:58:37.248929+0000","last_fullsized":"2024-02-17T12:58:37.248929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250402+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:37.250402+0000","last_peered":"2024-02-17T12:58:37.250402+0000","last_clean":"2024-02-17T12:58:37.250402+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:37.250402+0000","last_undegraded":"2024-02-17T12:58:37.250402+0000","last_fullsized":"2024-02-17T12:58:37.250402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447772+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:35.447772+0000","last_peered":"2024-02-17T12:58:35.447772+0000","last_clean":"2024-02-17T12:58:35.447772+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:35.447772+0000","last_undegraded":"2024-02-17T12:58:35.447772+0000","last_fullsized":"2024-02-17T12:58:35.447772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447557+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:35.447557+0000","last_peered":"2024-02-17T12:58:35.447557+0000","last_clean":"2024-02-17T12:58:35.447557+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:35.447557+0000","last_undegraded":"2024-02-17T12:58:35.447557+0000","last_fullsized":"2024-02-17T12:58:35.447557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446610+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:35.446610+0000","last_peered":"2024-02-17T12:58:35.446610+0000","last_clean":"2024-02-17T12:58:35.446610+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:35.446610+0000","last_undegraded":"2024-02-17T12:58:35.446610+0000","last_fullsized":"2024-02-17T12:58:35.446610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324493+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:37.324493+0000","last_peered":"2024-02-17T12:58:37.324493+0000","last_clean":"2024-02-17T12:58:37.324493+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:37.324493+0000","last_undegraded":"2024-02-17T12:58:37.324493+0000","last_fullsized":"2024-02-17T12:58:37.324493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248623+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:37.248623+0000","last_peered":"2024-02-17T12:58:37.248623+0000","last_clean":"2024-02-17T12:58:37.248623+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:37.248623+0000","last_undegraded":"2024-02-17T12:58:37.248623+0000","last_fullsized":"2024-02-17T12:58:37.248623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324212+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:37.324212+0000","last_peered":"2024-02-17T12:58:37.324212+0000","last_clean":"2024-02-17T12:58:37.324212+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:37.324212+0000","last_undegraded":"2024-02-17T12:58:37.324212+0000","last_fullsized":"2024-02-17T12:58:37.324212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250988+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:37.250988+0000","last_peered":"2024-02-17T12:58:37.250988+0000","last_clean":"2024-02-17T12:58:37.250988+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:37.250988+0000","last_undegraded":"2024-02-17T12:58:37.250988+0000","last_fullsized":"2024-02-17T12:58:37.250988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450301+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:35.450301+0000","last_peered":"2024-02-17T12:58:35.450301+0000","last_clean":"2024-02-17T12:58:35.450301+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:35.450301+0000","last_undegraded":"2024-02-17T12:58:35.450301+0000","last_fullsized":"2024-02-17T12:58:35.450301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324026+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:37.324026+0000","last_peered":"2024-02-17T12:58:37.324026+0000","last_clean":"2024-02-17T12:58:37.324026+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:37.324026+0000","last_undegraded":"2024-02-17T12:58:37.324026+0000","last_fullsized":"2024-02-17T12:58:37.324026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363882+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:37.363882+0000","last_peered":"2024-02-17T12:58:37.363882+0000","last_clean":"2024-02-17T12:58:37.363882+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:37.363882+0000","last_undegraded":"2024-02-17T12:58:37.363882+0000","last_fullsized":"2024-02-17T12:58:37.363882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248625+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:37.248625+0000","last_peered":"2024-02-17T12:58:37.248625+0000","last_clean":"2024-02-17T12:58:37.248625+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:37.248625+0000","last_undegraded":"2024-02-17T12:58:37.248625+0000","last_fullsized":"2024-02-17T12:58:37.248625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324381+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:37.324381+0000","last_peered":"2024-02-17T12:58:37.324381+0000","last_clean":"2024-02-17T12:58:37.324381+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:37.324381+0000","last_undegraded":"2024-02-17T12:58:37.324381+0000","last_fullsized":"2024-02-17T12:58:37.324381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449065+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:35.449065+0000","last_peered":"2024-02-17T12:58:35.449065+0000","last_clean":"2024-02-17T12:58:35.449065+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:35.449065+0000","last_undegraded":"2024-02-17T12:58:35.449065+0000","last_fullsized":"2024-02-17T12:58:35.449065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251333+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:37.251333+0000","last_peered":"2024-02-17T12:58:37.251333+0000","last_clean":"2024-02-17T12:58:37.251333+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:37.251333+0000","last_undegraded":"2024-02-17T12:58:37.251333+0000","last_fullsized":"2024-02-17T12:58:37.251333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324268+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:37.324268+0000","last_peered":"2024-02-17T12:58:37.324268+0000","last_clean":"2024-02-17T12:58:37.324268+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:37.324268+0000","last_undegraded":"2024-02-17T12:58:37.324268+0000","last_fullsized":"2024-02-17T12:58:37.324268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.323981+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:37.323981+0000","last_peered":"2024-02-17T12:58:37.323981+0000","last_clean":"2024-02-17T12:58:37.323981+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:37.323981+0000","last_undegraded":"2024-02-17T12:58:37.323981+0000","last_fullsized":"2024-02-17T12:58:37.323981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247892+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:37.247892+0000","last_peered":"2024-02-17T12:58:37.247892+0000","last_clean":"2024-02-17T12:58:37.247892+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:37.247892+0000","last_undegraded":"2024-02-17T12:58:37.247892+0000","last_fullsized":"2024-02-17T12:58:37.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449414+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:35.449414+0000","last_peered":"2024-02-17T12:58:35.449414+0000","last_clean":"2024-02-17T12:58:35.449414+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:35.449414+0000","last_undegraded":"2024-02-17T12:58:35.449414+0000","last_fullsized":"2024-02-17T12:58:35.449414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446932+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:35.446932+0000","last_peered":"2024-02-17T12:58:35.446932+0000","last_clean":"2024-02-17T12:58:35.446932+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:35.446932+0000","last_undegraded":"2024-02-17T12:58:35.446932+0000","last_fullsized":"2024-02-17T12:58:35.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453996+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:35.453996+0000","last_peered":"2024-02-17T12:58:35.453996+0000","last_clean":"2024-02-17T12:58:35.453996+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:35.453996+0000","last_undegraded":"2024-02-17T12:58:35.453996+0000","last_fullsized":"2024-02-17T12:58:35.453996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324559+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:37.324559+0000","last_peered":"2024-02-17T12:58:37.324559+0000","last_clean":"2024-02-17T12:58:37.324559+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:37.324559+0000","last_undegraded":"2024-02-17T12:58:37.324559+0000","last_fullsized":"2024-02-17T12:58:37.324559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250612+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:37.250612+0000","last_peered":"2024-02-17T12:58:37.250612+0000","last_clean":"2024-02-17T12:58:37.250612+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:37.250612+0000","last_undegraded":"2024-02-17T12:58:37.250612+0000","last_fullsized":"2024-02-17T12:58:37.250612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363999+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:37.363999+0000","last_peered":"2024-02-17T12:58:37.363999+0000","last_clean":"2024-02-17T12:58:37.363999+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:37.363999+0000","last_undegraded":"2024-02-17T12:58:37.363999+0000","last_fullsized":"2024-02-17T12:58:37.363999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450641+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:35.450641+0000","last_peered":"2024-02-17T12:58:35.450641+0000","last_clean":"2024-02-17T12:58:35.450641+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:35.450641+0000","last_undegraded":"2024-02-17T12:58:35.450641+0000","last_fullsized":"2024-02-17T12:58:35.450641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449570+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:35.449570+0000","last_peered":"2024-02-17T12:58:35.449570+0000","last_clean":"2024-02-17T12:58:35.449570+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:35.449570+0000","last_undegraded":"2024-02-17T12:58:35.449570+0000","last_fullsized":"2024-02-17T12:58:35.449570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363983+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:37.363983+0000","last_peered":"2024-02-17T12:58:37.363983+0000","last_clean":"2024-02-17T12:58:37.363983+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:37.363983+0000","last_undegraded":"2024-02-17T12:58:37.363983+0000","last_fullsized":"2024-02-17T12:58:37.363983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447469+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:35.447469+0000","last_peered":"2024-02-17T12:58:35.447469+0000","last_clean":"2024-02-17T12:58:35.447469+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:35.447469+0000","last_undegraded":"2024-02-17T12:58:35.447469+0000","last_fullsized":"2024-02-17T12:58:35.447469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247666+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:37.247666+0000","last_peered":"2024-02-17T12:58:37.247666+0000","last_clean":"2024-02-17T12:58:37.247666+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:37.247666+0000","last_undegraded":"2024-02-17T12:58:37.247666+0000","last_fullsized":"2024-02-17T12:58:37.247666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251231+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:37.251231+0000","last_peered":"2024-02-17T12:58:37.251231+0000","last_clean":"2024-02-17T12:58:37.251231+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:37.251231+0000","last_undegraded":"2024-02-17T12:58:37.251231+0000","last_fullsized":"2024-02-17T12:58:37.251231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364174+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:37.364174+0000","last_peered":"2024-02-17T12:58:37.364174+0000","last_clean":"2024-02-17T12:58:37.364174+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:37.364174+0000","last_undegraded":"2024-02-17T12:58:37.364174+0000","last_fullsized":"2024-02-17T12:58:37.364174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453399+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:35.453399+0000","last_peered":"2024-02-17T12:58:35.453399+0000","last_clean":"2024-02-17T12:58:35.453399+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:35.453399+0000","last_undegraded":"2024-02-17T12:58:35.453399+0000","last_fullsized":"2024-02-17T12:58:35.453399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247880+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:37.247880+0000","last_peered":"2024-02-17T12:58:37.247880+0000","last_clean":"2024-02-17T12:58:37.247880+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:37.247880+0000","last_undegraded":"2024-02-17T12:58:37.247880+0000","last_fullsized":"2024-02-17T12:58:37.247880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'16","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446726+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:35.446726+0000","last_peered":"2024-02-17T12:58:35.446726+0000","last_clean":"2024-02-17T12:58:35.446726+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:35.446726+0000","last_undegraded":"2024-02-17T12:58:35.446726+0000","last_fullsized":"2024-02-17T12:58:35.446726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449691+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:35.449691+0000","last_peered":"2024-02-17T12:58:35.449691+0000","last_clean":"2024-02-17T12:58:35.449691+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:35.449691+0000","last_undegraded":"2024-02-17T12:58:35.449691+0000","last_fullsized":"2024-02-17T12:58:35.449691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453774+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:35.453774+0000","last_peered":"2024-02-17T12:58:35.453774+0000","last_clean":"2024-02-17T12:58:35.453774+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:35.453774+0000","last_undegraded":"2024-02-17T12:58:35.453774+0000","last_fullsized":"2024-02-17T12:58:35.453774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363771+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:37.363771+0000","last_peered":"2024-02-17T12:58:37.363771+0000","last_clean":"2024-02-17T12:58:37.363771+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:37.363771+0000","last_undegraded":"2024-02-17T12:58:37.363771+0000","last_fullsized":"2024-02-17T12:58:37.363771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449906+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:35.449906+0000","last_peered":"2024-02-17T12:58:35.449906+0000","last_clean":"2024-02-17T12:58:35.449906+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:35.449906+0000","last_undegraded":"2024-02-17T12:58:35.449906+0000","last_fullsized":"2024-02-17T12:58:35.449906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248256+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:37.248256+0000","last_peered":"2024-02-17T12:58:37.248256+0000","last_clean":"2024-02-17T12:58:37.248256+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:37.248256+0000","last_undegraded":"2024-02-17T12:58:37.248256+0000","last_fullsized":"2024-02-17T12:58:37.248256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248528+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:37.248528+0000","last_peered":"2024-02-17T12:58:37.248528+0000","last_clean":"2024-02-17T12:58:37.248528+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:37.248528+0000","last_undegraded":"2024-02-17T12:58:37.248528+0000","last_fullsized":"2024-02-17T12:58:37.248528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324198+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:37.324198+0000","last_peered":"2024-02-17T12:58:37.324198+0000","last_clean":"2024-02-17T12:58:37.324198+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:37.324198+0000","last_undegraded":"2024-02-17T12:58:37.324198+0000","last_fullsized":"2024-02-17T12:58:37.324198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324160+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:37.324160+0000","last_peered":"2024-02-17T12:58:37.324160+0000","last_clean":"2024-02-17T12:58:37.324160+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:37.324160+0000","last_undegraded":"2024-02-17T12:58:37.324160+0000","last_fullsized":"2024-02-17T12:58:37.324160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251902+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:37.251902+0000","last_peered":"2024-02-17T12:58:37.251902+0000","last_clean":"2024-02-17T12:58:37.251902+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:37.251902+0000","last_undegraded":"2024-02-17T12:58:37.251902+0000","last_fullsized":"2024-02-17T12:58:37.251902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248263+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:37.248263+0000","last_peered":"2024-02-17T12:58:37.248263+0000","last_clean":"2024-02-17T12:58:37.248263+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:37.248263+0000","last_undegraded":"2024-02-17T12:58:37.248263+0000","last_fullsized":"2024-02-17T12:58:37.248263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363833+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:37.363833+0000","last_peered":"2024-02-17T12:58:37.363833+0000","last_clean":"2024-02-17T12:58:37.363833+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:37.363833+0000","last_undegraded":"2024-02-17T12:58:37.363833+0000","last_fullsized":"2024-02-17T12:58:37.363833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250807+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:37.250807+0000","last_peered":"2024-02-17T12:58:37.250807+0000","last_clean":"2024-02-17T12:58:37.250807+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:37.250807+0000","last_undegraded":"2024-02-17T12:58:37.250807+0000","last_fullsized":"2024-02-17T12:58:37.250807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446826+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:35.446826+0000","last_peered":"2024-02-17T12:58:35.446826+0000","last_clean":"2024-02-17T12:58:35.446826+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:35.446826+0000","last_undegraded":"2024-02-17T12:58:35.446826+0000","last_fullsized":"2024-02-17T12:58:35.446826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248015+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:37.248015+0000","last_peered":"2024-02-17T12:58:37.248015+0000","last_clean":"2024-02-17T12:58:37.248015+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:37.248015+0000","last_undegraded":"2024-02-17T12:58:37.248015+0000","last_fullsized":"2024-02-17T12:58:37.248015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252276+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:37.252276+0000","last_peered":"2024-02-17T12:58:37.252276+0000","last_clean":"2024-02-17T12:58:37.252276+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:37.252276+0000","last_undegraded":"2024-02-17T12:58:37.252276+0000","last_fullsized":"2024-02-17T12:58:37.252276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250675+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:37.250675+0000","last_peered":"2024-02-17T12:58:37.250675+0000","last_clean":"2024-02-17T12:58:37.250675+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:37.250675+0000","last_undegraded":"2024-02-17T12:58:37.250675+0000","last_fullsized":"2024-02-17T12:58:37.250675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450071+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.450071+0000","last_peered":"2024-02-17T12:58:35.450071+0000","last_clean":"2024-02-17T12:58:35.450071+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:35.450071+0000","last_undegraded":"2024-02-17T12:58:35.450071+0000","last_fullsized":"2024-02-17T12:58:35.450071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364124+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:37.364124+0000","last_peered":"2024-02-17T12:58:37.364124+0000","last_clean":"2024-02-17T12:58:37.364124+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:37.364124+0000","last_undegraded":"2024-02-17T12:58:37.364124+0000","last_fullsized":"2024-02-17T12:58:37.364124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251083+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:37.251083+0000","last_peered":"2024-02-17T12:58:37.251083+0000","last_clean":"2024-02-17T12:58:37.251083+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:37.251083+0000","last_undegraded":"2024-02-17T12:58:37.251083+0000","last_fullsized":"2024-02-17T12:58:37.251083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251217+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:37.251217+0000","last_peered":"2024-02-17T12:58:37.251217+0000","last_clean":"2024-02-17T12:58:37.251217+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:37.251217+0000","last_undegraded":"2024-02-17T12:58:37.251217+0000","last_fullsized":"2024-02-17T12:58:37.251217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454832+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:35.454832+0000","last_peered":"2024-02-17T12:58:35.454832+0000","last_clean":"2024-02-17T12:58:35.454832+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:35.454832+0000","last_undegraded":"2024-02-17T12:58:35.454832+0000","last_fullsized":"2024-02-17T12:58:35.454832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446907+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:35.446907+0000","last_peered":"2024-02-17T12:58:35.446907+0000","last_clean":"2024-02-17T12:58:35.446907+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:35.446907+0000","last_undegraded":"2024-02-17T12:58:35.446907+0000","last_fullsized":"2024-02-17T12:58:35.446907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447300+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:35.447300+0000","last_peered":"2024-02-17T12:58:35.447300+0000","last_clean":"2024-02-17T12:58:35.447300+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:35.447300+0000","last_undegraded":"2024-02-17T12:58:35.447300+0000","last_fullsized":"2024-02-17T12:58:35.447300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446948+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:35.446948+0000","last_peered":"2024-02-17T12:58:35.446948+0000","last_clean":"2024-02-17T12:58:35.446948+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:35.446948+0000","last_undegraded":"2024-02-17T12:58:35.446948+0000","last_fullsized":"2024-02-17T12:58:35.446948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247856+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:37.247856+0000","last_peered":"2024-02-17T12:58:37.247856+0000","last_clean":"2024-02-17T12:58:37.247856+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:37.247856+0000","last_undegraded":"2024-02-17T12:58:37.247856+0000","last_fullsized":"2024-02-17T12:58:37.247856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248706+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:37.248706+0000","last_peered":"2024-02-17T12:58:37.248706+0000","last_clean":"2024-02-17T12:58:37.248706+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:37.248706+0000","last_undegraded":"2024-02-17T12:58:37.248706+0000","last_fullsized":"2024-02-17T12:58:37.248706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449178+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:35.449178+0000","last_peered":"2024-02-17T12:58:35.449178+0000","last_clean":"2024-02-17T12:58:35.449178+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:35.449178+0000","last_undegraded":"2024-02-17T12:58:35.449178+0000","last_fullsized":"2024-02-17T12:58:35.449178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324017+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:37.324017+0000","last_peered":"2024-02-17T12:58:37.324017+0000","last_clean":"2024-02-17T12:58:37.324017+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:37.324017+0000","last_undegraded":"2024-02-17T12:58:37.324017+0000","last_fullsized":"2024-02-17T12:58:37.324017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447093+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:35.447093+0000","last_peered":"2024-02-17T12:58:35.447093+0000","last_clean":"2024-02-17T12:58:35.447093+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:35.447093+0000","last_undegraded":"2024-02-17T12:58:35.447093+0000","last_fullsized":"2024-02-17T12:58:35.447093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.447152+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:35.447152+0000","last_peered":"2024-02-17T12:58:35.447152+0000","last_clean":"2024-02-17T12:58:35.447152+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:35.447152+0000","last_undegraded":"2024-02-17T12:58:35.447152+0000","last_fullsized":"2024-02-17T12:58:35.447152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449679+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:35.449679+0000","last_peered":"2024-02-17T12:58:35.449679+0000","last_clean":"2024-02-17T12:58:35.449679+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:35.449679+0000","last_undegraded":"2024-02-17T12:58:35.449679+0000","last_fullsized":"2024-02-17T12:58:35.449679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454124+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:35.454124+0000","last_peered":"2024-02-17T12:58:35.454124+0000","last_clean":"2024-02-17T12:58:35.454124+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:35.454124+0000","last_undegraded":"2024-02-17T12:58:35.454124+0000","last_fullsized":"2024-02-17T12:58:35.454124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":5,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.250879+0000","last_change":"2024-02-17T12:58:37.250879+0000","last_active":"2024-02-17T12:58:01.234263+0000","last_peered":"2024-02-17T12:58:01.234263+0000","last_clean":"2024-02-17T12:58:01.234263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:58:37.250879+0000","last_undegraded":"2024-02-17T12:58:37.250879+0000","last_fullsized":"2024-02-17T12:58:37.250879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":["2(0)","0(3)","1(2)","5(1)","7(0)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250452+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:37.250452+0000","last_peered":"2024-02-17T12:58:37.250452+0000","last_clean":"2024-02-17T12:58:37.250452+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:37.250452+0000","last_undegraded":"2024-02-17T12:58:37.250452+0000","last_fullsized":"2024-02-17T12:58:37.250452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251224+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:37.251224+0000","last_peered":"2024-02-17T12:58:37.251224+0000","last_clean":"2024-02-17T12:58:37.251224+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:37.251224+0000","last_undegraded":"2024-02-17T12:58:37.251224+0000","last_fullsized":"2024-02-17T12:58:37.251224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248199+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:37.248199+0000","last_peered":"2024-02-17T12:58:37.248199+0000","last_clean":"2024-02-17T12:58:37.248199+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:37.248199+0000","last_undegraded":"2024-02-17T12:58:37.248199+0000","last_fullsized":"2024-02-17T12:58:37.248199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449596+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:35.449596+0000","last_peered":"2024-02-17T12:58:35.449596+0000","last_clean":"2024-02-17T12:58:35.449596+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:35.449596+0000","last_undegraded":"2024-02-17T12:58:35.449596+0000","last_fullsized":"2024-02-17T12:58:35.449596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324471+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:37.324471+0000","last_peered":"2024-02-17T12:58:37.324471+0000","last_clean":"2024-02-17T12:58:37.324471+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:37.324471+0000","last_undegraded":"2024-02-17T12:58:37.324471+0000","last_fullsized":"2024-02-17T12:58:37.324471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324153+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:37.324153+0000","last_peered":"2024-02-17T12:58:37.324153+0000","last_clean":"2024-02-17T12:58:37.324153+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:37.324153+0000","last_undegraded":"2024-02-17T12:58:37.324153+0000","last_fullsized":"2024-02-17T12:58:37.324153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251155+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:37.251155+0000","last_peered":"2024-02-17T12:58:37.251155+0000","last_clean":"2024-02-17T12:58:37.251155+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:37.251155+0000","last_undegraded":"2024-02-17T12:58:37.251155+0000","last_fullsized":"2024-02-17T12:58:37.251155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449798+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.449798+0000","last_peered":"2024-02-17T12:58:35.449798+0000","last_clean":"2024-02-17T12:58:35.449798+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:35.449798+0000","last_undegraded":"2024-02-17T12:58:35.449798+0000","last_fullsized":"2024-02-17T12:58:35.449798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247786+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:37.247786+0000","last_peered":"2024-02-17T12:58:37.247786+0000","last_clean":"2024-02-17T12:58:37.247786+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:37.247786+0000","last_undegraded":"2024-02-17T12:58:37.247786+0000","last_fullsized":"2024-02-17T12:58:37.247786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449437+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:35.449437+0000","last_peered":"2024-02-17T12:58:35.449437+0000","last_clean":"2024-02-17T12:58:35.449437+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:35.449437+0000","last_undegraded":"2024-02-17T12:58:35.449437+0000","last_fullsized":"2024-02-17T12:58:35.449437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453645+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:35.453645+0000","last_peered":"2024-02-17T12:58:35.453645+0000","last_clean":"2024-02-17T12:58:35.453645+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:35.453645+0000","last_undegraded":"2024-02-17T12:58:35.453645+0000","last_fullsized":"2024-02-17T12:58:35.453645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.446907+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:35.446907+0000","last_peered":"2024-02-17T12:58:35.446907+0000","last_clean":"2024-02-17T12:58:35.446907+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:35.446907+0000","last_undegraded":"2024-02-17T12:58:35.446907+0000","last_fullsized":"2024-02-17T12:58:35.446907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.741377+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T12:58:37.741377+0000","last_peered":"2024-02-17T12:58:37.741377+0000","last_clean":"2024-02-17T12:58:37.741377+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T12:58:37.741377+0000","last_undegraded":"2024-02-17T12:58:37.741377+0000","last_fullsized":"2024-02-17T12:58:37.741377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248600+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:37.248600+0000","last_peered":"2024-02-17T12:58:37.248600+0000","last_clean":"2024-02-17T12:58:37.248600+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:37.248600+0000","last_undegraded":"2024-02-17T12:58:37.248600+0000","last_fullsized":"2024-02-17T12:58:37.248600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252206+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:37.252206+0000","last_peered":"2024-02-17T12:58:37.252206+0000","last_clean":"2024-02-17T12:58:37.252206+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:37.252206+0000","last_undegraded":"2024-02-17T12:58:37.252206+0000","last_fullsized":"2024-02-17T12:58:37.252206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248852+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:37.248852+0000","last_peered":"2024-02-17T12:58:37.248852+0000","last_clean":"2024-02-17T12:58:37.248852+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:37.248852+0000","last_undegraded":"2024-02-17T12:58:37.248852+0000","last_fullsized":"2024-02-17T12:58:37.248852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247763+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:37.247763+0000","last_peered":"2024-02-17T12:58:37.247763+0000","last_clean":"2024-02-17T12:58:37.247763+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:37.247763+0000","last_undegraded":"2024-02-17T12:58:37.247763+0000","last_fullsized":"2024-02-17T12:58:37.247763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449274+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:35.449274+0000","last_peered":"2024-02-17T12:58:35.449274+0000","last_clean":"2024-02-17T12:58:35.449274+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:35.449274+0000","last_undegraded":"2024-02-17T12:58:35.449274+0000","last_fullsized":"2024-02-17T12:58:35.449274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324058+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:37.324058+0000","last_peered":"2024-02-17T12:58:37.324058+0000","last_clean":"2024-02-17T12:58:37.324058+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:37.324058+0000","last_undegraded":"2024-02-17T12:58:37.324058+0000","last_fullsized":"2024-02-17T12:58:37.324058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324329+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:37.324329+0000","last_peered":"2024-02-17T12:58:37.324329+0000","last_clean":"2024-02-17T12:58:37.324329+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:37.324329+0000","last_undegraded":"2024-02-17T12:58:37.324329+0000","last_fullsized":"2024-02-17T12:58:37.324329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363917+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:37.363917+0000","last_peered":"2024-02-17T12:58:37.363917+0000","last_clean":"2024-02-17T12:58:37.363917+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:37.363917+0000","last_undegraded":"2024-02-17T12:58:37.363917+0000","last_fullsized":"2024-02-17T12:58:37.363917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363804+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:37.363804+0000","last_peered":"2024-02-17T12:58:37.363804+0000","last_clean":"2024-02-17T12:58:37.363804+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:37.363804+0000","last_undegraded":"2024-02-17T12:58:37.363804+0000","last_fullsized":"2024-02-17T12:58:37.363804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363645+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:37.363645+0000","last_peered":"2024-02-17T12:58:37.363645+0000","last_clean":"2024-02-17T12:58:37.363645+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:37.363645+0000","last_undegraded":"2024-02-17T12:58:37.363645+0000","last_fullsized":"2024-02-17T12:58:37.363645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454803+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:35.454803+0000","last_peered":"2024-02-17T12:58:35.454803+0000","last_clean":"2024-02-17T12:58:35.454803+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:35.454803+0000","last_undegraded":"2024-02-17T12:58:35.454803+0000","last_fullsized":"2024-02-17T12:58:35.454803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449023+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:35.449023+0000","last_peered":"2024-02-17T12:58:35.449023+0000","last_clean":"2024-02-17T12:58:35.449023+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:35.449023+0000","last_undegraded":"2024-02-17T12:58:35.449023+0000","last_fullsized":"2024-02-17T12:58:35.449023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363643+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:37.363643+0000","last_peered":"2024-02-17T12:58:37.363643+0000","last_clean":"2024-02-17T12:58:37.363643+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:37.363643+0000","last_undegraded":"2024-02-17T12:58:37.363643+0000","last_fullsized":"2024-02-17T12:58:37.363643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251191+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:37.251191+0000","last_peered":"2024-02-17T12:58:37.251191+0000","last_clean":"2024-02-17T12:58:37.251191+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:37.251191+0000","last_undegraded":"2024-02-17T12:58:37.251191+0000","last_fullsized":"2024-02-17T12:58:37.251191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363883+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:37.363883+0000","last_peered":"2024-02-17T12:58:37.363883+0000","last_clean":"2024-02-17T12:58:37.363883+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:37.363883+0000","last_undegraded":"2024-02-17T12:58:37.363883+0000","last_fullsized":"2024-02-17T12:58:37.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250720+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:37.250720+0000","last_peered":"2024-02-17T12:58:37.250720+0000","last_clean":"2024-02-17T12:58:37.250720+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:37.250720+0000","last_undegraded":"2024-02-17T12:58:37.250720+0000","last_fullsized":"2024-02-17T12:58:37.250720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450393+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:35.450393+0000","last_peered":"2024-02-17T12:58:35.450393+0000","last_clean":"2024-02-17T12:58:35.450393+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:35.450393+0000","last_undegraded":"2024-02-17T12:58:35.450393+0000","last_fullsized":"2024-02-17T12:58:35.450393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449588+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:35.449588+0000","last_peered":"2024-02-17T12:58:35.449588+0000","last_clean":"2024-02-17T12:58:35.449588+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:35.449588+0000","last_undegraded":"2024-02-17T12:58:35.449588+0000","last_fullsized":"2024-02-17T12:58:35.449588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364223+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:37.364223+0000","last_peered":"2024-02-17T12:58:37.364223+0000","last_clean":"2024-02-17T12:58:37.364223+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:37.364223+0000","last_undegraded":"2024-02-17T12:58:37.364223+0000","last_fullsized":"2024-02-17T12:58:37.364223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10174,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":20348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":115059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":109550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":698364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":112670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":109090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":698952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":109712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":5500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:40.824 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-02-17T12:58:40.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 19, 'reported_epoch': 26, 'state': 'activating', 'last_fresh': '2024-02-17T12:58:37.324543+0000', 'last_change': '2024-02-17T12:58:37.250456+0000', 'last_active': '2024-02-17T12:58:35.446593+0000', 'last_peered': '2024-02-17T12:58:03.437264+0000', 'last_clean': '2024-02-17T12:58:03.437264+0000', 'last_became_active': '2024-02-17T12:58:02.529672+0000', 'last_became_peered': '2024-02-17T12:58:02.529672+0000', 'last_unstale': '2024-02-17T12:58:37.324543+0000', 'last_undegraded': '2024-02-17T12:58:37.324543+0000', 'last_fullsized': '2024-02-17T12:58:37.324543+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 23, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:58:01.234263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:58:01.234263+0000', 'last_clean_scrub_stamp': '2024-02-17T12:58:01.234263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5, 0, 6], 'acting': [2, 5, 0, 6], 'avail_no_missing': ['2(0)', '0(2)', '3(2)', '5(1)', '6(3)'], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:58:40.825 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-02-17T12:58:40.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 26, 'state': 'activating', 'last_fresh': '2024-02-17T12:58:37.250879+0000', 'last_change': '2024-02-17T12:58:37.250879+0000', 'last_active': '2024-02-17T12:58:01.234263+0000', 'last_peered': '2024-02-17T12:58:01.234263+0000', 'last_clean': '2024-02-17T12:58:01.234263+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:58:37.250879+0000', 'last_undegraded': '2024-02-17T12:58:37.250879+0000', 'last_fullsized': '2024-02-17T12:58:37.250879+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 23, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:58:01.234263+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:58:01.234263+0000', 'last_clean_scrub_stamp': '2024-02-17T12:58:01.234263+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5, 1, 0], 'acting': [2, 5, 1, 0], 'avail_no_missing': ['2(0)', '0(3)', '1(2)', '5(1)', '7(0)'], 'object_location_counts': [], 'blocked_by': [1, 2], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:58:40.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T12:58:40.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.971+0000 7f10b750c640 1 Processor -- start 2024-02-17T12:58:40.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.971+0000 7f10b750c640 1 -- start start 2024-02-17T12:58:40.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.972+0000 7f10b750c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10b0154250 0x7f10b006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.972+0000 7f10b750c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f10b00c9930 0x7f10b015d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.972+0000 7f10b750c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00c8e60 con 0x7f10b00c94f0 2024-02-17T12:58:40.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.972+0000 7f10b750c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b006c260 con 0x7f10b00c9930 2024-02-17T12:58:40.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.972+0000 7f10b750c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b006c540 con 0x7f10b0154250 2024-02-17T12:58:40.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.972+0000 7f10b5aa9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f10b00c9930 0x7f10b015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.973+0000 7f10b52a8640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10b0154250 0x7f10b006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.973+0000 7f10b4aa7640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f10b00c94f0 0x7f10b0070720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38080/0 (socket says 172.21.15.136:38080) 2024-02-17T12:58:40.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.973+0000 7f10b4aa7640 1 -- 172.21.15.136:0/1424166031 learned_addr learned my addr 172.21.15.136:0/1424166031 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:40.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.975+0000 7f10b52a8640 1 -- 172.21.15.136:0/1424166031 >> v2:172.21.15.136:3300/0 conn(0x7f10b00c9930 msgr2=0x7f10b015d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:40.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.975+0000 7f10b52a8640 1 --2- 172.21.15.136:0/1424166031 >> v2:172.21.15.136:3300/0 conn(0x7f10b00c9930 0x7f10b015d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.975+0000 7f10b52a8640 1 -- 172.21.15.136:0/1424166031 >> v1:172.21.15.136:6789/0 conn(0x7f10b00c94f0 legacy=0x7f10b0070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.975+0000 7f10b52a8640 1 -- 172.21.15.136:0/1424166031 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00c8530 con 0x7f10b0154250 2024-02-17T12:58:40.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.977+0000 7f10b52a8640 1 --2- 172.21.15.136:0/1424166031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b006bbd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f10b006ddb0 tx=0x7f10ac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=468731971175e997 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:40.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.981+0000 7f10a7fff640 1 -- 172.21.15.136:0/1424166031 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac030610 con 0x7f10b0154250 2024-02-17T12:58:40.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.981+0000 7f10a7fff640 1 -- 172.21.15.136:0/1424166031 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac030770 con 0x7f10b0154250 2024-02-17T12:58:40.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.981+0000 7f10a7fff640 1 -- 172.21.15.136:0/1424166031 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac030b00 con 0x7f10b0154250 2024-02-17T12:58:40.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 -- 172.21.15.136:0/1424166031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 msgr2=0x7f10b006bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 --2- 172.21.15.136:0/1424166031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b006bbd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f10b006ddb0 tx=0x7f10ac02b960 comp rx=0 tx=0).stop 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 -- 172.21.15.136:0/1424166031 shutdown_connections 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 --2- 172.21.15.136:0/1424166031 >> v2:172.21.15.136:3300/0 conn(0x7f10b00c9930 0x7f10b015d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 --2- 172.21.15.136:0/1424166031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b006bbd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 -- 172.21.15.136:0/1424166031 >> 172.21.15.136:0/1424166031 conn(0x7f10b006fe80 msgr2=0x7f10b006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 -- 172.21.15.136:0/1424166031 shutdown_connections 2024-02-17T12:58:40.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.982+0000 7f10b750c640 1 -- 172.21.15.136:0/1424166031 wait complete. 2024-02-17T12:58:40.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.983+0000 7f10b750c640 1 Processor -- start 2024-02-17T12:58:40.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.983+0000 7f10b750c640 1 -- start start 2024-02-17T12:58:40.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.984+0000 7f10b750c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10b00c94f0 0x7f10b01f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.984+0000 7f10b750c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 0x7f10b0156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.984+0000 7f10b750c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:40.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.984+0000 7f10b750c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0156fd0 con 0x7f10b00c9930 2024-02-17T12:58:40.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.984+0000 7f10b750c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0157910 con 0x7f10b0154250 2024-02-17T12:58:40.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.984+0000 7f10b750c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b01f0c20 con 0x7f10b00c94f0 2024-02-17T12:58:40.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.985+0000 7f10b4aa7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 0x7f10b0156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.985+0000 7f10b4aa7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 0x7f10b0156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50584/0 (socket says 172.21.15.136:50584) 2024-02-17T12:58:40.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.985+0000 7f10b4aa7640 1 -- 172.21.15.136:0/2532623571 learned_addr learned my addr 172.21.15.136:0/2532623571 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:40.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.985+0000 7f10b52a8640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10b00c94f0 0x7f10b01f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.985+0000 7f10b5aa9640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:40.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.988+0000 7f10b4aa7640 1 -- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10b00c94f0 msgr2=0x7f10b01f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.988+0000 7f10b4aa7640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10b00c94f0 0x7f10b01f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.988+0000 7f10b4aa7640 1 -- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 msgr2=0x7f10b0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:40.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.988+0000 7f10b4aa7640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b0155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:40.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.988+0000 7f10b4aa7640 1 -- 172.21.15.136:0/2532623571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009400 con 0x7f10b00c9930 2024-02-17T12:58:40.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.990+0000 7f10b4aa7640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 0x7f10b0156a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c400 tx=0x7f10a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:40.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.993+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0005ce0 con 0x7f10b00c9930 2024-02-17T12:58:40.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.993+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0005e40 con 0x7f10b00c9930 2024-02-17T12:58:40.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.993+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b0155e40 con 0x7f10b00c9930 2024-02-17T12:58:40.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.993+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00072d0 con 0x7f10b00c9930 2024-02-17T12:58:40.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.994+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b0154e20 con 0x7f10b00c9930 2024-02-17T12:58:40.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:40.995+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b0067e00 con 0x7f10b00c9930 2024-02-17T12:58:41.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.014+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f10a00074f0 con 0x7f10b00c9930 2024-02-17T12:58:41.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.014+0000 7f10a5ffb640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f109406b860 0x7f109406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:41.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.014+0000 7f10b52a8640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f109406b860 0x7f109406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:41.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.015+0000 7f10b52a8640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f109406b860 0x7f109406dd20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10ac036000 tx=0x7f10ac03b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:41.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.249+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f10a00583f0 con 0x7f10b00c9930 2024-02-17T12:58:41.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.249+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10a0054690 con 0x7f10b00c9930 2024-02-17T12:58:41.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.492+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f10b006c8b0 con 0x7f10b00c9930 2024-02-17T12:58:41.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.517+0000 7f10a5ffb640 1 -- 172.21.15.136:0/2532623571 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3255 (secure 0 0 0) 0x7f10a0017080 con 0x7f10b00c9930 2024-02-17T12:58:41.509 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:41.509 INFO:teuthology.orchestra.run.smithi136.stdout:{"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":74,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":26,"num_osds":8,"num_up_osds":8,"osd_up_since":1708174661,"num_in_osds":8,"osd_in_since":1708174652,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":127},{"state_name":"activating","count":2}],"num_pgs":129,"num_pools":4,"num_objects":96,"data_bytes":600542,"bytes_used":224911360,"bytes_avail":772869201920,"bytes_total":773094113280,"inactive_pgs_ratio":0.015503875911235809,"write_bytes_sec":5886,"read_op_per_sec":0,"write_op_per_sec":18},"fsmap":{"epoch":18,"id":1,"up":5,"in":5,"max":5,"by_rank":[{"filesystem_id":1,"rank":4,"name":"d","status":"up:active","gid":4244},{"filesystem_id":1,"rank":3,"name":"f","status":"up:active","gid":4245},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":4248},{"filesystem_id":1,"rank":1,"name":"b","status":"up:active","gid":4288},{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4297}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-02-17T12:58:35.990908+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f109406b860 msgr2=0x7f109406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f109406b860 0x7f109406dd20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10ac036000 tx=0x7f10ac03b040 comp rx=0 tx=0).stop 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 msgr2=0x7f10b0156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 0x7f10b0156a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c400 tx=0x7f10a000c8c0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 shutdown_connections 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f109406b860 0x7f109406dd20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10b0154250 0x7f10b0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10b00c9930 0x7f10b0156a90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 --2- 172.21.15.136:0/2532623571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10b00c94f0 0x7f10b01f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 >> 172.21.15.136:0/2532623571 conn(0x7f10b006fe80 msgr2=0x7f10b00c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:41.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 shutdown_connections 2024-02-17T12:58:41.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.520+0000 7f10b750c640 1 -- 172.21.15.136:0/2532623571 wait complete. 2024-02-17T12:58:41.522 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-02-17T12:58:41.522 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:41.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.632+0000 7fb312dbc640 1 Processor -- start 2024-02-17T12:58:41.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.632+0000 7fb312dbc640 1 -- start start 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.632+0000 7fb312dbc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.632+0000 7fb312dbc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c158ba0 con 0x7fb30c0c5a20 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.632+0000 7fb312dbc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c06adb0 con 0x7fb30c151f10 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.632+0000 7fb312dbc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0c3590 con 0x7fb30c0c8a00 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.633+0000 7fb311359640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb30c0c5a20 0x7fb30c162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58830/0 (socket says 172.21.15.136:58830) 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.633+0000 7fb311359640 1 -- 172.21.15.136:0/927435919 learned_addr learned my addr 172.21.15.136:0/927435919 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:41.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.634+0000 7fb30bfff640 1 --2- 172.21.15.136:0/927435919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:41.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.635+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561419955 0 0) 0x7fb2f4001110 con 0x7fb30c0c5a20 2024-02-17T12:58:41.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.636+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f8003520 con 0x7fb30c0c5a20 2024-02-17T12:58:41.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.636+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280228190 0 0) 0x7fb30c06adb0 con 0x7fb30c151f10 2024-02-17T12:58:41.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.636+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f4001110 con 0x7fb30c151f10 2024-02-17T12:58:41.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.637+0000 7fb30bfff640 1 -- 172.21.15.136:0/927435919 >> v1:172.21.15.160:6789/0 conn(0x7fb30c151f10 legacy=0x7fb30c15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.637+0000 7fb30bfff640 1 -- 172.21.15.136:0/927435919 >> v1:172.21.15.136:6789/0 conn(0x7fb30c0c5a20 legacy=0x7fb30c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.637+0000 7fb30bfff640 1 -- 172.21.15.136:0/927435919 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0c6db0 con 0x7fb30c0c8a00 2024-02-17T12:58:41.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.640+0000 7fb30bfff640 1 --2- 172.21.15.136:0/927435919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c158660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0097d0 tx=0x7fb2fc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5b910bcdb1d2ae server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:41.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.644+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc031890 con 0x7fb30c0c8a00 2024-02-17T12:58:41.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.644+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0319f0 con 0x7fb30c0c8a00 2024-02-17T12:58:41.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.644+0000 7fb30b7fe640 1 -- 172.21.15.136:0/927435919 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc031d80 con 0x7fb30c0c8a00 2024-02-17T12:58:41.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 -- 172.21.15.136:0/927435919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 msgr2=0x7fb30c158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 --2- 172.21.15.136:0/927435919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c158660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0097d0 tx=0x7fb2fc02b930 comp rx=0 tx=0).stop 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 -- 172.21.15.136:0/927435919 shutdown_connections 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 --2- 172.21.15.136:0/927435919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c158660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 -- 172.21.15.136:0/927435919 >> 172.21.15.136:0/927435919 conn(0x7fb30c06bbd0 msgr2=0x7fb30c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 -- 172.21.15.136:0/927435919 shutdown_connections 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.645+0000 7fb312dbc640 1 -- 172.21.15.136:0/927435919 wait complete. 2024-02-17T12:58:41.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.646+0000 7fb312dbc640 1 Processor -- start 2024-02-17T12:58:41.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.646+0000 7fb312dbc640 1 -- start start 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.647+0000 7fb312dbc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 0x7fb30c147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.647+0000 7fb312dbc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.647+0000 7fb312dbc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c151f10 0x7fb30c159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.647+0000 7fb312dbc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c1e34c0 con 0x7fb30c0c5a20 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.647+0000 7fb312dbc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c1e2f40 con 0x7fb30c151f10 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.647+0000 7fb312dbc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c1e31e0 con 0x7fb30c0c8a00 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.648+0000 7fb310b58640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 0x7fb30c147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:41.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.648+0000 7fb311359640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c151f10 0x7fb30c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:41.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.648+0000 7fb310b58640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 0x7fb30c147cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35212/0 (socket says 172.21.15.136:35212) 2024-02-17T12:58:41.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.648+0000 7fb310b58640 1 -- 172.21.15.136:0/3512502459 learned_addr learned my addr 172.21.15.136:0/3512502459 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:41.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.649+0000 7fb30bfff640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:41.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.652+0000 7fb310b58640 1 -- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 msgr2=0x7fb30c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.652+0000 7fb310b58640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.652+0000 7fb310b58640 1 -- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c151f10 msgr2=0x7fb30c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:41.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.652+0000 7fb310b58640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c151f10 0x7fb30c159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:41.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.652+0000 7fb310b58640 1 -- 172.21.15.136:0/3512502459 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009400 con 0x7fb30c0c5a20 2024-02-17T12:58:41.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.654+0000 7fb310b58640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 0x7fb30c147cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c870 tx=0x7fb30400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:41.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.657+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304003b70 con 0x7fb30c0c5a20 2024-02-17T12:58:41.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.657+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb304003cf0 con 0x7fb30c0c5a20 2024-02-17T12:58:41.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.658+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0c0f00 con 0x7fb30c0c5a20 2024-02-17T12:58:41.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.658+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400aa90 con 0x7fb30c0c5a20 2024-02-17T12:58:41.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.658+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c0c1820 con 0x7fb30c0c5a20 2024-02-17T12:58:41.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.659+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0c0d60 con 0x7fb30c0c5a20 2024-02-17T12:58:41.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.677+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb30400abf0 con 0x7fb30c0c5a20 2024-02-17T12:58:41.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.678+0000 7fb3097fa640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb2ec06b860 0x7fb2ec06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:41.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.678+0000 7fb30bfff640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb2ec06b860 0x7fb2ec06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:41.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.678+0000 7fb30bfff640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb2ec06b860 0x7fb2ec06dd20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc036000 tx=0x7fb2fc03c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:41.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.913+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb3040590e0 con 0x7fb30c0c5a20 2024-02-17T12:58:41.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:41.914+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb304055380 con 0x7fb30c0c5a20 2024-02-17T12:58:42.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.098+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb30c06b8b0 con 0x7fb2ec06b860 2024-02-17T12:58:42.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.106+0000 7fb3097fa640 1 -- 172.21.15.136:0/3512502459 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345319 (secure 0 0 0) 0x7fb30c06b8b0 con 0x7fb2ec06b860 2024-02-17T12:58:42.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:42.104 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb2ec06b860 msgr2=0x7fb2ec06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb2ec06b860 0x7fb2ec06dd20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc036000 tx=0x7fb2fc03c040 comp rx=0 tx=0).stop 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 msgr2=0x7fb30c147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 0x7fb30c147cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c870 tx=0x7fb30400cd30 comp rx=0 tx=0).stop 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 shutdown_connections 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb2ec06b860 0x7fb2ec06dd20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:42.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c151f10 0x7fb30c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0c8a00 0x7fb30c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 --2- 172.21.15.136:0/3512502459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb30c0c5a20 0x7fb30c147cc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 >> 172.21.15.136:0/3512502459 conn(0x7fb30c06bbd0 msgr2=0x7fb30c150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 shutdown_connections 2024-02-17T12:58:42.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:42.110+0000 7fb312dbc640 1 -- 172.21.15.136:0/3512502459 wait complete. 2024-02-17T12:58:42.112 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-02-17T12:58:41.992067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":367,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219660,"kb_used_data":3516,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755060,"statfs":{"total":773094113280,"available":772869181440,"internally_reserved":0,"allocated":3600384,"data_stored":2078327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2924,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002121"},"pg_stats":[{"pgid":"2.1f","version":"25'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825510+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:37.825510+0000","last_peered":"2024-02-17T12:58:37.825510+0000","last_clean":"2024-02-17T12:58:37.825510+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:37.825510+0000","last_undegraded":"2024-02-17T12:58:37.825510+0000","last_fullsized":"2024-02-17T12:58:37.825510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449786+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:35.449786+0000","last_peered":"2024-02-17T12:58:35.449786+0000","last_clean":"2024-02-17T12:58:35.449786+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:35.449786+0000","last_undegraded":"2024-02-17T12:58:35.449786+0000","last_fullsized":"2024-02-17T12:58:35.449786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252135+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:37.252135+0000","last_peered":"2024-02-17T12:58:37.252135+0000","last_clean":"2024-02-17T12:58:37.252135+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:37.252135+0000","last_undegraded":"2024-02-17T12:58:37.252135+0000","last_fullsized":"2024-02-17T12:58:37.252135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449995+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:35.449995+0000","last_peered":"2024-02-17T12:58:35.449995+0000","last_clean":"2024-02-17T12:58:35.449995+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:35.449995+0000","last_undegraded":"2024-02-17T12:58:35.449995+0000","last_fullsized":"2024-02-17T12:58:35.449995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450004+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:35.450004+0000","last_peered":"2024-02-17T12:58:35.450004+0000","last_clean":"2024-02-17T12:58:35.450004+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:35.450004+0000","last_undegraded":"2024-02-17T12:58:35.450004+0000","last_fullsized":"2024-02-17T12:58:35.450004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250259+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:37.250259+0000","last_peered":"2024-02-17T12:58:37.250259+0000","last_clean":"2024-02-17T12:58:37.250259+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:37.250259+0000","last_undegraded":"2024-02-17T12:58:37.250259+0000","last_fullsized":"2024-02-17T12:58:37.250259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363936+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:37.363936+0000","last_peered":"2024-02-17T12:58:37.363936+0000","last_clean":"2024-02-17T12:58:37.363936+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:37.363936+0000","last_undegraded":"2024-02-17T12:58:37.363936+0000","last_fullsized":"2024-02-17T12:58:37.363936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454386+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:35.454386+0000","last_peered":"2024-02-17T12:58:35.454386+0000","last_clean":"2024-02-17T12:58:35.454386+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:35.454386+0000","last_undegraded":"2024-02-17T12:58:35.454386+0000","last_fullsized":"2024-02-17T12:58:35.454386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.324543+0000","last_change":"2024-02-17T12:58:37.250456+0000","last_active":"2024-02-17T12:58:35.446593+0000","last_peered":"2024-02-17T12:58:03.437264+0000","last_clean":"2024-02-17T12:58:03.437264+0000","last_became_active":"2024-02-17T12:58:02.529672+0000","last_became_peered":"2024-02-17T12:58:02.529672+0000","last_unstale":"2024-02-17T12:58:37.324543+0000","last_undegraded":"2024-02-17T12:58:37.324543+0000","last_fullsized":"2024-02-17T12:58:37.324543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":["2(0)","0(2)","3(2)","5(1)","6(3)"],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364065+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:37.364065+0000","last_peered":"2024-02-17T12:58:37.364065+0000","last_clean":"2024-02-17T12:58:37.364065+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:37.364065+0000","last_undegraded":"2024-02-17T12:58:37.364065+0000","last_fullsized":"2024-02-17T12:58:37.364065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248354+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:37.248354+0000","last_peered":"2024-02-17T12:58:37.248354+0000","last_clean":"2024-02-17T12:58:37.248354+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:37.248354+0000","last_undegraded":"2024-02-17T12:58:37.248354+0000","last_fullsized":"2024-02-17T12:58:37.248354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251301+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:37.251301+0000","last_peered":"2024-02-17T12:58:37.251301+0000","last_clean":"2024-02-17T12:58:37.251301+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:37.251301+0000","last_undegraded":"2024-02-17T12:58:37.251301+0000","last_fullsized":"2024-02-17T12:58:37.251301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248286+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:37.248286+0000","last_peered":"2024-02-17T12:58:37.248286+0000","last_clean":"2024-02-17T12:58:37.248286+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:37.248286+0000","last_undegraded":"2024-02-17T12:58:37.248286+0000","last_fullsized":"2024-02-17T12:58:37.248286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248415+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:37.248415+0000","last_peered":"2024-02-17T12:58:37.248415+0000","last_clean":"2024-02-17T12:58:37.248415+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:37.248415+0000","last_undegraded":"2024-02-17T12:58:37.248415+0000","last_fullsized":"2024-02-17T12:58:37.248415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248122+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:37.248122+0000","last_peered":"2024-02-17T12:58:37.248122+0000","last_clean":"2024-02-17T12:58:37.248122+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:37.248122+0000","last_undegraded":"2024-02-17T12:58:37.248122+0000","last_fullsized":"2024-02-17T12:58:37.248122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251582+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:37.251582+0000","last_peered":"2024-02-17T12:58:37.251582+0000","last_clean":"2024-02-17T12:58:37.251582+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:37.251582+0000","last_undegraded":"2024-02-17T12:58:37.251582+0000","last_fullsized":"2024-02-17T12:58:37.251582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324439+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:37.324439+0000","last_peered":"2024-02-17T12:58:37.324439+0000","last_clean":"2024-02-17T12:58:37.324439+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:37.324439+0000","last_undegraded":"2024-02-17T12:58:37.324439+0000","last_fullsized":"2024-02-17T12:58:37.324439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363560+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:37.363560+0000","last_peered":"2024-02-17T12:58:37.363560+0000","last_clean":"2024-02-17T12:58:37.363560+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:37.363560+0000","last_undegraded":"2024-02-17T12:58:37.363560+0000","last_fullsized":"2024-02-17T12:58:37.363560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.824934+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:37.824934+0000","last_peered":"2024-02-17T12:58:37.824934+0000","last_clean":"2024-02-17T12:58:37.824934+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:37.824934+0000","last_undegraded":"2024-02-17T12:58:37.824934+0000","last_fullsized":"2024-02-17T12:58:37.824934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825294+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:37.825294+0000","last_peered":"2024-02-17T12:58:37.825294+0000","last_clean":"2024-02-17T12:58:37.825294+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:37.825294+0000","last_undegraded":"2024-02-17T12:58:37.825294+0000","last_fullsized":"2024-02-17T12:58:37.825294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252567+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:37.252567+0000","last_peered":"2024-02-17T12:58:37.252567+0000","last_clean":"2024-02-17T12:58:37.252567+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:37.252567+0000","last_undegraded":"2024-02-17T12:58:37.252567+0000","last_fullsized":"2024-02-17T12:58:37.252567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247975+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:37.247975+0000","last_peered":"2024-02-17T12:58:37.247975+0000","last_clean":"2024-02-17T12:58:37.247975+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:37.247975+0000","last_undegraded":"2024-02-17T12:58:37.247975+0000","last_fullsized":"2024-02-17T12:58:37.247975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363471+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:37.363471+0000","last_peered":"2024-02-17T12:58:37.363471+0000","last_clean":"2024-02-17T12:58:37.363471+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:37.363471+0000","last_undegraded":"2024-02-17T12:58:37.363471+0000","last_fullsized":"2024-02-17T12:58:37.363471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251135+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:37.251135+0000","last_peered":"2024-02-17T12:58:37.251135+0000","last_clean":"2024-02-17T12:58:37.251135+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:37.251135+0000","last_undegraded":"2024-02-17T12:58:37.251135+0000","last_fullsized":"2024-02-17T12:58:37.251135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825216+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:37.825216+0000","last_peered":"2024-02-17T12:58:37.825216+0000","last_clean":"2024-02-17T12:58:37.825216+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:37.825216+0000","last_undegraded":"2024-02-17T12:58:37.825216+0000","last_fullsized":"2024-02-17T12:58:37.825216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248929+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:37.248929+0000","last_peered":"2024-02-17T12:58:37.248929+0000","last_clean":"2024-02-17T12:58:37.248929+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:37.248929+0000","last_undegraded":"2024-02-17T12:58:37.248929+0000","last_fullsized":"2024-02-17T12:58:37.248929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250402+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:37.250402+0000","last_peered":"2024-02-17T12:58:37.250402+0000","last_clean":"2024-02-17T12:58:37.250402+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:37.250402+0000","last_undegraded":"2024-02-17T12:58:37.250402+0000","last_fullsized":"2024-02-17T12:58:37.250402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825452+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:37.825452+0000","last_peered":"2024-02-17T12:58:37.825452+0000","last_clean":"2024-02-17T12:58:37.825452+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:37.825452+0000","last_undegraded":"2024-02-17T12:58:37.825452+0000","last_fullsized":"2024-02-17T12:58:37.825452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825380+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:37.825380+0000","last_peered":"2024-02-17T12:58:37.825380+0000","last_clean":"2024-02-17T12:58:37.825380+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:37.825380+0000","last_undegraded":"2024-02-17T12:58:37.825380+0000","last_fullsized":"2024-02-17T12:58:37.825380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.824939+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:37.824939+0000","last_peered":"2024-02-17T12:58:37.824939+0000","last_clean":"2024-02-17T12:58:37.824939+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:37.824939+0000","last_undegraded":"2024-02-17T12:58:37.824939+0000","last_fullsized":"2024-02-17T12:58:37.824939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324493+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:37.324493+0000","last_peered":"2024-02-17T12:58:37.324493+0000","last_clean":"2024-02-17T12:58:37.324493+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:37.324493+0000","last_undegraded":"2024-02-17T12:58:37.324493+0000","last_fullsized":"2024-02-17T12:58:37.324493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248623+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:37.248623+0000","last_peered":"2024-02-17T12:58:37.248623+0000","last_clean":"2024-02-17T12:58:37.248623+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:37.248623+0000","last_undegraded":"2024-02-17T12:58:37.248623+0000","last_fullsized":"2024-02-17T12:58:37.248623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324212+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:37.324212+0000","last_peered":"2024-02-17T12:58:37.324212+0000","last_clean":"2024-02-17T12:58:37.324212+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:37.324212+0000","last_undegraded":"2024-02-17T12:58:37.324212+0000","last_fullsized":"2024-02-17T12:58:37.324212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250988+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:37.250988+0000","last_peered":"2024-02-17T12:58:37.250988+0000","last_clean":"2024-02-17T12:58:37.250988+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:37.250988+0000","last_undegraded":"2024-02-17T12:58:37.250988+0000","last_fullsized":"2024-02-17T12:58:37.250988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450301+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:35.450301+0000","last_peered":"2024-02-17T12:58:35.450301+0000","last_clean":"2024-02-17T12:58:35.450301+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:35.450301+0000","last_undegraded":"2024-02-17T12:58:35.450301+0000","last_fullsized":"2024-02-17T12:58:35.450301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324026+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:37.324026+0000","last_peered":"2024-02-17T12:58:37.324026+0000","last_clean":"2024-02-17T12:58:37.324026+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:37.324026+0000","last_undegraded":"2024-02-17T12:58:37.324026+0000","last_fullsized":"2024-02-17T12:58:37.324026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363882+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:37.363882+0000","last_peered":"2024-02-17T12:58:37.363882+0000","last_clean":"2024-02-17T12:58:37.363882+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:37.363882+0000","last_undegraded":"2024-02-17T12:58:37.363882+0000","last_fullsized":"2024-02-17T12:58:37.363882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248625+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:37.248625+0000","last_peered":"2024-02-17T12:58:37.248625+0000","last_clean":"2024-02-17T12:58:37.248625+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:37.248625+0000","last_undegraded":"2024-02-17T12:58:37.248625+0000","last_fullsized":"2024-02-17T12:58:37.248625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324381+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:37.324381+0000","last_peered":"2024-02-17T12:58:37.324381+0000","last_clean":"2024-02-17T12:58:37.324381+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:37.324381+0000","last_undegraded":"2024-02-17T12:58:37.324381+0000","last_fullsized":"2024-02-17T12:58:37.324381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449065+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:35.449065+0000","last_peered":"2024-02-17T12:58:35.449065+0000","last_clean":"2024-02-17T12:58:35.449065+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:35.449065+0000","last_undegraded":"2024-02-17T12:58:35.449065+0000","last_fullsized":"2024-02-17T12:58:35.449065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251333+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:37.251333+0000","last_peered":"2024-02-17T12:58:37.251333+0000","last_clean":"2024-02-17T12:58:37.251333+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:37.251333+0000","last_undegraded":"2024-02-17T12:58:37.251333+0000","last_fullsized":"2024-02-17T12:58:37.251333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324268+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:37.324268+0000","last_peered":"2024-02-17T12:58:37.324268+0000","last_clean":"2024-02-17T12:58:37.324268+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:37.324268+0000","last_undegraded":"2024-02-17T12:58:37.324268+0000","last_fullsized":"2024-02-17T12:58:37.324268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.323981+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:37.323981+0000","last_peered":"2024-02-17T12:58:37.323981+0000","last_clean":"2024-02-17T12:58:37.323981+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:37.323981+0000","last_undegraded":"2024-02-17T12:58:37.323981+0000","last_fullsized":"2024-02-17T12:58:37.323981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247892+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:37.247892+0000","last_peered":"2024-02-17T12:58:37.247892+0000","last_clean":"2024-02-17T12:58:37.247892+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:37.247892+0000","last_undegraded":"2024-02-17T12:58:37.247892+0000","last_fullsized":"2024-02-17T12:58:37.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449414+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:35.449414+0000","last_peered":"2024-02-17T12:58:35.449414+0000","last_clean":"2024-02-17T12:58:35.449414+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:35.449414+0000","last_undegraded":"2024-02-17T12:58:35.449414+0000","last_fullsized":"2024-02-17T12:58:35.449414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825079+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:37.825079+0000","last_peered":"2024-02-17T12:58:37.825079+0000","last_clean":"2024-02-17T12:58:37.825079+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:37.825079+0000","last_undegraded":"2024-02-17T12:58:37.825079+0000","last_fullsized":"2024-02-17T12:58:37.825079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453996+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:35.453996+0000","last_peered":"2024-02-17T12:58:35.453996+0000","last_clean":"2024-02-17T12:58:35.453996+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:35.453996+0000","last_undegraded":"2024-02-17T12:58:35.453996+0000","last_fullsized":"2024-02-17T12:58:35.453996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324559+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:37.324559+0000","last_peered":"2024-02-17T12:58:37.324559+0000","last_clean":"2024-02-17T12:58:37.324559+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:37.324559+0000","last_undegraded":"2024-02-17T12:58:37.324559+0000","last_fullsized":"2024-02-17T12:58:37.324559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250612+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:37.250612+0000","last_peered":"2024-02-17T12:58:37.250612+0000","last_clean":"2024-02-17T12:58:37.250612+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:37.250612+0000","last_undegraded":"2024-02-17T12:58:37.250612+0000","last_fullsized":"2024-02-17T12:58:37.250612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363999+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:37.363999+0000","last_peered":"2024-02-17T12:58:37.363999+0000","last_clean":"2024-02-17T12:58:37.363999+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:37.363999+0000","last_undegraded":"2024-02-17T12:58:37.363999+0000","last_fullsized":"2024-02-17T12:58:37.363999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450641+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:35.450641+0000","last_peered":"2024-02-17T12:58:35.450641+0000","last_clean":"2024-02-17T12:58:35.450641+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:35.450641+0000","last_undegraded":"2024-02-17T12:58:35.450641+0000","last_fullsized":"2024-02-17T12:58:35.450641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449570+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:35.449570+0000","last_peered":"2024-02-17T12:58:35.449570+0000","last_clean":"2024-02-17T12:58:35.449570+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:35.449570+0000","last_undegraded":"2024-02-17T12:58:35.449570+0000","last_fullsized":"2024-02-17T12:58:35.449570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363983+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:37.363983+0000","last_peered":"2024-02-17T12:58:37.363983+0000","last_clean":"2024-02-17T12:58:37.363983+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:37.363983+0000","last_undegraded":"2024-02-17T12:58:37.363983+0000","last_fullsized":"2024-02-17T12:58:37.363983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825316+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:37.825316+0000","last_peered":"2024-02-17T12:58:37.825316+0000","last_clean":"2024-02-17T12:58:37.825316+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:37.825316+0000","last_undegraded":"2024-02-17T12:58:37.825316+0000","last_fullsized":"2024-02-17T12:58:37.825316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247666+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:37.247666+0000","last_peered":"2024-02-17T12:58:37.247666+0000","last_clean":"2024-02-17T12:58:37.247666+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:37.247666+0000","last_undegraded":"2024-02-17T12:58:37.247666+0000","last_fullsized":"2024-02-17T12:58:37.247666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251231+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:37.251231+0000","last_peered":"2024-02-17T12:58:37.251231+0000","last_clean":"2024-02-17T12:58:37.251231+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:37.251231+0000","last_undegraded":"2024-02-17T12:58:37.251231+0000","last_fullsized":"2024-02-17T12:58:37.251231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364174+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:37.364174+0000","last_peered":"2024-02-17T12:58:37.364174+0000","last_clean":"2024-02-17T12:58:37.364174+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:37.364174+0000","last_undegraded":"2024-02-17T12:58:37.364174+0000","last_fullsized":"2024-02-17T12:58:37.364174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453399+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:35.453399+0000","last_peered":"2024-02-17T12:58:35.453399+0000","last_clean":"2024-02-17T12:58:35.453399+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:35.453399+0000","last_undegraded":"2024-02-17T12:58:35.453399+0000","last_fullsized":"2024-02-17T12:58:35.453399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247880+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:37.247880+0000","last_peered":"2024-02-17T12:58:37.247880+0000","last_clean":"2024-02-17T12:58:37.247880+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:37.247880+0000","last_undegraded":"2024-02-17T12:58:37.247880+0000","last_fullsized":"2024-02-17T12:58:37.247880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825170+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:37.825170+0000","last_peered":"2024-02-17T12:58:37.825170+0000","last_clean":"2024-02-17T12:58:37.825170+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:37.825170+0000","last_undegraded":"2024-02-17T12:58:37.825170+0000","last_fullsized":"2024-02-17T12:58:37.825170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449691+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:35.449691+0000","last_peered":"2024-02-17T12:58:35.449691+0000","last_clean":"2024-02-17T12:58:35.449691+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:35.449691+0000","last_undegraded":"2024-02-17T12:58:35.449691+0000","last_fullsized":"2024-02-17T12:58:35.449691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453774+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:35.453774+0000","last_peered":"2024-02-17T12:58:35.453774+0000","last_clean":"2024-02-17T12:58:35.453774+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:35.453774+0000","last_undegraded":"2024-02-17T12:58:35.453774+0000","last_fullsized":"2024-02-17T12:58:35.453774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363771+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:37.363771+0000","last_peered":"2024-02-17T12:58:37.363771+0000","last_clean":"2024-02-17T12:58:37.363771+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:37.363771+0000","last_undegraded":"2024-02-17T12:58:37.363771+0000","last_fullsized":"2024-02-17T12:58:37.363771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449906+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:35.449906+0000","last_peered":"2024-02-17T12:58:35.449906+0000","last_clean":"2024-02-17T12:58:35.449906+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:35.449906+0000","last_undegraded":"2024-02-17T12:58:35.449906+0000","last_fullsized":"2024-02-17T12:58:35.449906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248256+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:37.248256+0000","last_peered":"2024-02-17T12:58:37.248256+0000","last_clean":"2024-02-17T12:58:37.248256+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:37.248256+0000","last_undegraded":"2024-02-17T12:58:37.248256+0000","last_fullsized":"2024-02-17T12:58:37.248256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248528+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:37.248528+0000","last_peered":"2024-02-17T12:58:37.248528+0000","last_clean":"2024-02-17T12:58:37.248528+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:37.248528+0000","last_undegraded":"2024-02-17T12:58:37.248528+0000","last_fullsized":"2024-02-17T12:58:37.248528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324198+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:37.324198+0000","last_peered":"2024-02-17T12:58:37.324198+0000","last_clean":"2024-02-17T12:58:37.324198+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:37.324198+0000","last_undegraded":"2024-02-17T12:58:37.324198+0000","last_fullsized":"2024-02-17T12:58:37.324198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324160+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:37.324160+0000","last_peered":"2024-02-17T12:58:37.324160+0000","last_clean":"2024-02-17T12:58:37.324160+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:37.324160+0000","last_undegraded":"2024-02-17T12:58:37.324160+0000","last_fullsized":"2024-02-17T12:58:37.324160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251902+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:37.251902+0000","last_peered":"2024-02-17T12:58:37.251902+0000","last_clean":"2024-02-17T12:58:37.251902+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:37.251902+0000","last_undegraded":"2024-02-17T12:58:37.251902+0000","last_fullsized":"2024-02-17T12:58:37.251902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248263+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:37.248263+0000","last_peered":"2024-02-17T12:58:37.248263+0000","last_clean":"2024-02-17T12:58:37.248263+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:37.248263+0000","last_undegraded":"2024-02-17T12:58:37.248263+0000","last_fullsized":"2024-02-17T12:58:37.248263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363833+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:37.363833+0000","last_peered":"2024-02-17T12:58:37.363833+0000","last_clean":"2024-02-17T12:58:37.363833+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:37.363833+0000","last_undegraded":"2024-02-17T12:58:37.363833+0000","last_fullsized":"2024-02-17T12:58:37.363833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250807+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:37.250807+0000","last_peered":"2024-02-17T12:58:37.250807+0000","last_clean":"2024-02-17T12:58:37.250807+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:37.250807+0000","last_undegraded":"2024-02-17T12:58:37.250807+0000","last_fullsized":"2024-02-17T12:58:37.250807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825007+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:37.825007+0000","last_peered":"2024-02-17T12:58:37.825007+0000","last_clean":"2024-02-17T12:58:37.825007+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:37.825007+0000","last_undegraded":"2024-02-17T12:58:37.825007+0000","last_fullsized":"2024-02-17T12:58:37.825007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248015+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:37.248015+0000","last_peered":"2024-02-17T12:58:37.248015+0000","last_clean":"2024-02-17T12:58:37.248015+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:37.248015+0000","last_undegraded":"2024-02-17T12:58:37.248015+0000","last_fullsized":"2024-02-17T12:58:37.248015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252276+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:37.252276+0000","last_peered":"2024-02-17T12:58:37.252276+0000","last_clean":"2024-02-17T12:58:37.252276+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:37.252276+0000","last_undegraded":"2024-02-17T12:58:37.252276+0000","last_fullsized":"2024-02-17T12:58:37.252276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250675+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:37.250675+0000","last_peered":"2024-02-17T12:58:37.250675+0000","last_clean":"2024-02-17T12:58:37.250675+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:37.250675+0000","last_undegraded":"2024-02-17T12:58:37.250675+0000","last_fullsized":"2024-02-17T12:58:37.250675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450071+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.450071+0000","last_peered":"2024-02-17T12:58:35.450071+0000","last_clean":"2024-02-17T12:58:35.450071+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:35.450071+0000","last_undegraded":"2024-02-17T12:58:35.450071+0000","last_fullsized":"2024-02-17T12:58:35.450071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364124+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:37.364124+0000","last_peered":"2024-02-17T12:58:37.364124+0000","last_clean":"2024-02-17T12:58:37.364124+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:37.364124+0000","last_undegraded":"2024-02-17T12:58:37.364124+0000","last_fullsized":"2024-02-17T12:58:37.364124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251083+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:37.251083+0000","last_peered":"2024-02-17T12:58:37.251083+0000","last_clean":"2024-02-17T12:58:37.251083+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:37.251083+0000","last_undegraded":"2024-02-17T12:58:37.251083+0000","last_fullsized":"2024-02-17T12:58:37.251083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251217+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:37.251217+0000","last_peered":"2024-02-17T12:58:37.251217+0000","last_clean":"2024-02-17T12:58:37.251217+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:37.251217+0000","last_undegraded":"2024-02-17T12:58:37.251217+0000","last_fullsized":"2024-02-17T12:58:37.251217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454832+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:35.454832+0000","last_peered":"2024-02-17T12:58:35.454832+0000","last_clean":"2024-02-17T12:58:35.454832+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:35.454832+0000","last_undegraded":"2024-02-17T12:58:35.454832+0000","last_fullsized":"2024-02-17T12:58:35.454832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825120+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:37.825120+0000","last_peered":"2024-02-17T12:58:37.825120+0000","last_clean":"2024-02-17T12:58:37.825120+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:37.825120+0000","last_undegraded":"2024-02-17T12:58:37.825120+0000","last_fullsized":"2024-02-17T12:58:37.825120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825265+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:37.825265+0000","last_peered":"2024-02-17T12:58:37.825265+0000","last_clean":"2024-02-17T12:58:37.825265+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:37.825265+0000","last_undegraded":"2024-02-17T12:58:37.825265+0000","last_fullsized":"2024-02-17T12:58:37.825265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825214+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:37.825214+0000","last_peered":"2024-02-17T12:58:37.825214+0000","last_clean":"2024-02-17T12:58:37.825214+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:37.825214+0000","last_undegraded":"2024-02-17T12:58:37.825214+0000","last_fullsized":"2024-02-17T12:58:37.825214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247856+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:37.247856+0000","last_peered":"2024-02-17T12:58:37.247856+0000","last_clean":"2024-02-17T12:58:37.247856+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:37.247856+0000","last_undegraded":"2024-02-17T12:58:37.247856+0000","last_fullsized":"2024-02-17T12:58:37.247856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248706+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:37.248706+0000","last_peered":"2024-02-17T12:58:37.248706+0000","last_clean":"2024-02-17T12:58:37.248706+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:37.248706+0000","last_undegraded":"2024-02-17T12:58:37.248706+0000","last_fullsized":"2024-02-17T12:58:37.248706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449178+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:35.449178+0000","last_peered":"2024-02-17T12:58:35.449178+0000","last_clean":"2024-02-17T12:58:35.449178+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:35.449178+0000","last_undegraded":"2024-02-17T12:58:35.449178+0000","last_fullsized":"2024-02-17T12:58:35.449178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324017+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:37.324017+0000","last_peered":"2024-02-17T12:58:37.324017+0000","last_clean":"2024-02-17T12:58:37.324017+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:37.324017+0000","last_undegraded":"2024-02-17T12:58:37.324017+0000","last_fullsized":"2024-02-17T12:58:37.324017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825102+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:37.825102+0000","last_peered":"2024-02-17T12:58:37.825102+0000","last_clean":"2024-02-17T12:58:37.825102+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:37.825102+0000","last_undegraded":"2024-02-17T12:58:37.825102+0000","last_fullsized":"2024-02-17T12:58:37.825102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825379+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:37.825379+0000","last_peered":"2024-02-17T12:58:37.825379+0000","last_clean":"2024-02-17T12:58:37.825379+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:37.825379+0000","last_undegraded":"2024-02-17T12:58:37.825379+0000","last_fullsized":"2024-02-17T12:58:37.825379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449679+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:35.449679+0000","last_peered":"2024-02-17T12:58:35.449679+0000","last_clean":"2024-02-17T12:58:35.449679+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:35.449679+0000","last_undegraded":"2024-02-17T12:58:35.449679+0000","last_fullsized":"2024-02-17T12:58:35.449679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454124+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:35.454124+0000","last_peered":"2024-02-17T12:58:35.454124+0000","last_clean":"2024-02-17T12:58:35.454124+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:35.454124+0000","last_undegraded":"2024-02-17T12:58:35.454124+0000","last_fullsized":"2024-02-17T12:58:35.454124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":5,"reported_epoch":26,"state":"activating","last_fresh":"2024-02-17T12:58:37.250879+0000","last_change":"2024-02-17T12:58:37.250879+0000","last_active":"2024-02-17T12:58:01.234263+0000","last_peered":"2024-02-17T12:58:01.234263+0000","last_clean":"2024-02-17T12:58:01.234263+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:58:37.250879+0000","last_undegraded":"2024-02-17T12:58:37.250879+0000","last_fullsized":"2024-02-17T12:58:37.250879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":["2(0)","0(3)","1(2)","5(1)","7(0)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250452+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:37.250452+0000","last_peered":"2024-02-17T12:58:37.250452+0000","last_clean":"2024-02-17T12:58:37.250452+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:37.250452+0000","last_undegraded":"2024-02-17T12:58:37.250452+0000","last_fullsized":"2024-02-17T12:58:37.250452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251224+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:37.251224+0000","last_peered":"2024-02-17T12:58:37.251224+0000","last_clean":"2024-02-17T12:58:37.251224+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:37.251224+0000","last_undegraded":"2024-02-17T12:58:37.251224+0000","last_fullsized":"2024-02-17T12:58:37.251224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248199+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:37.248199+0000","last_peered":"2024-02-17T12:58:37.248199+0000","last_clean":"2024-02-17T12:58:37.248199+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:37.248199+0000","last_undegraded":"2024-02-17T12:58:37.248199+0000","last_fullsized":"2024-02-17T12:58:37.248199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449596+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:35.449596+0000","last_peered":"2024-02-17T12:58:35.449596+0000","last_clean":"2024-02-17T12:58:35.449596+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:35.449596+0000","last_undegraded":"2024-02-17T12:58:35.449596+0000","last_fullsized":"2024-02-17T12:58:35.449596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324471+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:37.324471+0000","last_peered":"2024-02-17T12:58:37.324471+0000","last_clean":"2024-02-17T12:58:37.324471+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:37.324471+0000","last_undegraded":"2024-02-17T12:58:37.324471+0000","last_fullsized":"2024-02-17T12:58:37.324471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324153+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:37.324153+0000","last_peered":"2024-02-17T12:58:37.324153+0000","last_clean":"2024-02-17T12:58:37.324153+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:37.324153+0000","last_undegraded":"2024-02-17T12:58:37.324153+0000","last_fullsized":"2024-02-17T12:58:37.324153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251155+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:37.251155+0000","last_peered":"2024-02-17T12:58:37.251155+0000","last_clean":"2024-02-17T12:58:37.251155+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:37.251155+0000","last_undegraded":"2024-02-17T12:58:37.251155+0000","last_fullsized":"2024-02-17T12:58:37.251155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449798+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:35.449798+0000","last_peered":"2024-02-17T12:58:35.449798+0000","last_clean":"2024-02-17T12:58:35.449798+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:35.449798+0000","last_undegraded":"2024-02-17T12:58:35.449798+0000","last_fullsized":"2024-02-17T12:58:35.449798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247786+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:37.247786+0000","last_peered":"2024-02-17T12:58:37.247786+0000","last_clean":"2024-02-17T12:58:37.247786+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:37.247786+0000","last_undegraded":"2024-02-17T12:58:37.247786+0000","last_fullsized":"2024-02-17T12:58:37.247786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449437+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:35.449437+0000","last_peered":"2024-02-17T12:58:35.449437+0000","last_clean":"2024-02-17T12:58:35.449437+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:35.449437+0000","last_undegraded":"2024-02-17T12:58:35.449437+0000","last_fullsized":"2024-02-17T12:58:35.449437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.453645+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:35.453645+0000","last_peered":"2024-02-17T12:58:35.453645+0000","last_clean":"2024-02-17T12:58:35.453645+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:35.453645+0000","last_undegraded":"2024-02-17T12:58:35.453645+0000","last_fullsized":"2024-02-17T12:58:35.453645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825255+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:37.825255+0000","last_peered":"2024-02-17T12:58:37.825255+0000","last_clean":"2024-02-17T12:58:37.825255+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:37.825255+0000","last_undegraded":"2024-02-17T12:58:37.825255+0000","last_fullsized":"2024-02-17T12:58:37.825255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.741377+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T12:58:37.741377+0000","last_peered":"2024-02-17T12:58:37.741377+0000","last_clean":"2024-02-17T12:58:37.741377+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T12:58:37.741377+0000","last_undegraded":"2024-02-17T12:58:37.741377+0000","last_fullsized":"2024-02-17T12:58:37.741377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248600+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:37.248600+0000","last_peered":"2024-02-17T12:58:37.248600+0000","last_clean":"2024-02-17T12:58:37.248600+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:37.248600+0000","last_undegraded":"2024-02-17T12:58:37.248600+0000","last_fullsized":"2024-02-17T12:58:37.248600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252206+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:37.252206+0000","last_peered":"2024-02-17T12:58:37.252206+0000","last_clean":"2024-02-17T12:58:37.252206+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:37.252206+0000","last_undegraded":"2024-02-17T12:58:37.252206+0000","last_fullsized":"2024-02-17T12:58:37.252206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248852+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:37.248852+0000","last_peered":"2024-02-17T12:58:37.248852+0000","last_clean":"2024-02-17T12:58:37.248852+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:37.248852+0000","last_undegraded":"2024-02-17T12:58:37.248852+0000","last_fullsized":"2024-02-17T12:58:37.248852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247763+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:37.247763+0000","last_peered":"2024-02-17T12:58:37.247763+0000","last_clean":"2024-02-17T12:58:37.247763+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:37.247763+0000","last_undegraded":"2024-02-17T12:58:37.247763+0000","last_fullsized":"2024-02-17T12:58:37.247763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449274+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:35.449274+0000","last_peered":"2024-02-17T12:58:35.449274+0000","last_clean":"2024-02-17T12:58:35.449274+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:35.449274+0000","last_undegraded":"2024-02-17T12:58:35.449274+0000","last_fullsized":"2024-02-17T12:58:35.449274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324058+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:37.324058+0000","last_peered":"2024-02-17T12:58:37.324058+0000","last_clean":"2024-02-17T12:58:37.324058+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:37.324058+0000","last_undegraded":"2024-02-17T12:58:37.324058+0000","last_fullsized":"2024-02-17T12:58:37.324058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324329+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:37.324329+0000","last_peered":"2024-02-17T12:58:37.324329+0000","last_clean":"2024-02-17T12:58:37.324329+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:37.324329+0000","last_undegraded":"2024-02-17T12:58:37.324329+0000","last_fullsized":"2024-02-17T12:58:37.324329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363917+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:37.363917+0000","last_peered":"2024-02-17T12:58:37.363917+0000","last_clean":"2024-02-17T12:58:37.363917+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:37.363917+0000","last_undegraded":"2024-02-17T12:58:37.363917+0000","last_fullsized":"2024-02-17T12:58:37.363917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363804+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:37.363804+0000","last_peered":"2024-02-17T12:58:37.363804+0000","last_clean":"2024-02-17T12:58:37.363804+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:37.363804+0000","last_undegraded":"2024-02-17T12:58:37.363804+0000","last_fullsized":"2024-02-17T12:58:37.363804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363645+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:37.363645+0000","last_peered":"2024-02-17T12:58:37.363645+0000","last_clean":"2024-02-17T12:58:37.363645+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:37.363645+0000","last_undegraded":"2024-02-17T12:58:37.363645+0000","last_fullsized":"2024-02-17T12:58:37.363645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.454803+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:35.454803+0000","last_peered":"2024-02-17T12:58:35.454803+0000","last_clean":"2024-02-17T12:58:35.454803+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:35.454803+0000","last_undegraded":"2024-02-17T12:58:35.454803+0000","last_fullsized":"2024-02-17T12:58:35.454803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449023+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:35.449023+0000","last_peered":"2024-02-17T12:58:35.449023+0000","last_clean":"2024-02-17T12:58:35.449023+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:35.449023+0000","last_undegraded":"2024-02-17T12:58:35.449023+0000","last_fullsized":"2024-02-17T12:58:35.449023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363643+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:37.363643+0000","last_peered":"2024-02-17T12:58:37.363643+0000","last_clean":"2024-02-17T12:58:37.363643+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:37.363643+0000","last_undegraded":"2024-02-17T12:58:37.363643+0000","last_fullsized":"2024-02-17T12:58:37.363643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251191+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:37.251191+0000","last_peered":"2024-02-17T12:58:37.251191+0000","last_clean":"2024-02-17T12:58:37.251191+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:37.251191+0000","last_undegraded":"2024-02-17T12:58:37.251191+0000","last_fullsized":"2024-02-17T12:58:37.251191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363883+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:37.363883+0000","last_peered":"2024-02-17T12:58:37.363883+0000","last_clean":"2024-02-17T12:58:37.363883+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:37.363883+0000","last_undegraded":"2024-02-17T12:58:37.363883+0000","last_fullsized":"2024-02-17T12:58:37.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250720+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:37.250720+0000","last_peered":"2024-02-17T12:58:37.250720+0000","last_clean":"2024-02-17T12:58:37.250720+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:37.250720+0000","last_undegraded":"2024-02-17T12:58:37.250720+0000","last_fullsized":"2024-02-17T12:58:37.250720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.450393+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:35.450393+0000","last_peered":"2024-02-17T12:58:35.450393+0000","last_clean":"2024-02-17T12:58:35.450393+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:35.450393+0000","last_undegraded":"2024-02-17T12:58:35.450393+0000","last_fullsized":"2024-02-17T12:58:35.450393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T12:58:35.449588+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:35.449588+0000","last_peered":"2024-02-17T12:58:35.449588+0000","last_clean":"2024-02-17T12:58:35.449588+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:35.449588+0000","last_undegraded":"2024-02-17T12:58:35.449588+0000","last_fullsized":"2024-02-17T12:58:35.449588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364223+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:37.364223+0000","last_peered":"2024-02-17T12:58:37.364223+0000","last_clean":"2024-02-17T12:58:37.364223+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:37.364223+0000","last_undegraded":"2024-02-17T12:58:37.364223+0000","last_fullsized":"2024-02-17T12:58:37.364223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":182,"ondisk_log_size":182,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":115059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":109550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":884736,"data_stored":698364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":119685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":109090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":698952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":109712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:45.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:58:45.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.233+0000 7f5d5f439640 1 Processor -- start 2024-02-17T12:58:45.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.233+0000 7f5d5f439640 1 -- start start 2024-02-17T12:58:45.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.234+0000 7f5d5f439640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 0x7f5d580c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.234+0000 7f5d5f439640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5d580c7e30 0x7f5d58070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.234+0000 7f5d5f439640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d580c9d20 con 0x7f5d580c4340 2024-02-17T12:58:45.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.234+0000 7f5d5f439640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5806bf20 con 0x7f5d580c7e30 2024-02-17T12:58:45.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.234+0000 7f5d5f439640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5806cd20 con 0x7f5d58157430 2024-02-17T12:58:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.235+0000 7f5d5d9d6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5d580c7e30 0x7f5d58070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.235+0000 7f5d5d1d5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 0x7f5d580c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.235+0000 7f5d5d1d5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 0x7f5d580c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:57656/0 (socket says 172.21.15.136:57656) 2024-02-17T12:58:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.235+0000 7f5d5d1d5640 1 -- 172.21.15.136:0/1185347504 learned_addr learned my addr 172.21.15.136:0/1185347504 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.238+0000 7f5d5d1d5640 1 -- 172.21.15.136:0/1185347504 >> v2:172.21.15.136:3300/0 conn(0x7f5d580c7e30 msgr2=0x7f5d58070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.238+0000 7f5d5d1d5640 1 --2- 172.21.15.136:0/1185347504 >> v2:172.21.15.136:3300/0 conn(0x7f5d580c7e30 0x7f5d58070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.238+0000 7f5d5d1d5640 1 -- 172.21.15.136:0/1185347504 >> v1:172.21.15.136:6789/0 conn(0x7f5d580c4340 legacy=0x7f5d5815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.238+0000 7f5d5d1d5640 1 -- 172.21.15.136:0/1185347504 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5806bbd0 con 0x7f5d58157430 2024-02-17T12:58:45.231 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.240+0000 7f5d5d1d5640 1 --2- 172.21.15.136:0/1185347504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 0x7f5d580c9700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009e50 tx=0x7f5d5402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6940cbca95053c3e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:45.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.243+0000 7f5d4ffff640 1 -- 172.21.15.136:0/1185347504 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5402cb00 con 0x7f5d58157430 2024-02-17T12:58:45.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.243+0000 7f5d4ffff640 1 -- 172.21.15.136:0/1185347504 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5402cc60 con 0x7f5d58157430 2024-02-17T12:58:45.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.243+0000 7f5d4ffff640 1 -- 172.21.15.136:0/1185347504 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d540343f0 con 0x7f5d58157430 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 -- 172.21.15.136:0/1185347504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 msgr2=0x7f5d580c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 --2- 172.21.15.136:0/1185347504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 0x7f5d580c9700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009e50 tx=0x7f5d5402bf60 comp rx=0 tx=0).stop 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 -- 172.21.15.136:0/1185347504 shutdown_connections 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 --2- 172.21.15.136:0/1185347504 >> v2:172.21.15.136:3300/0 conn(0x7f5d580c7e30 0x7f5d58070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 --2- 172.21.15.136:0/1185347504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d58157430 0x7f5d580c9700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 -- 172.21.15.136:0/1185347504 >> 172.21.15.136:0/1185347504 conn(0x7f5d5806fe80 msgr2=0x7f5d5806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 -- 172.21.15.136:0/1185347504 shutdown_connections 2024-02-17T12:58:45.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.244+0000 7f5d5f439640 1 -- 172.21.15.136:0/1185347504 wait complete. 2024-02-17T12:58:45.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.245+0000 7f5d5f439640 1 Processor -- start 2024-02-17T12:58:45.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.245+0000 7f5d5f439640 1 -- start start 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.246+0000 7f5d5f439640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d580c4340 0x7f5d580cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.246+0000 7f5d5f439640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d580c7e30 0x7f5d581f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.246+0000 7f5d5f439640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 0x7f5d581555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.246+0000 7f5d5f439640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580cd0f0 con 0x7f5d58157430 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.246+0000 7f5d5f439640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d581f3500 con 0x7f5d580c4340 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.246+0000 7f5d5f439640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580cc180 con 0x7f5d580c7e30 2024-02-17T12:58:45.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.247+0000 7f5d5d9d6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 0x7f5d581555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.247+0000 7f5d5d9d6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 0x7f5d581555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35232/0 (socket says 172.21.15.136:35232) 2024-02-17T12:58:45.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.247+0000 7f5d5d9d6640 1 -- 172.21.15.136:0/2818335703 learned_addr learned my addr 172.21.15.136:0/2818335703 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:45.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.247+0000 7f5d5c9d4640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d580c7e30 0x7f5d581f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.247+0000 7f5d5d1d5640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d580c4340 0x7f5d580cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.250+0000 7f5d5d9d6640 1 -- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d580c7e30 msgr2=0x7f5d581f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.250+0000 7f5d5d9d6640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d580c7e30 0x7f5d581f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.250+0000 7f5d5d9d6640 1 -- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d580c4340 msgr2=0x7f5d580cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.250+0000 7f5d5d9d6640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d580c4340 0x7f5d580cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.250+0000 7f5d5d9d6640 1 -- 172.21.15.136:0/2818335703 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54009b30 con 0x7f5d58157430 2024-02-17T12:58:45.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.252+0000 7f5d5d9d6640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 0x7f5d581555a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000e960 tx=0x7f5d5000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:45.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.256+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50009690 con 0x7f5d58157430 2024-02-17T12:58:45.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.256+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5000c980 con 0x7f5d58157430 2024-02-17T12:58:45.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.256+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000cd30 con 0x7f5d58157430 2024-02-17T12:58:45.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.256+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d581f3ed0 con 0x7f5d58157430 2024-02-17T12:58:45.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.256+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d580cdd70 con 0x7f5d58157430 2024-02-17T12:58:45.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.257+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d58067e00 con 0x7f5d58157430 2024-02-17T12:58:45.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.278+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5d50013470 con 0x7f5d58157430 2024-02-17T12:58:45.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.278+0000 7f5d4dffb640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d3c06b890 0x7f5d3c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.279+0000 7f5d5d1d5640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d3c06b890 0x7f5d3c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.279+0000 7f5d5d1d5640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d3c06b890 0x7f5d3c06dd50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d54035000 tx=0x7f5d54030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:45.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.517+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f5d50059360 con 0x7f5d58157430 2024-02-17T12:58:45.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.517+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d50055600 con 0x7f5d58157430 2024-02-17T12:58:45.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.688+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d58150d30 con 0x7f5d3c06b890 2024-02-17T12:58:45.687 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.696+0000 7f5d4dffb640 1 -- 172.21.15.136:0/2818335703 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345393 (secure 0 0 0) 0x7f5d58150d30 con 0x7f5d3c06b890 2024-02-17T12:58:45.692 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:45.694 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d3c06b890 msgr2=0x7f5d3c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d3c06b890 0x7f5d3c06dd50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d54035000 tx=0x7f5d54030000 comp rx=0 tx=0).stop 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 msgr2=0x7f5d581555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 0x7f5d581555a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000e960 tx=0x7f5d5000ee20 comp rx=0 tx=0).stop 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 shutdown_connections 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5d3c06b890 0x7f5d3c06dd50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d58157430 0x7f5d581555a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d580c7e30 0x7f5d581f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 --2- 172.21.15.136:0/2818335703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d580c4340 0x7f5d580cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 >> 172.21.15.136:0/2818335703 conn(0x7f5d5806fe80 msgr2=0x7f5d580c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 shutdown_connections 2024-02-17T12:58:45.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.700+0000 7f5d5f439640 1 -- 172.21.15.136:0/2818335703 wait complete. 2024-02-17T12:58:45.703 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-02-17T12:58:43.992580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":368,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2113304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2924,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.573383"},"pg_stats":[{"pgid":"2.1f","version":"25'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825510+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T12:58:37.825510+0000","last_peered":"2024-02-17T12:58:37.825510+0000","last_clean":"2024-02-17T12:58:37.825510+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T12:58:37.825510+0000","last_undegraded":"2024-02-17T12:58:37.825510+0000","last_fullsized":"2024-02-17T12:58:37.825510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886968+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T12:58:37.886968+0000","last_peered":"2024-02-17T12:58:37.886968+0000","last_clean":"2024-02-17T12:58:37.886968+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T12:58:37.886968+0000","last_undegraded":"2024-02-17T12:58:37.886968+0000","last_fullsized":"2024-02-17T12:58:37.886968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252135+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T12:58:37.252135+0000","last_peered":"2024-02-17T12:58:37.252135+0000","last_clean":"2024-02-17T12:58:37.252135+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T12:58:37.252135+0000","last_undegraded":"2024-02-17T12:58:37.252135+0000","last_fullsized":"2024-02-17T12:58:37.252135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.887034+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T12:58:37.887034+0000","last_peered":"2024-02-17T12:58:37.887034+0000","last_clean":"2024-02-17T12:58:37.887034+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T12:58:37.887034+0000","last_undegraded":"2024-02-17T12:58:37.887034+0000","last_fullsized":"2024-02-17T12:58:37.887034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886996+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T12:58:37.886996+0000","last_peered":"2024-02-17T12:58:37.886996+0000","last_clean":"2024-02-17T12:58:37.886996+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T12:58:37.886996+0000","last_undegraded":"2024-02-17T12:58:37.886996+0000","last_fullsized":"2024-02-17T12:58:37.886996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250259+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T12:58:37.250259+0000","last_peered":"2024-02-17T12:58:37.250259+0000","last_clean":"2024-02-17T12:58:37.250259+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T12:58:37.250259+0000","last_undegraded":"2024-02-17T12:58:37.250259+0000","last_fullsized":"2024-02-17T12:58:37.250259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363991+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T12:58:37.363991+0000","last_peered":"2024-02-17T12:58:37.363991+0000","last_clean":"2024-02-17T12:58:37.363991+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T12:58:37.363991+0000","last_undegraded":"2024-02-17T12:58:37.363991+0000","last_fullsized":"2024-02-17T12:58:37.363991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.740038+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T12:58:37.740038+0000","last_peered":"2024-02-17T12:58:37.740038+0000","last_clean":"2024-02-17T12:58:37.740038+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T12:58:37.740038+0000","last_undegraded":"2024-02-17T12:58:37.740038+0000","last_fullsized":"2024-02-17T12:58:37.740038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.887403+0000","last_change":"2024-02-17T12:58:37.887403+0000","last_active":"2024-02-17T12:58:37.887403+0000","last_peered":"2024-02-17T12:58:37.887403+0000","last_clean":"2024-02-17T12:58:37.887403+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T12:58:37.887403+0000","last_undegraded":"2024-02-17T12:58:37.887403+0000","last_fullsized":"2024-02-17T12:58:37.887403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364065+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T12:58:37.364065+0000","last_peered":"2024-02-17T12:58:37.364065+0000","last_clean":"2024-02-17T12:58:37.364065+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T12:58:37.364065+0000","last_undegraded":"2024-02-17T12:58:37.364065+0000","last_fullsized":"2024-02-17T12:58:37.364065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248354+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T12:58:37.248354+0000","last_peered":"2024-02-17T12:58:37.248354+0000","last_clean":"2024-02-17T12:58:37.248354+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T12:58:37.248354+0000","last_undegraded":"2024-02-17T12:58:37.248354+0000","last_fullsized":"2024-02-17T12:58:37.248354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251301+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T12:58:37.251301+0000","last_peered":"2024-02-17T12:58:37.251301+0000","last_clean":"2024-02-17T12:58:37.251301+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T12:58:37.251301+0000","last_undegraded":"2024-02-17T12:58:37.251301+0000","last_fullsized":"2024-02-17T12:58:37.251301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248286+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T12:58:37.248286+0000","last_peered":"2024-02-17T12:58:37.248286+0000","last_clean":"2024-02-17T12:58:37.248286+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T12:58:37.248286+0000","last_undegraded":"2024-02-17T12:58:37.248286+0000","last_fullsized":"2024-02-17T12:58:37.248286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248415+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T12:58:37.248415+0000","last_peered":"2024-02-17T12:58:37.248415+0000","last_clean":"2024-02-17T12:58:37.248415+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T12:58:37.248415+0000","last_undegraded":"2024-02-17T12:58:37.248415+0000","last_fullsized":"2024-02-17T12:58:37.248415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248122+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T12:58:37.248122+0000","last_peered":"2024-02-17T12:58:37.248122+0000","last_clean":"2024-02-17T12:58:37.248122+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T12:58:37.248122+0000","last_undegraded":"2024-02-17T12:58:37.248122+0000","last_fullsized":"2024-02-17T12:58:37.248122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251582+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T12:58:37.251582+0000","last_peered":"2024-02-17T12:58:37.251582+0000","last_clean":"2024-02-17T12:58:37.251582+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T12:58:37.251582+0000","last_undegraded":"2024-02-17T12:58:37.251582+0000","last_fullsized":"2024-02-17T12:58:37.251582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324439+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T12:58:37.324439+0000","last_peered":"2024-02-17T12:58:37.324439+0000","last_clean":"2024-02-17T12:58:37.324439+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T12:58:37.324439+0000","last_undegraded":"2024-02-17T12:58:37.324439+0000","last_fullsized":"2024-02-17T12:58:37.324439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363560+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T12:58:37.363560+0000","last_peered":"2024-02-17T12:58:37.363560+0000","last_clean":"2024-02-17T12:58:37.363560+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T12:58:37.363560+0000","last_undegraded":"2024-02-17T12:58:37.363560+0000","last_fullsized":"2024-02-17T12:58:37.363560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.824934+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T12:58:37.824934+0000","last_peered":"2024-02-17T12:58:37.824934+0000","last_clean":"2024-02-17T12:58:37.824934+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T12:58:37.824934+0000","last_undegraded":"2024-02-17T12:58:37.824934+0000","last_fullsized":"2024-02-17T12:58:37.824934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825294+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T12:58:37.825294+0000","last_peered":"2024-02-17T12:58:37.825294+0000","last_clean":"2024-02-17T12:58:37.825294+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T12:58:37.825294+0000","last_undegraded":"2024-02-17T12:58:37.825294+0000","last_fullsized":"2024-02-17T12:58:37.825294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252567+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T12:58:37.252567+0000","last_peered":"2024-02-17T12:58:37.252567+0000","last_clean":"2024-02-17T12:58:37.252567+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T12:58:37.252567+0000","last_undegraded":"2024-02-17T12:58:37.252567+0000","last_fullsized":"2024-02-17T12:58:37.252567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247975+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T12:58:37.247975+0000","last_peered":"2024-02-17T12:58:37.247975+0000","last_clean":"2024-02-17T12:58:37.247975+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T12:58:37.247975+0000","last_undegraded":"2024-02-17T12:58:37.247975+0000","last_fullsized":"2024-02-17T12:58:37.247975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363471+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T12:58:37.363471+0000","last_peered":"2024-02-17T12:58:37.363471+0000","last_clean":"2024-02-17T12:58:37.363471+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T12:58:37.363471+0000","last_undegraded":"2024-02-17T12:58:37.363471+0000","last_fullsized":"2024-02-17T12:58:37.363471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251135+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T12:58:37.251135+0000","last_peered":"2024-02-17T12:58:37.251135+0000","last_clean":"2024-02-17T12:58:37.251135+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T12:58:37.251135+0000","last_undegraded":"2024-02-17T12:58:37.251135+0000","last_fullsized":"2024-02-17T12:58:37.251135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825216+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T12:58:37.825216+0000","last_peered":"2024-02-17T12:58:37.825216+0000","last_clean":"2024-02-17T12:58:37.825216+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T12:58:37.825216+0000","last_undegraded":"2024-02-17T12:58:37.825216+0000","last_fullsized":"2024-02-17T12:58:37.825216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248929+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T12:58:37.248929+0000","last_peered":"2024-02-17T12:58:37.248929+0000","last_clean":"2024-02-17T12:58:37.248929+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T12:58:37.248929+0000","last_undegraded":"2024-02-17T12:58:37.248929+0000","last_fullsized":"2024-02-17T12:58:37.248929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250402+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T12:58:37.250402+0000","last_peered":"2024-02-17T12:58:37.250402+0000","last_clean":"2024-02-17T12:58:37.250402+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T12:58:37.250402+0000","last_undegraded":"2024-02-17T12:58:37.250402+0000","last_fullsized":"2024-02-17T12:58:37.250402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825452+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T12:58:37.825452+0000","last_peered":"2024-02-17T12:58:37.825452+0000","last_clean":"2024-02-17T12:58:37.825452+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T12:58:37.825452+0000","last_undegraded":"2024-02-17T12:58:37.825452+0000","last_fullsized":"2024-02-17T12:58:37.825452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825380+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T12:58:37.825380+0000","last_peered":"2024-02-17T12:58:37.825380+0000","last_clean":"2024-02-17T12:58:37.825380+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T12:58:37.825380+0000","last_undegraded":"2024-02-17T12:58:37.825380+0000","last_fullsized":"2024-02-17T12:58:37.825380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.824939+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T12:58:37.824939+0000","last_peered":"2024-02-17T12:58:37.824939+0000","last_clean":"2024-02-17T12:58:37.824939+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T12:58:37.824939+0000","last_undegraded":"2024-02-17T12:58:37.824939+0000","last_fullsized":"2024-02-17T12:58:37.824939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324493+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T12:58:37.324493+0000","last_peered":"2024-02-17T12:58:37.324493+0000","last_clean":"2024-02-17T12:58:37.324493+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T12:58:37.324493+0000","last_undegraded":"2024-02-17T12:58:37.324493+0000","last_fullsized":"2024-02-17T12:58:37.324493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248623+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T12:58:37.248623+0000","last_peered":"2024-02-17T12:58:37.248623+0000","last_clean":"2024-02-17T12:58:37.248623+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T12:58:37.248623+0000","last_undegraded":"2024-02-17T12:58:37.248623+0000","last_fullsized":"2024-02-17T12:58:37.248623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324212+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T12:58:37.324212+0000","last_peered":"2024-02-17T12:58:37.324212+0000","last_clean":"2024-02-17T12:58:37.324212+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T12:58:37.324212+0000","last_undegraded":"2024-02-17T12:58:37.324212+0000","last_fullsized":"2024-02-17T12:58:37.324212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250988+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T12:58:37.250988+0000","last_peered":"2024-02-17T12:58:37.250988+0000","last_clean":"2024-02-17T12:58:37.250988+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T12:58:37.250988+0000","last_undegraded":"2024-02-17T12:58:37.250988+0000","last_fullsized":"2024-02-17T12:58:37.250988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886406+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T12:58:37.886406+0000","last_peered":"2024-02-17T12:58:37.886406+0000","last_clean":"2024-02-17T12:58:37.886406+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T12:58:37.886406+0000","last_undegraded":"2024-02-17T12:58:37.886406+0000","last_fullsized":"2024-02-17T12:58:37.886406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324026+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T12:58:37.324026+0000","last_peered":"2024-02-17T12:58:37.324026+0000","last_clean":"2024-02-17T12:58:37.324026+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T12:58:37.324026+0000","last_undegraded":"2024-02-17T12:58:37.324026+0000","last_fullsized":"2024-02-17T12:58:37.324026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363882+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T12:58:37.363882+0000","last_peered":"2024-02-17T12:58:37.363882+0000","last_clean":"2024-02-17T12:58:37.363882+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T12:58:37.363882+0000","last_undegraded":"2024-02-17T12:58:37.363882+0000","last_fullsized":"2024-02-17T12:58:37.363882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248625+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T12:58:37.248625+0000","last_peered":"2024-02-17T12:58:37.248625+0000","last_clean":"2024-02-17T12:58:37.248625+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T12:58:37.248625+0000","last_undegraded":"2024-02-17T12:58:37.248625+0000","last_fullsized":"2024-02-17T12:58:37.248625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324381+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T12:58:37.324381+0000","last_peered":"2024-02-17T12:58:37.324381+0000","last_clean":"2024-02-17T12:58:37.324381+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T12:58:37.324381+0000","last_undegraded":"2024-02-17T12:58:37.324381+0000","last_fullsized":"2024-02-17T12:58:37.324381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886075+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T12:58:37.886075+0000","last_peered":"2024-02-17T12:58:37.886075+0000","last_clean":"2024-02-17T12:58:37.886075+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T12:58:37.886075+0000","last_undegraded":"2024-02-17T12:58:37.886075+0000","last_fullsized":"2024-02-17T12:58:37.886075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251333+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T12:58:37.251333+0000","last_peered":"2024-02-17T12:58:37.251333+0000","last_clean":"2024-02-17T12:58:37.251333+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T12:58:37.251333+0000","last_undegraded":"2024-02-17T12:58:37.251333+0000","last_fullsized":"2024-02-17T12:58:37.251333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324268+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T12:58:37.324268+0000","last_peered":"2024-02-17T12:58:37.324268+0000","last_clean":"2024-02-17T12:58:37.324268+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T12:58:37.324268+0000","last_undegraded":"2024-02-17T12:58:37.324268+0000","last_fullsized":"2024-02-17T12:58:37.324268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.323981+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T12:58:37.323981+0000","last_peered":"2024-02-17T12:58:37.323981+0000","last_clean":"2024-02-17T12:58:37.323981+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T12:58:37.323981+0000","last_undegraded":"2024-02-17T12:58:37.323981+0000","last_fullsized":"2024-02-17T12:58:37.323981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247892+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T12:58:37.247892+0000","last_peered":"2024-02-17T12:58:37.247892+0000","last_clean":"2024-02-17T12:58:37.247892+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T12:58:37.247892+0000","last_undegraded":"2024-02-17T12:58:37.247892+0000","last_fullsized":"2024-02-17T12:58:37.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886762+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T12:58:37.886762+0000","last_peered":"2024-02-17T12:58:37.886762+0000","last_clean":"2024-02-17T12:58:37.886762+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T12:58:37.886762+0000","last_undegraded":"2024-02-17T12:58:37.886762+0000","last_fullsized":"2024-02-17T12:58:37.886762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825079+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T12:58:37.825079+0000","last_peered":"2024-02-17T12:58:37.825079+0000","last_clean":"2024-02-17T12:58:37.825079+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T12:58:37.825079+0000","last_undegraded":"2024-02-17T12:58:37.825079+0000","last_fullsized":"2024-02-17T12:58:37.825079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.740023+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T12:58:37.740023+0000","last_peered":"2024-02-17T12:58:37.740023+0000","last_clean":"2024-02-17T12:58:37.740023+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T12:58:37.740023+0000","last_undegraded":"2024-02-17T12:58:37.740023+0000","last_fullsized":"2024-02-17T12:58:37.740023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248513+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T12:58:37.248513+0000","last_peered":"2024-02-17T12:58:37.248513+0000","last_clean":"2024-02-17T12:58:37.248513+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T12:58:37.248513+0000","last_undegraded":"2024-02-17T12:58:37.248513+0000","last_fullsized":"2024-02-17T12:58:37.248513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324559+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T12:58:37.324559+0000","last_peered":"2024-02-17T12:58:37.324559+0000","last_clean":"2024-02-17T12:58:37.324559+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T12:58:37.324559+0000","last_undegraded":"2024-02-17T12:58:37.324559+0000","last_fullsized":"2024-02-17T12:58:37.324559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250612+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T12:58:37.250612+0000","last_peered":"2024-02-17T12:58:37.250612+0000","last_clean":"2024-02-17T12:58:37.250612+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T12:58:37.250612+0000","last_undegraded":"2024-02-17T12:58:37.250612+0000","last_fullsized":"2024-02-17T12:58:37.250612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363999+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T12:58:37.363999+0000","last_peered":"2024-02-17T12:58:37.363999+0000","last_clean":"2024-02-17T12:58:37.363999+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T12:58:37.363999+0000","last_undegraded":"2024-02-17T12:58:37.363999+0000","last_fullsized":"2024-02-17T12:58:37.363999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886828+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T12:58:37.886828+0000","last_peered":"2024-02-17T12:58:37.886828+0000","last_clean":"2024-02-17T12:58:37.886828+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T12:58:37.886828+0000","last_undegraded":"2024-02-17T12:58:37.886828+0000","last_fullsized":"2024-02-17T12:58:37.886828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886404+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T12:58:37.886404+0000","last_peered":"2024-02-17T12:58:37.886404+0000","last_clean":"2024-02-17T12:58:37.886404+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T12:58:37.886404+0000","last_undegraded":"2024-02-17T12:58:37.886404+0000","last_fullsized":"2024-02-17T12:58:37.886404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363983+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T12:58:37.363983+0000","last_peered":"2024-02-17T12:58:37.363983+0000","last_clean":"2024-02-17T12:58:37.363983+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T12:58:37.363983+0000","last_undegraded":"2024-02-17T12:58:37.363983+0000","last_fullsized":"2024-02-17T12:58:37.363983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825316+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T12:58:37.825316+0000","last_peered":"2024-02-17T12:58:37.825316+0000","last_clean":"2024-02-17T12:58:37.825316+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T12:58:37.825316+0000","last_undegraded":"2024-02-17T12:58:37.825316+0000","last_fullsized":"2024-02-17T12:58:37.825316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247666+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T12:58:37.247666+0000","last_peered":"2024-02-17T12:58:37.247666+0000","last_clean":"2024-02-17T12:58:37.247666+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T12:58:37.247666+0000","last_undegraded":"2024-02-17T12:58:37.247666+0000","last_fullsized":"2024-02-17T12:58:37.247666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251231+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T12:58:37.251231+0000","last_peered":"2024-02-17T12:58:37.251231+0000","last_clean":"2024-02-17T12:58:37.251231+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T12:58:37.251231+0000","last_undegraded":"2024-02-17T12:58:37.251231+0000","last_fullsized":"2024-02-17T12:58:37.251231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364174+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T12:58:37.364174+0000","last_peered":"2024-02-17T12:58:37.364174+0000","last_clean":"2024-02-17T12:58:37.364174+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T12:58:37.364174+0000","last_undegraded":"2024-02-17T12:58:37.364174+0000","last_fullsized":"2024-02-17T12:58:37.364174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.739790+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T12:58:37.739790+0000","last_peered":"2024-02-17T12:58:37.739790+0000","last_clean":"2024-02-17T12:58:37.739790+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T12:58:37.739790+0000","last_undegraded":"2024-02-17T12:58:37.739790+0000","last_fullsized":"2024-02-17T12:58:37.739790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247880+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T12:58:37.247880+0000","last_peered":"2024-02-17T12:58:37.247880+0000","last_clean":"2024-02-17T12:58:37.247880+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T12:58:37.247880+0000","last_undegraded":"2024-02-17T12:58:37.247880+0000","last_fullsized":"2024-02-17T12:58:37.247880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825170+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T12:58:37.825170+0000","last_peered":"2024-02-17T12:58:37.825170+0000","last_clean":"2024-02-17T12:58:37.825170+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T12:58:37.825170+0000","last_undegraded":"2024-02-17T12:58:37.825170+0000","last_fullsized":"2024-02-17T12:58:37.825170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886911+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T12:58:37.886911+0000","last_peered":"2024-02-17T12:58:37.886911+0000","last_clean":"2024-02-17T12:58:37.886911+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T12:58:37.886911+0000","last_undegraded":"2024-02-17T12:58:37.886911+0000","last_fullsized":"2024-02-17T12:58:37.886911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.739729+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T12:58:37.739729+0000","last_peered":"2024-02-17T12:58:37.739729+0000","last_clean":"2024-02-17T12:58:37.739729+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T12:58:37.739729+0000","last_undegraded":"2024-02-17T12:58:37.739729+0000","last_fullsized":"2024-02-17T12:58:37.739729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363771+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T12:58:37.363771+0000","last_peered":"2024-02-17T12:58:37.363771+0000","last_clean":"2024-02-17T12:58:37.363771+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T12:58:37.363771+0000","last_undegraded":"2024-02-17T12:58:37.363771+0000","last_fullsized":"2024-02-17T12:58:37.363771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886977+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T12:58:37.886977+0000","last_peered":"2024-02-17T12:58:37.886977+0000","last_clean":"2024-02-17T12:58:37.886977+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T12:58:37.886977+0000","last_undegraded":"2024-02-17T12:58:37.886977+0000","last_fullsized":"2024-02-17T12:58:37.886977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248256+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T12:58:37.248256+0000","last_peered":"2024-02-17T12:58:37.248256+0000","last_clean":"2024-02-17T12:58:37.248256+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T12:58:37.248256+0000","last_undegraded":"2024-02-17T12:58:37.248256+0000","last_fullsized":"2024-02-17T12:58:37.248256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248528+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T12:58:37.248528+0000","last_peered":"2024-02-17T12:58:37.248528+0000","last_clean":"2024-02-17T12:58:37.248528+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T12:58:37.248528+0000","last_undegraded":"2024-02-17T12:58:37.248528+0000","last_fullsized":"2024-02-17T12:58:37.248528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324198+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T12:58:37.324198+0000","last_peered":"2024-02-17T12:58:37.324198+0000","last_clean":"2024-02-17T12:58:37.324198+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T12:58:37.324198+0000","last_undegraded":"2024-02-17T12:58:37.324198+0000","last_fullsized":"2024-02-17T12:58:37.324198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324160+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T12:58:37.324160+0000","last_peered":"2024-02-17T12:58:37.324160+0000","last_clean":"2024-02-17T12:58:37.324160+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T12:58:37.324160+0000","last_undegraded":"2024-02-17T12:58:37.324160+0000","last_fullsized":"2024-02-17T12:58:37.324160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251902+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T12:58:37.251902+0000","last_peered":"2024-02-17T12:58:37.251902+0000","last_clean":"2024-02-17T12:58:37.251902+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T12:58:37.251902+0000","last_undegraded":"2024-02-17T12:58:37.251902+0000","last_fullsized":"2024-02-17T12:58:37.251902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248263+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T12:58:37.248263+0000","last_peered":"2024-02-17T12:58:37.248263+0000","last_clean":"2024-02-17T12:58:37.248263+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T12:58:37.248263+0000","last_undegraded":"2024-02-17T12:58:37.248263+0000","last_fullsized":"2024-02-17T12:58:37.248263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363833+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T12:58:37.363833+0000","last_peered":"2024-02-17T12:58:37.363833+0000","last_clean":"2024-02-17T12:58:37.363833+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T12:58:37.363833+0000","last_undegraded":"2024-02-17T12:58:37.363833+0000","last_fullsized":"2024-02-17T12:58:37.363833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250807+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T12:58:37.250807+0000","last_peered":"2024-02-17T12:58:37.250807+0000","last_clean":"2024-02-17T12:58:37.250807+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T12:58:37.250807+0000","last_undegraded":"2024-02-17T12:58:37.250807+0000","last_fullsized":"2024-02-17T12:58:37.250807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825007+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T12:58:37.825007+0000","last_peered":"2024-02-17T12:58:37.825007+0000","last_clean":"2024-02-17T12:58:37.825007+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T12:58:37.825007+0000","last_undegraded":"2024-02-17T12:58:37.825007+0000","last_fullsized":"2024-02-17T12:58:37.825007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248015+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T12:58:37.248015+0000","last_peered":"2024-02-17T12:58:37.248015+0000","last_clean":"2024-02-17T12:58:37.248015+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T12:58:37.248015+0000","last_undegraded":"2024-02-17T12:58:37.248015+0000","last_fullsized":"2024-02-17T12:58:37.248015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252276+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T12:58:37.252276+0000","last_peered":"2024-02-17T12:58:37.252276+0000","last_clean":"2024-02-17T12:58:37.252276+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T12:58:37.252276+0000","last_undegraded":"2024-02-17T12:58:37.252276+0000","last_fullsized":"2024-02-17T12:58:37.252276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250675+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T12:58:37.250675+0000","last_peered":"2024-02-17T12:58:37.250675+0000","last_clean":"2024-02-17T12:58:37.250675+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T12:58:37.250675+0000","last_undegraded":"2024-02-17T12:58:37.250675+0000","last_fullsized":"2024-02-17T12:58:37.250675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.887065+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:37.887065+0000","last_peered":"2024-02-17T12:58:37.887065+0000","last_clean":"2024-02-17T12:58:37.887065+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T12:58:37.887065+0000","last_undegraded":"2024-02-17T12:58:37.887065+0000","last_fullsized":"2024-02-17T12:58:37.887065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364124+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T12:58:37.364124+0000","last_peered":"2024-02-17T12:58:37.364124+0000","last_clean":"2024-02-17T12:58:37.364124+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T12:58:37.364124+0000","last_undegraded":"2024-02-17T12:58:37.364124+0000","last_fullsized":"2024-02-17T12:58:37.364124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251083+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T12:58:37.251083+0000","last_peered":"2024-02-17T12:58:37.251083+0000","last_clean":"2024-02-17T12:58:37.251083+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T12:58:37.251083+0000","last_undegraded":"2024-02-17T12:58:37.251083+0000","last_fullsized":"2024-02-17T12:58:37.251083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251217+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T12:58:37.251217+0000","last_peered":"2024-02-17T12:58:37.251217+0000","last_clean":"2024-02-17T12:58:37.251217+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T12:58:37.251217+0000","last_undegraded":"2024-02-17T12:58:37.251217+0000","last_fullsized":"2024-02-17T12:58:37.251217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.740330+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T12:58:37.740330+0000","last_peered":"2024-02-17T12:58:37.740330+0000","last_clean":"2024-02-17T12:58:37.740330+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T12:58:37.740330+0000","last_undegraded":"2024-02-17T12:58:37.740330+0000","last_fullsized":"2024-02-17T12:58:37.740330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825120+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T12:58:37.825120+0000","last_peered":"2024-02-17T12:58:37.825120+0000","last_clean":"2024-02-17T12:58:37.825120+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T12:58:37.825120+0000","last_undegraded":"2024-02-17T12:58:37.825120+0000","last_fullsized":"2024-02-17T12:58:37.825120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825265+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T12:58:37.825265+0000","last_peered":"2024-02-17T12:58:37.825265+0000","last_clean":"2024-02-17T12:58:37.825265+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T12:58:37.825265+0000","last_undegraded":"2024-02-17T12:58:37.825265+0000","last_fullsized":"2024-02-17T12:58:37.825265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825214+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T12:58:37.825214+0000","last_peered":"2024-02-17T12:58:37.825214+0000","last_clean":"2024-02-17T12:58:37.825214+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T12:58:37.825214+0000","last_undegraded":"2024-02-17T12:58:37.825214+0000","last_fullsized":"2024-02-17T12:58:37.825214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247856+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T12:58:37.247856+0000","last_peered":"2024-02-17T12:58:37.247856+0000","last_clean":"2024-02-17T12:58:37.247856+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T12:58:37.247856+0000","last_undegraded":"2024-02-17T12:58:37.247856+0000","last_fullsized":"2024-02-17T12:58:37.247856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248706+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T12:58:37.248706+0000","last_peered":"2024-02-17T12:58:37.248706+0000","last_clean":"2024-02-17T12:58:37.248706+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T12:58:37.248706+0000","last_undegraded":"2024-02-17T12:58:37.248706+0000","last_fullsized":"2024-02-17T12:58:37.248706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886179+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T12:58:37.886179+0000","last_peered":"2024-02-17T12:58:37.886179+0000","last_clean":"2024-02-17T12:58:37.886179+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T12:58:37.886179+0000","last_undegraded":"2024-02-17T12:58:37.886179+0000","last_fullsized":"2024-02-17T12:58:37.886179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324017+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T12:58:37.324017+0000","last_peered":"2024-02-17T12:58:37.324017+0000","last_clean":"2024-02-17T12:58:37.324017+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T12:58:37.324017+0000","last_undegraded":"2024-02-17T12:58:37.324017+0000","last_fullsized":"2024-02-17T12:58:37.324017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248432+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T12:58:37.248432+0000","last_peered":"2024-02-17T12:58:37.248432+0000","last_clean":"2024-02-17T12:58:37.248432+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T12:58:37.248432+0000","last_undegraded":"2024-02-17T12:58:37.248432+0000","last_fullsized":"2024-02-17T12:58:37.248432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825102+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T12:58:37.825102+0000","last_peered":"2024-02-17T12:58:37.825102+0000","last_clean":"2024-02-17T12:58:37.825102+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T12:58:37.825102+0000","last_undegraded":"2024-02-17T12:58:37.825102+0000","last_fullsized":"2024-02-17T12:58:37.825102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825379+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T12:58:37.825379+0000","last_peered":"2024-02-17T12:58:37.825379+0000","last_clean":"2024-02-17T12:58:37.825379+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T12:58:37.825379+0000","last_undegraded":"2024-02-17T12:58:37.825379+0000","last_fullsized":"2024-02-17T12:58:37.825379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886548+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T12:58:37.886548+0000","last_peered":"2024-02-17T12:58:37.886548+0000","last_clean":"2024-02-17T12:58:37.886548+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T12:58:37.886548+0000","last_undegraded":"2024-02-17T12:58:37.886548+0000","last_fullsized":"2024-02-17T12:58:37.886548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.739956+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T12:58:37.739956+0000","last_peered":"2024-02-17T12:58:37.739956+0000","last_clean":"2024-02-17T12:58:37.739956+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T12:58:37.739956+0000","last_undegraded":"2024-02-17T12:58:37.739956+0000","last_fullsized":"2024-02-17T12:58:37.739956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.887482+0000","last_change":"2024-02-17T12:58:37.887482+0000","last_active":"2024-02-17T12:58:37.887482+0000","last_peered":"2024-02-17T12:58:37.887482+0000","last_clean":"2024-02-17T12:58:37.887482+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T12:58:37.887482+0000","last_undegraded":"2024-02-17T12:58:37.887482+0000","last_fullsized":"2024-02-17T12:58:37.887482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:58.699256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250452+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T12:58:37.250452+0000","last_peered":"2024-02-17T12:58:37.250452+0000","last_clean":"2024-02-17T12:58:37.250452+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T12:58:37.250452+0000","last_undegraded":"2024-02-17T12:58:37.250452+0000","last_fullsized":"2024-02-17T12:58:37.250452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251224+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T12:58:37.251224+0000","last_peered":"2024-02-17T12:58:37.251224+0000","last_clean":"2024-02-17T12:58:37.251224+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T12:58:37.251224+0000","last_undegraded":"2024-02-17T12:58:37.251224+0000","last_fullsized":"2024-02-17T12:58:37.251224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248199+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T12:58:37.248199+0000","last_peered":"2024-02-17T12:58:37.248199+0000","last_clean":"2024-02-17T12:58:37.248199+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T12:58:37.248199+0000","last_undegraded":"2024-02-17T12:58:37.248199+0000","last_fullsized":"2024-02-17T12:58:37.248199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886539+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T12:58:37.886539+0000","last_peered":"2024-02-17T12:58:37.886539+0000","last_clean":"2024-02-17T12:58:37.886539+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T12:58:37.886539+0000","last_undegraded":"2024-02-17T12:58:37.886539+0000","last_fullsized":"2024-02-17T12:58:37.886539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324471+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T12:58:37.324471+0000","last_peered":"2024-02-17T12:58:37.324471+0000","last_clean":"2024-02-17T12:58:37.324471+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T12:58:37.324471+0000","last_undegraded":"2024-02-17T12:58:37.324471+0000","last_fullsized":"2024-02-17T12:58:37.324471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324153+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T12:58:37.324153+0000","last_peered":"2024-02-17T12:58:37.324153+0000","last_clean":"2024-02-17T12:58:37.324153+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T12:58:37.324153+0000","last_undegraded":"2024-02-17T12:58:37.324153+0000","last_fullsized":"2024-02-17T12:58:37.324153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251155+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T12:58:37.251155+0000","last_peered":"2024-02-17T12:58:37.251155+0000","last_clean":"2024-02-17T12:58:37.251155+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T12:58:37.251155+0000","last_undegraded":"2024-02-17T12:58:37.251155+0000","last_fullsized":"2024-02-17T12:58:37.251155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886892+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T12:58:37.886892+0000","last_peered":"2024-02-17T12:58:37.886892+0000","last_clean":"2024-02-17T12:58:37.886892+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T12:58:37.886892+0000","last_undegraded":"2024-02-17T12:58:37.886892+0000","last_fullsized":"2024-02-17T12:58:37.886892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247786+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T12:58:37.247786+0000","last_peered":"2024-02-17T12:58:37.247786+0000","last_clean":"2024-02-17T12:58:37.247786+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T12:58:37.247786+0000","last_undegraded":"2024-02-17T12:58:37.247786+0000","last_fullsized":"2024-02-17T12:58:37.247786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886360+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T12:58:37.886360+0000","last_peered":"2024-02-17T12:58:37.886360+0000","last_clean":"2024-02-17T12:58:37.886360+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T12:58:37.886360+0000","last_undegraded":"2024-02-17T12:58:37.886360+0000","last_fullsized":"2024-02-17T12:58:37.886360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.739842+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T12:58:37.739842+0000","last_peered":"2024-02-17T12:58:37.739842+0000","last_clean":"2024-02-17T12:58:37.739842+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T12:58:37.739842+0000","last_undegraded":"2024-02-17T12:58:37.739842+0000","last_fullsized":"2024-02-17T12:58:37.739842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.825255+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T12:58:37.825255+0000","last_peered":"2024-02-17T12:58:37.825255+0000","last_clean":"2024-02-17T12:58:37.825255+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T12:58:37.825255+0000","last_undegraded":"2024-02-17T12:58:37.825255+0000","last_fullsized":"2024-02-17T12:58:37.825255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.741377+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T12:58:37.741377+0000","last_peered":"2024-02-17T12:58:37.741377+0000","last_clean":"2024-02-17T12:58:37.741377+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T12:58:37.741377+0000","last_undegraded":"2024-02-17T12:58:37.741377+0000","last_fullsized":"2024-02-17T12:58:37.741377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248600+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T12:58:37.248600+0000","last_peered":"2024-02-17T12:58:37.248600+0000","last_clean":"2024-02-17T12:58:37.248600+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T12:58:37.248600+0000","last_undegraded":"2024-02-17T12:58:37.248600+0000","last_fullsized":"2024-02-17T12:58:37.248600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.252206+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T12:58:37.252206+0000","last_peered":"2024-02-17T12:58:37.252206+0000","last_clean":"2024-02-17T12:58:37.252206+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T12:58:37.252206+0000","last_undegraded":"2024-02-17T12:58:37.252206+0000","last_fullsized":"2024-02-17T12:58:37.252206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.248852+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T12:58:37.248852+0000","last_peered":"2024-02-17T12:58:37.248852+0000","last_clean":"2024-02-17T12:58:37.248852+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T12:58:37.248852+0000","last_undegraded":"2024-02-17T12:58:37.248852+0000","last_fullsized":"2024-02-17T12:58:37.248852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.247763+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T12:58:37.247763+0000","last_peered":"2024-02-17T12:58:37.247763+0000","last_clean":"2024-02-17T12:58:37.247763+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T12:58:37.247763+0000","last_undegraded":"2024-02-17T12:58:37.247763+0000","last_fullsized":"2024-02-17T12:58:37.247763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886181+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T12:58:37.886181+0000","last_peered":"2024-02-17T12:58:37.886181+0000","last_clean":"2024-02-17T12:58:37.886181+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T12:58:37.886181+0000","last_undegraded":"2024-02-17T12:58:37.886181+0000","last_fullsized":"2024-02-17T12:58:37.886181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324058+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T12:58:37.324058+0000","last_peered":"2024-02-17T12:58:37.324058+0000","last_clean":"2024-02-17T12:58:37.324058+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T12:58:37.324058+0000","last_undegraded":"2024-02-17T12:58:37.324058+0000","last_fullsized":"2024-02-17T12:58:37.324058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.324329+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T12:58:37.324329+0000","last_peered":"2024-02-17T12:58:37.324329+0000","last_clean":"2024-02-17T12:58:37.324329+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T12:58:37.324329+0000","last_undegraded":"2024-02-17T12:58:37.324329+0000","last_fullsized":"2024-02-17T12:58:37.324329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363917+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T12:58:37.363917+0000","last_peered":"2024-02-17T12:58:37.363917+0000","last_clean":"2024-02-17T12:58:37.363917+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T12:58:37.363917+0000","last_undegraded":"2024-02-17T12:58:37.363917+0000","last_fullsized":"2024-02-17T12:58:37.363917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363804+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T12:58:37.363804+0000","last_peered":"2024-02-17T12:58:37.363804+0000","last_clean":"2024-02-17T12:58:37.363804+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T12:58:37.363804+0000","last_undegraded":"2024-02-17T12:58:37.363804+0000","last_fullsized":"2024-02-17T12:58:37.363804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363645+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T12:58:37.363645+0000","last_peered":"2024-02-17T12:58:37.363645+0000","last_clean":"2024-02-17T12:58:37.363645+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T12:58:37.363645+0000","last_undegraded":"2024-02-17T12:58:37.363645+0000","last_fullsized":"2024-02-17T12:58:37.363645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.740323+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T12:58:37.740323+0000","last_peered":"2024-02-17T12:58:37.740323+0000","last_clean":"2024-02-17T12:58:37.740323+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T12:58:37.740323+0000","last_undegraded":"2024-02-17T12:58:37.740323+0000","last_fullsized":"2024-02-17T12:58:37.740323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886031+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T12:58:37.886031+0000","last_peered":"2024-02-17T12:58:37.886031+0000","last_clean":"2024-02-17T12:58:37.886031+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T12:58:37.886031+0000","last_undegraded":"2024-02-17T12:58:37.886031+0000","last_fullsized":"2024-02-17T12:58:37.886031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363643+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T12:58:37.363643+0000","last_peered":"2024-02-17T12:58:37.363643+0000","last_clean":"2024-02-17T12:58:37.363643+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T12:58:37.363643+0000","last_undegraded":"2024-02-17T12:58:37.363643+0000","last_fullsized":"2024-02-17T12:58:37.363643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.251191+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T12:58:37.251191+0000","last_peered":"2024-02-17T12:58:37.251191+0000","last_clean":"2024-02-17T12:58:37.251191+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T12:58:37.251191+0000","last_undegraded":"2024-02-17T12:58:37.251191+0000","last_fullsized":"2024-02-17T12:58:37.251191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.363883+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T12:58:37.363883+0000","last_peered":"2024-02-17T12:58:37.363883+0000","last_clean":"2024-02-17T12:58:37.363883+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T12:58:37.363883+0000","last_undegraded":"2024-02-17T12:58:37.363883+0000","last_fullsized":"2024-02-17T12:58:37.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.250720+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T12:58:37.250720+0000","last_peered":"2024-02-17T12:58:37.250720+0000","last_clean":"2024-02-17T12:58:37.250720+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T12:58:37.250720+0000","last_undegraded":"2024-02-17T12:58:37.250720+0000","last_fullsized":"2024-02-17T12:58:37.250720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886720+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T12:58:37.886720+0000","last_peered":"2024-02-17T12:58:37.886720+0000","last_clean":"2024-02-17T12:58:37.886720+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T12:58:37.886720+0000","last_undegraded":"2024-02-17T12:58:37.886720+0000","last_fullsized":"2024-02-17T12:58:37.886720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.886869+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T12:58:37.886869+0000","last_peered":"2024-02-17T12:58:37.886869+0000","last_clean":"2024-02-17T12:58:37.886869+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T12:58:37.886869+0000","last_undegraded":"2024-02-17T12:58:37.886869+0000","last_fullsized":"2024-02-17T12:58:37.886869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T12:58:37.364223+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T12:58:37.364223+0000","last_peered":"2024-02-17T12:58:37.364223+0000","last_clean":"2024-02-17T12:58:37.364223+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T12:58:37.364223+0000","last_undegraded":"2024-02-17T12:58:37.364223+0000","last_fullsized":"2024-02-17T12:58:37.364223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":115059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":116385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":705199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":119685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":116727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:58:45.708 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T12:58:45.708 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-17T12:58:45.708 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-17T12:58:45.708 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-17T12:58:45.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.853+0000 7fcfbd023640 1 Processor -- start 2024-02-17T12:58:45.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.853+0000 7fcfbd023640 1 -- start start 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.854+0000 7fcfbd023640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcfb80c7670 0x7fcfb806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.854+0000 7fcfbd023640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb814fca0 0x7fcfb8150110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.854+0000 7fcfbd023640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80c5fa0 con 0x7fcfb806cad0 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.854+0000 7fcfbd023640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80c61d0 con 0x7fcfb80c7670 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.854+0000 7fcfbd023640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c6490 con 0x7fcfb814fca0 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.855+0000 7fcfb6d9d640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fcfb806cad0 0x7fcfb8156a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58848/0 (socket says 172.21.15.136:58848) 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.855+0000 7fcfb6d9d640 1 -- 172.21.15.136:0/1877222892 learned_addr learned my addr 172.21.15.136:0/1877222892 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.855+0000 7fcfb759e640 1 --2- 172.21.15.136:0/1877222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb814fca0 0x7fcfb8150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.855+0000 7fcfb659c640 1 --2- 172.21.15.136:0/1877222892 >> v2:172.21.15.160:3300/0 conn(0x7fcfb80c7670 0x7fcfb806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.857+0000 7fcfb5d9b640 1 -- 172.21.15.136:0/1877222892 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096715045 0 0) 0x7fcfb80c5fa0 con 0x7fcfb806cad0 2024-02-17T12:58:45.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.857+0000 7fcfb5d9b640 1 -- 172.21.15.136:0/1877222892 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa0003520 con 0x7fcfb806cad0 2024-02-17T12:58:45.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.858+0000 7fcfb759e640 1 -- 172.21.15.136:0/1877222892 >> v2:172.21.15.160:3300/0 conn(0x7fcfb80c7670 msgr2=0x7fcfb806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:45.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.858+0000 7fcfb759e640 1 --2- 172.21.15.136:0/1877222892 >> v2:172.21.15.160:3300/0 conn(0x7fcfb80c7670 0x7fcfb806ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.858+0000 7fcfb759e640 1 -- 172.21.15.136:0/1877222892 >> v1:172.21.15.136:6789/0 conn(0x7fcfb806cad0 legacy=0x7fcfb8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.858+0000 7fcfb759e640 1 -- 172.21.15.136:0/1877222892 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80c6770 con 0x7fcfb814fca0 2024-02-17T12:58:45.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.860+0000 7fcfb759e640 1 --2- 172.21.15.136:0/1877222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb814fca0 0x7fcfb8150110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000aea0 tx=0x7fcfb002d030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ffdb81b548e0f63 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:45.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfb5d9b640 1 -- 172.21.15.136:0/1877222892 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002dbd0 con 0x7fcfb814fca0 2024-02-17T12:58:45.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfb5d9b640 1 -- 172.21.15.136:0/1877222892 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb002dd30 con 0x7fcfb814fca0 2024-02-17T12:58:45.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfb5d9b640 1 -- 172.21.15.136:0/1877222892 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002dea0 con 0x7fcfb814fca0 2024-02-17T12:58:45.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 -- 172.21.15.136:0/1877222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb814fca0 msgr2=0x7fcfb8150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 --2- 172.21.15.136:0/1877222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb814fca0 0x7fcfb8150110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000aea0 tx=0x7fcfb002d030 comp rx=0 tx=0).stop 2024-02-17T12:58:45.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 -- 172.21.15.136:0/1877222892 shutdown_connections 2024-02-17T12:58:45.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 --2- 172.21.15.136:0/1877222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb814fca0 0x7fcfb8150110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 --2- 172.21.15.136:0/1877222892 >> v2:172.21.15.160:3300/0 conn(0x7fcfb80c7670 0x7fcfb806ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 -- 172.21.15.136:0/1877222892 >> 172.21.15.136:0/1877222892 conn(0x7fcfb80c7e90 msgr2=0x7fcfb80c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:45.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 -- 172.21.15.136:0/1877222892 shutdown_connections 2024-02-17T12:58:45.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.865+0000 7fcfbd023640 1 -- 172.21.15.136:0/1877222892 wait complete. 2024-02-17T12:58:45.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 Processor -- start 2024-02-17T12:58:45.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 -- start start 2024-02-17T12:58:45.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb806cad0 0x7fcfb8157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80c7670 0x7fcfb8151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb814fca0 0x7fcfb8150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:45.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81512a0 con 0x7fcfb806cad0 2024-02-17T12:58:45.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8149d20 con 0x7fcfb814fca0 2024-02-17T12:58:45.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.867+0000 7fcfbd023640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb814cc10 con 0x7fcfb80c7670 2024-02-17T12:58:45.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.868+0000 7fcfb6d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb806cad0 0x7fcfb8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.868+0000 7fcfb659c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80c7670 0x7fcfb8151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.868+0000 7fcfb759e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb814fca0 0x7fcfb8150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:45.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.868+0000 7fcfb659c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80c7670 0x7fcfb8151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:57676/0 (socket says 172.21.15.136:57676) 2024-02-17T12:58:45.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.868+0000 7fcfb659c640 1 -- 172.21.15.136:0/3404832848 learned_addr learned my addr 172.21.15.136:0/3404832848 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:45.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.872+0000 7fcfb6d9d640 1 -- 172.21.15.136:0/3404832848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80c7670 msgr2=0x7fcfb8151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.872+0000 7fcfb6d9d640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80c7670 0x7fcfb8151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.872+0000 7fcfb6d9d640 1 -- 172.21.15.136:0/3404832848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb814fca0 msgr2=0x7fcfb8150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:45.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.872+0000 7fcfb6d9d640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb814fca0 0x7fcfb8150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:45.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.872+0000 7fcfb6d9d640 1 -- 172.21.15.136:0/3404832848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb000ab80 con 0x7fcfb806cad0 2024-02-17T12:58:45.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.874+0000 7fcfb6d9d640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb806cad0 0x7fcfb8157190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c400 tx=0x7fcfac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:45.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.877+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac005ce0 con 0x7fcfb806cad0 2024-02-17T12:58:45.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.877+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac005e40 con 0x7fcfb806cad0 2024-02-17T12:58:45.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.877+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0072f0 con 0x7fcfb806cad0 2024-02-17T12:58:45.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.878+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb8152f30 con 0x7fcfb806cad0 2024-02-17T12:58:45.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.878+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb81534f0 con 0x7fcfb806cad0 2024-02-17T12:58:45.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:45.878+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb80c2eb0 con 0x7fcfb806cad0 2024-02-17T12:58:46.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.124+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcfac007450 con 0x7fcfb806cad0 2024-02-17T12:58:46.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.124+0000 7fcf9f7fe640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcfa406b860 0x7fcfa406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:46.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.125+0000 7fcfb659c640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcfa406b860 0x7fcfa406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:46.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.125+0000 7fcfb659c640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcfa406b860 0x7fcfa406dd20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfb814b7f0 tx=0x7fcfa8009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:46.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.136+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fcfac007e40 con 0x7fcfb806cad0 2024-02-17T12:58:46.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.137+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfac0545e0 con 0x7fcfb806cad0 2024-02-17T12:58:46.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.348+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcfb80c3190 con 0x7fcfb806cad0 2024-02-17T12:58:46.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.403+0000 7fcf9f7fe640 1 -- 172.21.15.136:0/3404832848 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcfac017020 con 0x7fcfb806cad0 2024-02-17T12:58:46.395 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:46.395 INFO:teuthology.orchestra.run.smithi136.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcfa406b860 msgr2=0x7fcfa406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcfa406b860 0x7fcfa406dd20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfb814b7f0 tx=0x7fcfa8009190 comp rx=0 tx=0).stop 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb806cad0 msgr2=0x7fcfb8157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb806cad0 0x7fcfb8157190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c400 tx=0x7fcfac00c8c0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 shutdown_connections 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcfa406b860 0x7fcfa406dd20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb814fca0 0x7fcfb8150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80c7670 0x7fcfb8151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 --2- 172.21.15.136:0/3404832848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfb806cad0 0x7fcfb8157190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 >> 172.21.15.136:0/3404832848 conn(0x7fcfb80c7e90 msgr2=0x7fcfb8149120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:46.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 shutdown_connections 2024-02-17T12:58:46.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.405+0000 7fcfbd023640 1 -- 172.21.15.136:0/3404832848 wait complete. 2024-02-17T12:58:46.408 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-17T12:58:46.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:46.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.517+0000 7f132a9a1640 1 Processor -- start 2024-02-17T12:58:46.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.517+0000 7f132a9a1640 1 -- start start 2024-02-17T12:58:46.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.518+0000 7f132a9a1640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13240c7670 0x7f132406ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:46.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.518+0000 7f132a9a1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240c5fa0 con 0x7f132406aac0 2024-02-17T12:58:46.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.518+0000 7f132a9a1640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240c61d0 con 0x7f132406cad0 2024-02-17T12:58:46.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.518+0000 7f132a9a1640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240c6490 con 0x7f13240c7670 2024-02-17T12:58:46.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.519+0000 7f1328f3e640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f132406aac0 0x7f132414fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58852/0 (socket says 172.21.15.136:58852) 2024-02-17T12:58:46.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.519+0000 7f1328f3e640 1 -- 172.21.15.136:0/485586328 learned_addr learned my addr 172.21.15.136:0/485586328 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:46.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.519+0000 7f13237fe640 1 --2- 172.21.15.136:0/485586328 >> v2:172.21.15.136:3300/0 conn(0x7f13240c7670 0x7f132406ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:46.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.521+0000 7f1322ffd640 1 -- 172.21.15.136:0/485586328 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552342022 0 0) 0x7f13240c61d0 con 0x7f132406cad0 2024-02-17T12:58:46.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.521+0000 7f1322ffd640 1 -- 172.21.15.136:0/485586328 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f130c005730 con 0x7f132406cad0 2024-02-17T12:58:46.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.524+0000 7f13237fe640 1 -- 172.21.15.136:0/485586328 >> v1:172.21.15.160:6789/0 conn(0x7f132406cad0 legacy=0x7f1324156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.524+0000 7f13237fe640 1 -- 172.21.15.136:0/485586328 >> v1:172.21.15.136:6789/0 conn(0x7f132406aac0 legacy=0x7f132414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.524+0000 7f13237fe640 1 -- 172.21.15.136:0/485586328 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240c6770 con 0x7f13240c7670 2024-02-17T12:58:46.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.527+0000 7f13237fe640 1 --2- 172.21.15.136:0/485586328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13240c7670 0x7f132406ceb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13180097a0 tx=0x7f131802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62fc3979ae7d85c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:46.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.530+0000 7f1322ffd640 1 -- 172.21.15.136:0/485586328 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131802f810 con 0x7f13240c7670 2024-02-17T12:58:46.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.530+0000 7f1322ffd640 1 -- 172.21.15.136:0/485586328 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131802f970 con 0x7f13240c7670 2024-02-17T12:58:46.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.530+0000 7f1322ffd640 1 -- 172.21.15.136:0/485586328 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131802fd00 con 0x7f13240c7670 2024-02-17T12:58:46.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 -- 172.21.15.136:0/485586328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13240c7670 msgr2=0x7f132406ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 --2- 172.21.15.136:0/485586328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13240c7670 0x7f132406ceb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13180097a0 tx=0x7f131802b9f0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 -- 172.21.15.136:0/485586328 shutdown_connections 2024-02-17T12:58:46.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 --2- 172.21.15.136:0/485586328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13240c7670 0x7f132406ceb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 -- 172.21.15.136:0/485586328 >> 172.21.15.136:0/485586328 conn(0x7f13240c7e90 msgr2=0x7f13240c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:46.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 -- 172.21.15.136:0/485586328 shutdown_connections 2024-02-17T12:58:46.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.531+0000 7f132a9a1640 1 -- 172.21.15.136:0/485586328 wait complete. 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.532+0000 7f132a9a1640 1 Processor -- start 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 -- start start 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 0x7f13241f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f132406cad0 0x7f132414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13240c7670 0x7f132414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324152c00 con 0x7f132406aac0 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240c5ca0 con 0x7f13240c7670 2024-02-17T12:58:46.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.533+0000 7f132a9a1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13241f0120 con 0x7f132406cad0 2024-02-17T12:58:46.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.534+0000 7f1323fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 0x7f13241f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:46.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.534+0000 7f1323fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 0x7f13241f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35258/0 (socket says 172.21.15.136:35258) 2024-02-17T12:58:46.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.534+0000 7f1323fff640 1 -- 172.21.15.136:0/522844794 learned_addr learned my addr 172.21.15.136:0/522844794 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:46.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.534+0000 7f13237fe640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f132406cad0 0x7f132414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:46.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.534+0000 7f1328f3e640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13240c7670 0x7f132414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:46.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.537+0000 7f1323fff640 1 -- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f132406cad0 msgr2=0x7f132414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.537+0000 7f1323fff640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f132406cad0 0x7f132414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.537+0000 7f1323fff640 1 -- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13240c7670 msgr2=0x7f132414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:46.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.537+0000 7f1323fff640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13240c7670 0x7f132414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:46.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.537+0000 7f1323fff640 1 -- 172.21.15.136:0/522844794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318009400 con 0x7f132406aac0 2024-02-17T12:58:46.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.539+0000 7f1323fff640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 0x7f13241f0b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f131400c500 tx=0x7f131400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:46.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.543+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140052d0 con 0x7f132406aac0 2024-02-17T12:58:46.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.543+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314005470 con 0x7f132406aac0 2024-02-17T12:58:46.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.543+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314003830 con 0x7f132406aac0 2024-02-17T12:58:46.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.543+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13241f0650 con 0x7f132406aac0 2024-02-17T12:58:46.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.543+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13240ca960 con 0x7f132406aac0 2024-02-17T12:58:46.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.544+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1324071ed0 con 0x7f132406aac0 2024-02-17T12:58:46.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.788+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1314003990 con 0x7f132406aac0 2024-02-17T12:58:46.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.789+0000 7f1320ff9640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f131006b890 0x7f131006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:46.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.789+0000 7f13237fe640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f131006b890 0x7f131006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:46.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.789+0000 7f13237fe640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f131006b890 0x7f131006dd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1318036000 tx=0x7f1318008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:46.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.802+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f13140586f0 con 0x7f132406aac0 2024-02-17T12:58:46.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.802+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1314054990 con 0x7f132406aac0 2024-02-17T12:58:46.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:46.977+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1324156370 con 0x7f132406aac0 2024-02-17T12:58:47.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.016+0000 7f1320ff9640 1 -- 172.21.15.136:0/522844794 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f1314058050 con 0x7f132406aac0 2024-02-17T12:58:47.006 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:47.007 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f131006b890 msgr2=0x7f131006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f131006b890 0x7f131006dd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1318036000 tx=0x7f1318008030 comp rx=0 tx=0).stop 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 msgr2=0x7f13241f0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 0x7f13241f0b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f131400c500 tx=0x7f131400c9c0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 shutdown_connections 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f131006b890 0x7f131006dd50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13240c7670 0x7f132414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f132406cad0 0x7f132414aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 --2- 172.21.15.136:0/522844794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f132406aac0 0x7f13241f0b10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 >> 172.21.15.136:0/522844794 conn(0x7f13240c7e90 msgr2=0x7f13241565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 shutdown_connections 2024-02-17T12:58:47.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.018+0000 7f132a9a1640 1 -- 172.21.15.136:0/522844794 wait complete. 2024-02-17T12:58:47.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:57:54.504936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:57:56.035257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T12:58:00.288619+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T12:58:47.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:58:47.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.133+0000 7fc8320df640 1 Processor -- start 2024-02-17T12:58:47.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.133+0000 7fc8320df640 1 -- start start 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.134+0000 7fc8320df640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc82c150b50 0x7fc82c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.134+0000 7fc8320df640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc82c1573e0 0x7fc82c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.134+0000 7fc8320df640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c0c3690 con 0x7fc82c0ca090 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.134+0000 7fc8320df640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c159f50 con 0x7fc82c1573e0 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.134+0000 7fc8320df640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c157870 con 0x7fc82c150b50 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.135+0000 7fc82bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc82c1573e0 0x7fc82c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.135+0000 7fc82bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc82c1573e0 0x7fc82c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35268/0 (socket says 172.21.15.136:35268) 2024-02-17T12:58:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.135+0000 7fc82bfff640 1 -- 172.21.15.136:0/3061294933 learned_addr learned my addr 172.21.15.136:0/3061294933 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:47.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.135+0000 7fc82b7fe640 1 --2- 172.21.15.136:0/3061294933 >> v2:172.21.15.160:3300/0 conn(0x7fc82c150b50 0x7fc82c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.137+0000 7fc82bfff640 1 -- 172.21.15.136:0/3061294933 >> v2:172.21.15.160:3300/0 conn(0x7fc82c150b50 msgr2=0x7fc82c0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:47.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.137+0000 7fc82bfff640 1 --2- 172.21.15.136:0/3061294933 >> v2:172.21.15.160:3300/0 conn(0x7fc82c150b50 0x7fc82c0726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.137+0000 7fc82bfff640 1 -- 172.21.15.136:0/3061294933 >> v1:172.21.15.160:6789/0 conn(0x7fc82c0ca090 legacy=0x7fc82c0c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.137+0000 7fc82bfff640 1 -- 172.21.15.136:0/3061294933 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0c38e0 con 0x7fc82c1573e0 2024-02-17T12:58:47.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.139+0000 7fc82bfff640 1 --2- 172.21.15.136:0/3061294933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c15a3e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc82c070da0 tx=0x7fc82402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f880590802aca559 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:47.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.142+0000 7fc82a7fc640 1 -- 172.21.15.136:0/3061294933 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82402cb20 con 0x7fc82c1573e0 2024-02-17T12:58:47.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc82a7fc640 1 -- 172.21.15.136:0/3061294933 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82402cc80 con 0x7fc82c1573e0 2024-02-17T12:58:47.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc82a7fc640 1 -- 172.21.15.136:0/3061294933 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240343f0 con 0x7fc82c1573e0 2024-02-17T12:58:47.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 -- 172.21.15.136:0/3061294933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 msgr2=0x7fc82c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 --2- 172.21.15.136:0/3061294933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c15a3e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc82c070da0 tx=0x7fc82402bf80 comp rx=0 tx=0).stop 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 -- 172.21.15.136:0/3061294933 shutdown_connections 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 --2- 172.21.15.136:0/3061294933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c15a3e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 --2- 172.21.15.136:0/3061294933 >> v2:172.21.15.160:3300/0 conn(0x7fc82c150b50 0x7fc82c0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 -- 172.21.15.136:0/3061294933 >> 172.21.15.136:0/3061294933 conn(0x7fc82c06bbd0 msgr2=0x7fc82c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 -- 172.21.15.136:0/3061294933 shutdown_connections 2024-02-17T12:58:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.143+0000 7fc8320df640 1 -- 172.21.15.136:0/3061294933 wait complete. 2024-02-17T12:58:47.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.144+0000 7fc8320df640 1 Processor -- start 2024-02-17T12:58:47.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 -- start start 2024-02-17T12:58:47.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 0x7fc82c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc82c150b50 0x7fc82c1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c1566a0 con 0x7fc82c1573e0 2024-02-17T12:58:47.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c157f60 con 0x7fc82c0ca090 2024-02-17T12:58:47.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.145+0000 7fc8320df640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c1f0600 con 0x7fc82c150b50 2024-02-17T12:58:47.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.146+0000 7fc82b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 0x7fc82c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.146+0000 7fc82affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc82c150b50 0x7fc82c1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.147+0000 7fc82b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 0x7fc82c0c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:42116/0 (socket says 172.21.15.136:42116) 2024-02-17T12:58:47.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.147+0000 7fc82b7fe640 1 -- 172.21.15.136:0/3591187552 learned_addr learned my addr 172.21.15.136:0/3591187552 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:47.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.147+0000 7fc82bfff640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.150+0000 7fc82b7fe640 1 -- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc82c150b50 msgr2=0x7fc82c1465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.150+0000 7fc82b7fe640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc82c150b50 0x7fc82c1465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.150+0000 7fc82b7fe640 1 -- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 msgr2=0x7fc82c146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.150+0000 7fc82b7fe640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.150+0000 7fc82b7fe640 1 -- 172.21.15.136:0/3591187552 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009b30 con 0x7fc82c0ca090 2024-02-17T12:58:47.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.153+0000 7fc82b7fe640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 0x7fc82c0c8590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0089b0 tx=0x7fc81c008aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:47.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.157+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c010040 con 0x7fc82c0ca090 2024-02-17T12:58:47.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.157+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c009d20 con 0x7fc82c0ca090 2024-02-17T12:58:47.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.157+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00bea0 con 0x7fc82c0ca090 2024-02-17T12:58:47.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.157+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c158200 con 0x7fc82c0ca090 2024-02-17T12:58:47.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.157+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c1587c0 con 0x7fc82c0ca090 2024-02-17T12:58:47.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.158+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c072d70 con 0x7fc82c0ca090 2024-02-17T12:58:47.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.178+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc81c016630 con 0x7fc82c0ca090 2024-02-17T12:58:47.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.178+0000 7fc813fff640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc81806b860 0x7fc81806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.178+0000 7fc82affd640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc81806b860 0x7fc81806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.179+0000 7fc82affd640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc81806b860 0x7fc81806dd20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc82c159dd0 tx=0x7fc820009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:47.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.410+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fc81c059030 con 0x7fc82c0ca090 2024-02-17T12:58:47.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.421+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc81c0552d0 con 0x7fc82c0ca090 2024-02-17T12:58:47.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.597+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc82c067cb0 con 0x7fc82c0ca090 2024-02-17T12:58:47.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.619+0000 7fc813fff640 1 -- 172.21.15.136:0/3591187552 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc81c025020 con 0x7fc82c0ca090 2024-02-17T12:58:47.609 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T12:58:47.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc81806b860 msgr2=0x7fc81806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc81806b860 0x7fc81806dd20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc82c159dd0 tx=0x7fc820009040 comp rx=0 tx=0).stop 2024-02-17T12:58:47.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 msgr2=0x7fc82c0c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 0x7fc82c0c8590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0089b0 tx=0x7fc81c008aa0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 shutdown_connections 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc81806b860 0x7fc81806dd20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc82c1573e0 0x7fc82c146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc82c150b50 0x7fc82c1465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 --2- 172.21.15.136:0/3591187552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc82c0ca090 0x7fc82c0c8590 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 >> 172.21.15.136:0/3591187552 conn(0x7fc82c06bbd0 msgr2=0x7fc82c14e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 shutdown_connections 2024-02-17T12:58:47.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.621+0000 7fc8320df640 1 -- 172.21.15.136:0/3591187552 wait complete. 2024-02-17T12:58:47.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:58:47.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.740+0000 7f16d1ad4640 1 Processor -- start 2024-02-17T12:58:47.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.740+0000 7f16d1ad4640 1 -- start start 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.740+0000 7f16d1ad4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0c44e0 0x7f16cc0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.740+0000 7f16d1ad4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc154310 con 0x7f16cc0ca7c0 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.740+0000 7f16d1ad4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc15d2c0 con 0x7f16cc153f30 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.740+0000 7f16d1ad4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc15d560 con 0x7f16cc0c44e0 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.741+0000 7f16cbfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f16cc0ca7c0 0x7f16cc159f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58856/0 (socket says 172.21.15.136:58856) 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.741+0000 7f16cbfff640 1 -- 172.21.15.136:0/491742670 learned_addr learned my addr 172.21.15.136:0/491742670 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:47.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.741+0000 7f16caffd640 1 --2- 172.21.15.136:0/491742670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0c44e0 0x7f16cc0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.743+0000 7f16ca7fc640 1 -- 172.21.15.136:0/491742670 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205703179 0 0) 0x7f16cc154310 con 0x7f16cc0ca7c0 2024-02-17T12:58:47.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.744+0000 7f16ca7fc640 1 -- 172.21.15.136:0/491742670 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b4003520 con 0x7f16cc0ca7c0 2024-02-17T12:58:47.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.744+0000 7f16caffd640 1 -- 172.21.15.136:0/491742670 >> v1:172.21.15.160:6789/0 conn(0x7f16cc153f30 legacy=0x7f16cc0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.744+0000 7f16caffd640 1 -- 172.21.15.136:0/491742670 >> v1:172.21.15.136:6789/0 conn(0x7f16cc0ca7c0 legacy=0x7f16cc159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.744+0000 7f16ca7fc640 1 -- 172.21.15.136:0/491742670 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279030919 0 0) 0x7f16cc15d2c0 con 0x7f16cc153f30 2024-02-17T12:58:47.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.744+0000 7f16caffd640 1 -- 172.21.15.136:0/491742670 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc15d840 con 0x7f16cc0c44e0 2024-02-17T12:58:47.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.746+0000 7f16caffd640 1 --2- 172.21.15.136:0/491742670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0c44e0 0x7f16cc0ca280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16c00097d0 tx=0x7f16c002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72dc7456037fa45 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:47.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.750+0000 7f16ca7fc640 1 -- 172.21.15.136:0/491742670 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0031890 con 0x7f16cc0c44e0 2024-02-17T12:58:47.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.750+0000 7f16ca7fc640 1 -- 172.21.15.136:0/491742670 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c00319f0 con 0x7f16cc0c44e0 2024-02-17T12:58:47.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.750+0000 7f16ca7fc640 1 -- 172.21.15.136:0/491742670 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0031d80 con 0x7f16cc0c44e0 2024-02-17T12:58:47.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.750+0000 7f16d1ad4640 1 -- 172.21.15.136:0/491742670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0c44e0 msgr2=0x7f16cc0ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.750+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/491742670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0c44e0 0x7f16cc0ca280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16c00097d0 tx=0x7f16c002b930 comp rx=0 tx=0).stop 2024-02-17T12:58:47.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.751+0000 7f16d1ad4640 1 -- 172.21.15.136:0/491742670 shutdown_connections 2024-02-17T12:58:47.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.751+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/491742670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0c44e0 0x7f16cc0ca280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.751+0000 7f16d1ad4640 1 -- 172.21.15.136:0/491742670 >> 172.21.15.136:0/491742670 conn(0x7f16cc0721f0 msgr2=0x7f16cc072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:47.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.751+0000 7f16d1ad4640 1 -- 172.21.15.136:0/491742670 shutdown_connections 2024-02-17T12:58:47.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.751+0000 7f16d1ad4640 1 -- 172.21.15.136:0/491742670 wait complete. 2024-02-17T12:58:47.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.752+0000 7f16d1ad4640 1 Processor -- start 2024-02-17T12:58:47.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.752+0000 7f16d1ad4640 1 -- start start 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16d1ad4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16cc0c44e0 0x7f16cc15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16d1ad4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0ca7c0 0x7f16cc14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16d1ad4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 0x7f16cc157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16d1ad4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc157ba0 con 0x7f16cc153f30 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16d1ad4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc14ec80 con 0x7f16cc0c44e0 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16d1ad4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc14eed0 con 0x7f16cc0ca7c0 2024-02-17T12:58:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16cbfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 0x7f16cc157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16caffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0ca7c0 0x7f16cc14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16cbfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 0x7f16cc157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35280/0 (socket says 172.21.15.136:35280) 2024-02-17T12:58:47.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16cbfff640 1 -- 172.21.15.136:0/51370806 learned_addr learned my addr 172.21.15.136:0/51370806 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:47.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.753+0000 7f16cb7fe640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16cc0c44e0 0x7f16cc15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.757+0000 7f16cbfff640 1 -- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0ca7c0 msgr2=0x7f16cc14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.757+0000 7f16cbfff640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0ca7c0 0x7f16cc14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.757+0000 7f16cbfff640 1 -- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16cc0c44e0 msgr2=0x7f16cc15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.757+0000 7f16cbfff640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16cc0c44e0 0x7f16cc15b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.757+0000 7f16cbfff640 1 -- 172.21.15.136:0/51370806 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0009400 con 0x7f16cc153f30 2024-02-17T12:58:47.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.759+0000 7f16cbfff640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 0x7f16cc157fc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16c400cb40 tx=0x7f16c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:47.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.762+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400aca0 con 0x7f16cc153f30 2024-02-17T12:58:47.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.762+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400ae00 con 0x7f16cc153f30 2024-02-17T12:58:47.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.762+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4012620 con 0x7f16cc153f30 2024-02-17T12:58:47.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.763+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc14f1b0 con 0x7f16cc153f30 2024-02-17T12:58:47.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.763+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc15beb0 con 0x7f16cc153f30 2024-02-17T12:58:47.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:47.763+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc157ce0 con 0x7f16cc153f30 2024-02-17T12:58:47.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.006+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f16c4007070 con 0x7f16cc153f30 2024-02-17T12:58:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.006+0000 7f16b3fff640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f16b806b860 0x7f16b806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.006+0000 7f16cb7fe640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f16b806b860 0x7f16b806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:47.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.007+0000 7f16cb7fe640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f16b806b860 0x7f16b806dd20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000f60 tx=0x7f16bc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.033+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f16c4058c90 con 0x7f16cc153f30 2024-02-17T12:58:48.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.033+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16c4054f30 con 0x7f16cc153f30 2024-02-17T12:58:48.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.207+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16cc157ce0 con 0x7f16cc153f30 2024-02-17T12:58:48.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.212+0000 7f16b3fff640 1 -- 172.21.15.136:0/51370806 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16cc157ce0 con 0x7f16cc153f30 2024-02-17T12:58:48.202 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:48.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f16b806b860 msgr2=0x7f16b806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f16b806b860 0x7f16b806dd20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000f60 tx=0x7f16bc009040 comp rx=0 tx=0).stop 2024-02-17T12:58:48.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 msgr2=0x7f16cc157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 0x7f16cc157fc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16c400cb40 tx=0x7f16c400a060 comp rx=0 tx=0).stop 2024-02-17T12:58:48.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 shutdown_connections 2024-02-17T12:58:48.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f16b806b860 0x7f16b806dd20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16cc153f30 0x7f16cc157fc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16cc0ca7c0 0x7f16cc14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 --2- 172.21.15.136:0/51370806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16cc0c44e0 0x7f16cc15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 >> 172.21.15.136:0/51370806 conn(0x7f16cc0721f0 msgr2=0x7f16cc1519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:48.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 shutdown_connections 2024-02-17T12:58:48.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.214+0000 7f16d1ad4640 1 -- 172.21.15.136:0/51370806 wait complete. 2024-02-17T12:58:48.216 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:58:48.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.330+0000 7fa4a8a9d640 1 Processor -- start 2024-02-17T12:58:48.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.330+0000 7fa4a8a9d640 1 -- start start 2024-02-17T12:58:48.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.331+0000 7fa4a8a9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa4a414e3b0 0x7fa4a40c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.331+0000 7fa4a8a9d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a406df40 con 0x7fa4a40c7940 2024-02-17T12:58:48.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.331+0000 7fa4a8a9d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a4071b40 con 0x7fa4a40708f0 2024-02-17T12:58:48.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.331+0000 7fa4a8a9d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a40c6420 con 0x7fa4a414e3b0 2024-02-17T12:58:48.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.332+0000 7fa4a2d9d640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa4a40708f0 0x7fa4a40c4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:41082/0 (socket says 172.21.15.136:41082) 2024-02-17T12:58:48.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.332+0000 7fa4a2d9d640 1 -- 172.21.15.136:0/1523058944 learned_addr learned my addr 172.21.15.136:0/1523058944 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:48.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.332+0000 7fa4a259c640 1 --2- 172.21.15.136:0/1523058944 >> v2:172.21.15.136:3300/0 conn(0x7fa4a414e3b0 0x7fa4a40c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.334+0000 7fa4a1d9b640 1 -- 172.21.15.136:0/1523058944 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220224175 0 0) 0x7fa4a4071b40 con 0x7fa4a40708f0 2024-02-17T12:58:48.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.334+0000 7fa4a1d9b640 1 -- 172.21.15.136:0/1523058944 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa490003520 con 0x7fa4a40708f0 2024-02-17T12:58:48.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.337+0000 7fa4a259c640 1 -- 172.21.15.136:0/1523058944 >> v1:172.21.15.160:6789/0 conn(0x7fa4a40708f0 legacy=0x7fa4a40c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.337+0000 7fa4a259c640 1 -- 172.21.15.136:0/1523058944 >> v1:172.21.15.136:6789/0 conn(0x7fa4a40c7940 legacy=0x7fa4a4157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.337+0000 7fa4a259c640 1 -- 172.21.15.136:0/1523058944 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a414e790 con 0x7fa4a414e3b0 2024-02-17T12:58:48.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.340+0000 7fa4a259c640 1 --2- 172.21.15.136:0/1523058944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a414e3b0 0x7fa4a40c5d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4940097a0 tx=0x7fa49402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4febbf9abd32cabc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.344+0000 7fa4a1d9b640 1 -- 172.21.15.136:0/1523058944 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494031830 con 0x7fa4a414e3b0 2024-02-17T12:58:48.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a1d9b640 1 -- 172.21.15.136:0/1523058944 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494031990 con 0x7fa4a414e3b0 2024-02-17T12:58:48.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a1d9b640 1 -- 172.21.15.136:0/1523058944 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494031d20 con 0x7fa4a414e3b0 2024-02-17T12:58:48.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1523058944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a414e3b0 msgr2=0x7fa4a40c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1523058944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a414e3b0 0x7fa4a40c5d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4940097a0 tx=0x7fa49402b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1523058944 shutdown_connections 2024-02-17T12:58:48.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1523058944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a414e3b0 0x7fa4a40c5d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1523058944 >> 172.21.15.136:0/1523058944 conn(0x7fa4a40c7e90 msgr2=0x7fa4a40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:48.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1523058944 shutdown_connections 2024-02-17T12:58:48.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.345+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1523058944 wait complete. 2024-02-17T12:58:48.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 Processor -- start 2024-02-17T12:58:48.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 -- start start 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4a40708f0 0x7fa4a41ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 0x7fa4a406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4a414e3b0 0x7fa4a4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a41ee8f0 con 0x7fa4a40c7940 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4148a10 con 0x7fa4a414e3b0 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.347+0000 7fa4a8a9d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4148cf0 con 0x7fa4a40708f0 2024-02-17T12:58:48.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.348+0000 7fa49bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 0x7fa4a406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.348+0000 7fa4a259c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4a40708f0 0x7fa4a41ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.348+0000 7fa4a2d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4a414e3b0 0x7fa4a4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.348+0000 7fa49bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 0x7fa4a406ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35290/0 (socket says 172.21.15.136:35290) 2024-02-17T12:58:48.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.348+0000 7fa49bfff640 1 -- 172.21.15.136:0/1796007373 learned_addr learned my addr 172.21.15.136:0/1796007373 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:48.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.352+0000 7fa49bfff640 1 -- 172.21.15.136:0/1796007373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4a40708f0 msgr2=0x7fa4a41ee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.352+0000 7fa49bfff640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4a40708f0 0x7fa4a41ee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.352+0000 7fa49bfff640 1 -- 172.21.15.136:0/1796007373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4a414e3b0 msgr2=0x7fa4a4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.352+0000 7fa49bfff640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4a414e3b0 0x7fa4a4157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.352+0000 7fa49bfff640 1 -- 172.21.15.136:0/1796007373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494009400 con 0x7fa4a40c7940 2024-02-17T12:58:48.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.354+0000 7fa49bfff640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 0x7fa4a406ad30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00c3a0 tx=0x7fa48c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.357+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0052d0 con 0x7fa4a40c7940 2024-02-17T12:58:48.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.357+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c005450 con 0x7fa4a40c7940 2024-02-17T12:58:48.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.357+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c007260 con 0x7fa4a40c7940 2024-02-17T12:58:48.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.357+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a4148fd0 con 0x7fa4a40c7940 2024-02-17T12:58:48.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.357+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a4149590 con 0x7fa4a40c7940 2024-02-17T12:58:48.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.358+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a40c2530 con 0x7fa4a40c7940 2024-02-17T12:58:48.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.377+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa48c0073c0 con 0x7fa4a40c7940 2024-02-17T12:58:48.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.377+0000 7fa49affd640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa48406b840 0x7fa48406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.378+0000 7fa4a259c640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa48406b840 0x7fa48406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.378+0000 7fa4a259c640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa48406b840 0x7fa48406dd00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa494036000 tx=0x7fa49403c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.613+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fa48c058600 con 0x7fa4a40c7940 2024-02-17T12:58:48.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.614+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa48c0548a0 con 0x7fa4a40c7940 2024-02-17T12:58:48.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.795+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4a40c6650 con 0x7fa4a40c7940 2024-02-17T12:58:48.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.801+0000 7fa49affd640 1 -- 172.21.15.136:0/1796007373 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa48c020030 con 0x7fa4a40c7940 2024-02-17T12:58:48.791 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-02-17T12:58:48.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa48406b840 msgr2=0x7fa48406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa48406b840 0x7fa48406dd00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa494036000 tx=0x7fa49403c040 comp rx=0 tx=0).stop 2024-02-17T12:58:48.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 msgr2=0x7fa4a406ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 0x7fa4a406ad30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00c3a0 tx=0x7fa48c00c860 comp rx=0 tx=0).stop 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 shutdown_connections 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa48406b840 0x7fa48406dd00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4a414e3b0 0x7fa4a4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4a40c7940 0x7fa4a406ad30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 --2- 172.21.15.136:0/1796007373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4a40708f0 0x7fa4a41ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 >> 172.21.15.136:0/1796007373 conn(0x7fa4a40c7e90 msgr2=0x7fa4a40c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 shutdown_connections 2024-02-17T12:58:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.803+0000 7fa4a8a9d640 1 -- 172.21.15.136:0/1796007373 wait complete. 2024-02-17T12:58:48.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T12:58:48.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.919+0000 7f155fb5e640 1 Processor -- start 2024-02-17T12:58:48.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.920+0000 7f155fb5e640 1 -- start start 2024-02-17T12:58:48.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.920+0000 7f155fb5e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f15580c9730 0x7f15580cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.920+0000 7f155fb5e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15580c8b60 con 0x7f15581572b0 2024-02-17T12:58:48.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.920+0000 7f155fb5e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155815a030 con 0x7f1558157690 2024-02-17T12:58:48.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.920+0000 7f155fb5e640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1558159e40 con 0x7f15580c9730 2024-02-17T12:58:48.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.921+0000 7f155d8fa640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f15581572b0 0x7f155806afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58874/0 (socket says 172.21.15.136:58874) 2024-02-17T12:58:48.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.921+0000 7f155d8fa640 1 -- 172.21.15.136:0/482570017 learned_addr learned my addr 172.21.15.136:0/482570017 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:48.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.921+0000 7f155e0fb640 1 --2- 172.21.15.136:0/482570017 >> v2:172.21.15.160:3300/0 conn(0x7f15580c9730 0x7f15580cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.923+0000 7f155c8f8640 1 -- 172.21.15.136:0/482570017 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681582143 0 0) 0x7f15580c8b60 con 0x7f15581572b0 2024-02-17T12:58:48.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.923+0000 7f155c8f8640 1 -- 172.21.15.136:0/482570017 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003520 con 0x7f15581572b0 2024-02-17T12:58:48.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.924+0000 7f155e0fb640 1 -- 172.21.15.136:0/482570017 >> v1:172.21.15.160:6789/0 conn(0x7f1558157690 legacy=0x7f15580c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.924+0000 7f155e0fb640 1 -- 172.21.15.136:0/482570017 >> v1:172.21.15.136:6789/0 conn(0x7f15581572b0 legacy=0x7f155806afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.924+0000 7f155e0fb640 1 -- 172.21.15.136:0/482570017 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155815a310 con 0x7f15580c9730 2024-02-17T12:58:48.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.929+0000 7f155e0fb640 1 --2- 172.21.15.136:0/482570017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1550009d90 tx=0x7f155002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1ab177c087c94fd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.933+0000 7f155c8f8640 1 -- 172.21.15.136:0/482570017 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155002cd00 con 0x7f15580c9730 2024-02-17T12:58:48.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.933+0000 7f155c8f8640 1 -- 172.21.15.136:0/482570017 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155002ce60 con 0x7f15580c9730 2024-02-17T12:58:48.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.933+0000 7f155c8f8640 1 -- 172.21.15.136:0/482570017 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550034660 con 0x7f15580c9730 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.933+0000 7f155fb5e640 1 -- 172.21.15.136:0/482570017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 msgr2=0x7f15580cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.933+0000 7f155fb5e640 1 --2- 172.21.15.136:0/482570017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1550009d90 tx=0x7f155002bf50 comp rx=0 tx=0).stop 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.934+0000 7f155fb5e640 1 -- 172.21.15.136:0/482570017 shutdown_connections 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.934+0000 7f155fb5e640 1 --2- 172.21.15.136:0/482570017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.934+0000 7f155fb5e640 1 -- 172.21.15.136:0/482570017 >> 172.21.15.136:0/482570017 conn(0x7f155806bbd0 msgr2=0x7f155806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.934+0000 7f155fb5e640 1 -- 172.21.15.136:0/482570017 shutdown_connections 2024-02-17T12:58:48.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.934+0000 7f155fb5e640 1 -- 172.21.15.136:0/482570017 wait complete. 2024-02-17T12:58:48.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 Processor -- start 2024-02-17T12:58:48.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 -- start start 2024-02-17T12:58:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15581572b0 0x7f15580725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 0x7f15581efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581ef700 con 0x7f1558157690 2024-02-17T12:58:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580cd070 con 0x7f15580c9730 2024-02-17T12:58:48.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.935+0000 7f155fb5e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15580be8c0 con 0x7f15581572b0 2024-02-17T12:58:48.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.936+0000 7f155e0fb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 0x7f15581efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.936+0000 7f155d8fa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.936+0000 7f155d0f9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15581572b0 0x7f15580725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.936+0000 7f155e0fb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 0x7f15581efb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35302/0 (socket says 172.21.15.136:35302) 2024-02-17T12:58:48.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.936+0000 7f155e0fb640 1 -- 172.21.15.136:0/3432694964 learned_addr learned my addr 172.21.15.136:0/3432694964 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.939+0000 7f155e0fb640 1 -- 172.21.15.136:0/3432694964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15581572b0 msgr2=0x7f15580725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.939+0000 7f155e0fb640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15581572b0 0x7f15580725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.939+0000 7f155e0fb640 1 -- 172.21.15.136:0/3432694964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 msgr2=0x7f15580cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.939+0000 7f155e0fb640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:48.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.939+0000 7f155e0fb640 1 -- 172.21.15.136:0/3432694964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009a70 con 0x7f1558157690 2024-02-17T12:58:48.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.942+0000 7f155e0fb640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 0x7f15581efb30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1550009d90 tx=0x7f1550004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.945+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155003d600 con 0x7f1558157690 2024-02-17T12:58:48.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.945+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155003d780 con 0x7f1558157690 2024-02-17T12:58:48.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.945+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155003db30 con 0x7f1558157690 2024-02-17T12:58:48.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.945+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15580beba0 con 0x7f1558157690 2024-02-17T12:58:48.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.945+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15580bf160 con 0x7f1558157690 2024-02-17T12:58:48.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.946+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15581ef850 con 0x7f1558157690 2024-02-17T12:58:48.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.964+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f155003b040 con 0x7f1558157690 2024-02-17T12:58:48.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.964+0000 7f154e7fc640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f153c06b890 0x7f153c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:48.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.964+0000 7f155d8fa640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f153c06b890 0x7f153c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:48.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.965+0000 7f155d8fa640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f153c06b890 0x7f153c06dd50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15540011e0 tx=0x7f1554007d30 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:48.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:48.967+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f155007b1d0 con 0x7f1558157690 2024-02-17T12:58:49.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.210+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1550077470 con 0x7f1558157690 2024-02-17T12:58:49.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.380+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f15581ef850 con 0x7f1558157690 2024-02-17T12:58:49.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.386+0000 7f154e7fc640 1 -- 172.21.15.136:0/3432694964 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f15581ef850 con 0x7f1558157690 2024-02-17T12:58:49.376 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f153c06b890 msgr2=0x7f153c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f153c06b890 0x7f153c06dd50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15540011e0 tx=0x7f1554007d30 comp rx=0 tx=0).stop 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 msgr2=0x7f15581efb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 0x7f15581efb30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1550009d90 tx=0x7f1550004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 shutdown_connections 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f153c06b890 0x7f153c06dd50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1558157690 0x7f15581efb30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15581572b0 0x7f15580725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 --2- 172.21.15.136:0/3432694964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15580c9730 0x7f15580cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 >> 172.21.15.136:0/3432694964 conn(0x7f155806bbd0 msgr2=0x7f15580c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:49.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 shutdown_connections 2024-02-17T12:58:49.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.388+0000 7f155fb5e640 1 -- 172.21.15.136:0/3432694964 wait complete. 2024-02-17T12:58:49.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:58:49.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.500+0000 7f92c7439640 1 Processor -- start 2024-02-17T12:58:49.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.500+0000 7f92c7439640 1 -- start start 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.501+0000 7f92c7439640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92c0151c00 0x7f92c00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.501+0000 7f92c7439640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c006f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.501+0000 7f92c7439640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00c84a0 con 0x7f92c006f750 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.501+0000 7f92c7439640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c00b0310 con 0x7f92c0151c00 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.501+0000 7f92c7439640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01586c0 con 0x7f92c00c4270 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.502+0000 7f92c51d5640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92c0151c00 0x7f92c00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:49.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.502+0000 7f92c49d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:49.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.502+0000 7f92c51d5640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92c0151c00 0x7f92c00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35318/0 (socket says 172.21.15.136:35318) 2024-02-17T12:58:49.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.502+0000 7f92c59d6640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f92c006f750 0x7f92c0070900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:41110/0 (socket says 172.21.15.136:41110) 2024-02-17T12:58:49.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.502+0000 7f92c51d5640 1 -- 172.21.15.136:0/1727704533 learned_addr learned my addr 172.21.15.136:0/1727704533 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:49.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.504+0000 7f92c51d5640 1 -- 172.21.15.136:0/1727704533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 msgr2=0x7f92c006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:49.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.504+0000 7f92c51d5640 1 --2- 172.21.15.136:0/1727704533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.504+0000 7f92c51d5640 1 -- 172.21.15.136:0/1727704533 >> v1:172.21.15.160:6789/0 conn(0x7f92c006f750 legacy=0x7f92c0070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:49.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.504+0000 7f92c51d5640 1 -- 172.21.15.136:0/1727704533 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0158960 con 0x7f92c0151c00 2024-02-17T12:58:49.496 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.506+0000 7f92c51d5640 1 --2- 172.21.15.136:0/1727704533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c00c7f60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c4666c0931370d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:49.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.510+0000 7f92b7fff640 1 -- 172.21.15.136:0/1727704533 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc02f840 con 0x7f92c0151c00 2024-02-17T12:58:49.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.510+0000 7f92b7fff640 1 -- 172.21.15.136:0/1727704533 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc02f9a0 con 0x7f92c0151c00 2024-02-17T12:58:49.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.510+0000 7f92b7fff640 1 -- 172.21.15.136:0/1727704533 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc02fd30 con 0x7f92c0151c00 2024-02-17T12:58:49.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 -- 172.21.15.136:0/1727704533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 msgr2=0x7f92c00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:49.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 --2- 172.21.15.136:0/1727704533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c00c7f60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc02ba20 comp rx=0 tx=0).stop 2024-02-17T12:58:49.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 -- 172.21.15.136:0/1727704533 shutdown_connections 2024-02-17T12:58:49.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 --2- 172.21.15.136:0/1727704533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 --2- 172.21.15.136:0/1727704533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c00c7f60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 -- 172.21.15.136:0/1727704533 >> 172.21.15.136:0/1727704533 conn(0x7f92c006b0f0 msgr2=0x7f92c00668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:49.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 -- 172.21.15.136:0/1727704533 shutdown_connections 2024-02-17T12:58:49.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.511+0000 7f92c7439640 1 -- 172.21.15.136:0/1727704533 wait complete. 2024-02-17T12:58:49.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.512+0000 7f92c7439640 1 Processor -- start 2024-02-17T12:58:49.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.512+0000 7f92c7439640 1 -- start start 2024-02-17T12:58:49.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c7439640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c006f750 0x7f92c00cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:49.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c7439640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c00cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:49.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c7439640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c01ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c7439640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00cdce0 con 0x7f92c0151c00 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c7439640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01f1de0 con 0x7f92c006f750 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c7439640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00ce260 con 0x7f92c00c4270 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c59d6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c01ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c49d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c00cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c51d5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c006f750 0x7f92c00cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c59d6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c01ed980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35328/0 (socket says 172.21.15.136:35328) 2024-02-17T12:58:49.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.513+0000 7f92c59d6640 1 -- 172.21.15.136:0/3826069576 learned_addr learned my addr 172.21.15.136:0/3826069576 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:49.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.517+0000 7f92c59d6640 1 -- 172.21.15.136:0/3826069576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 msgr2=0x7f92c00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:49.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.517+0000 7f92c59d6640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c00cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.517+0000 7f92c59d6640 1 -- 172.21.15.136:0/3826069576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c006f750 msgr2=0x7f92c00cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:49.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.517+0000 7f92c59d6640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c006f750 0x7f92c00cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:49.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.517+0000 7f92c59d6640 1 -- 172.21.15.136:0/3826069576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0094d0 con 0x7f92c0151c00 2024-02-17T12:58:49.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.519+0000 7f92c59d6640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c01ed980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c780 tx=0x7f92b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:49.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.522+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800ce90 con 0x7f92c0151c00 2024-02-17T12:58:49.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.522+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800a640 con 0x7f92c0151c00 2024-02-17T12:58:49.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.522+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800a9f0 con 0x7f92c0151c00 2024-02-17T12:58:49.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.522+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c00cdf80 con 0x7f92c0151c00 2024-02-17T12:58:49.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.523+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c01f1300 con 0x7f92c0151c00 2024-02-17T12:58:49.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.524+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c0067bf0 con 0x7f92c0151c00 2024-02-17T12:58:49.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.541+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f92b800ab50 con 0x7f92c0151c00 2024-02-17T12:58:49.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.542+0000 7f92b5ffb640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f92a406b860 0x7f92a406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:49.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.542+0000 7f92c51d5640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f92a406b860 0x7f92a406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:49.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.542+0000 7f92c51d5640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f92a406b860 0x7f92a406dd20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f92bc036000 tx=0x7f92bc008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:49.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.545+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f92b8058820 con 0x7f92c0151c00 2024-02-17T12:58:49.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:49.783+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92b8054ac0 con 0x7f92c0151c00 2024-02-17T12:58:49.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.009+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92c004efc0 con 0x7f92c0151c00 2024-02-17T12:58:50.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.022+0000 7f92b5ffb640 1 -- 172.21.15.136:0/3826069576 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6599 (secure 0 0 0) 0x7f92b8058180 con 0x7f92c0151c00 2024-02-17T12:58:50.013 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:50.013 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:37.333637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4288,"mds_2":4248,"mds_3":4245,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4245":{"gid":4245,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4248":{"gid":4248,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:58:50.013 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 18 2024-02-17T12:58:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.024+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f92a406b860 msgr2=0x7f92a406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f92a406b860 0x7f92a406dd20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f92bc036000 tx=0x7f92bc008030 comp rx=0 tx=0).stop 2024-02-17T12:58:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 msgr2=0x7f92c01ed980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c01ed980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c780 tx=0x7f92b800cc40 comp rx=0 tx=0).stop 2024-02-17T12:58:50.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 shutdown_connections 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f92a406b860 0x7f92a406dd20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92c0151c00 0x7f92c01ed980 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92c00c4270 0x7f92c00cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 --2- 172.21.15.136:0/3826069576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92c006f750 0x7f92c00cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 >> 172.21.15.136:0/3826069576 conn(0x7f92c006b0f0 msgr2=0x7f92c01556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 shutdown_connections 2024-02-17T12:58:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.025+0000 7f92c7439640 1 -- 172.21.15.136:0/3826069576 wait complete. 2024-02-17T12:58:50.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:50.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.138+0000 7fc7a0b6c640 1 Processor -- start 2024-02-17T12:58:50.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.138+0000 7fc7a0b6c640 1 -- start start 2024-02-17T12:58:50.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.139+0000 7fc7a0b6c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc79c06f4f0 0x7fc79c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.139+0000 7fc7a0b6c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc79c0aff30 0x7fc79c070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.139+0000 7fc7a0b6c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c06c260 con 0x7fc79c06f8d0 2024-02-17T12:58:50.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.139+0000 7fc7a0b6c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c06dbe0 con 0x7fc79c0aff30 2024-02-17T12:58:50.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.139+0000 7fc7a0b6c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c15a1a0 con 0x7fc79c06f4f0 2024-02-17T12:58:50.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.140+0000 7fc79ad9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc79c0aff30 0x7fc79c070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.140+0000 7fc79a59c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc79c06f4f0 0x7fc79c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.140+0000 7fc79ad9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc79c0aff30 0x7fc79c070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35336/0 (socket says 172.21.15.136:35336) 2024-02-17T12:58:50.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.140+0000 7fc79ad9d640 1 -- 172.21.15.136:0/626223646 learned_addr learned my addr 172.21.15.136:0/626223646 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:50.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.142+0000 7fc79ad9d640 1 -- 172.21.15.136:0/626223646 >> v2:172.21.15.160:3300/0 conn(0x7fc79c06f4f0 msgr2=0x7fc79c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:50.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.142+0000 7fc79ad9d640 1 --2- 172.21.15.136:0/626223646 >> v2:172.21.15.160:3300/0 conn(0x7fc79c06f4f0 0x7fc79c06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.142+0000 7fc79ad9d640 1 -- 172.21.15.136:0/626223646 >> v1:172.21.15.160:6789/0 conn(0x7fc79c06f8d0 legacy=0x7fc79c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.142+0000 7fc79ad9d640 1 -- 172.21.15.136:0/626223646 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c15a480 con 0x7fc79c0aff30 2024-02-17T12:58:50.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.144+0000 7fc79ad9d640 1 --2- 172.21.15.136:0/626223646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c070000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc79c067790 tx=0x7fc78c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ba8f663f4f3f12 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:50.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.148+0000 7fc79959a640 1 -- 172.21.15.136:0/626223646 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c02f850 con 0x7fc79c0aff30 2024-02-17T12:58:50.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.148+0000 7fc79959a640 1 -- 172.21.15.136:0/626223646 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c02f9b0 con 0x7fc79c0aff30 2024-02-17T12:58:50.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.148+0000 7fc79959a640 1 -- 172.21.15.136:0/626223646 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c02fd40 con 0x7fc79c0aff30 2024-02-17T12:58:50.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/626223646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 msgr2=0x7fc79c070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/626223646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c070000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc79c067790 tx=0x7fc78c02ba30 comp rx=0 tx=0).stop 2024-02-17T12:58:50.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/626223646 shutdown_connections 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/626223646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c070000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/626223646 >> v2:172.21.15.160:3300/0 conn(0x7fc79c06f4f0 0x7fc79c06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/626223646 >> 172.21.15.136:0/626223646 conn(0x7fc79c06b0f0 msgr2=0x7fc79c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/626223646 shutdown_connections 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.149+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/626223646 wait complete. 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.150+0000 7fc7a0b6c640 1 Processor -- start 2024-02-17T12:58:50.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.150+0000 7fc7a0b6c640 1 -- start start 2024-02-17T12:58:50.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc7a0b6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc79c06f4f0 0x7fc79c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc7a0b6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc79c06f8d0 0x7fc79c151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc7a0b6c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc7a0b6c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0afb80 con 0x7fc79c0aff30 2024-02-17T12:58:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc7a0b6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0adc10 con 0x7fc79c06f4f0 2024-02-17T12:58:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc7a0b6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0ad8e0 con 0x7fc79c06f8d0 2024-02-17T12:58:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.151+0000 7fc79ad9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.152+0000 7fc79ad9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c0ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:35348/0 (socket says 172.21.15.136:35348) 2024-02-17T12:58:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.152+0000 7fc79ad9d640 1 -- 172.21.15.136:0/4199666554 learned_addr learned my addr 172.21.15.136:0/4199666554 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.152+0000 7fc79a59c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc79c06f4f0 0x7fc79c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.152+0000 7fc799d9b640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc79c06f8d0 0x7fc79c151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.155+0000 7fc79ad9d640 1 -- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc79c06f8d0 msgr2=0x7fc79c151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.155+0000 7fc79ad9d640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc79c06f8d0 0x7fc79c151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.155+0000 7fc79ad9d640 1 -- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc79c06f4f0 msgr2=0x7fc79c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.155+0000 7fc79ad9d640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc79c06f4f0 0x7fc79c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.155+0000 7fc79ad9d640 1 -- 172.21.15.136:0/4199666554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0094d0 con 0x7fc79c0aff30 2024-02-17T12:58:50.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.157+0000 7fc79ad9d640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c0ae0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc78c02ba70 tx=0x7fc78c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:50.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.161+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c037c40 con 0x7fc79c0aff30 2024-02-17T12:58:50.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.161+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c037dc0 con 0x7fc79c0aff30 2024-02-17T12:58:50.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.161+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c041640 con 0x7fc79c0aff30 2024-02-17T12:58:50.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.161+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c0af8a0 con 0x7fc79c0aff30 2024-02-17T12:58:50.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.161+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c1f04c0 con 0x7fc79c0aff30 2024-02-17T12:58:50.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.162+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c0addc0 con 0x7fc79c0aff30 2024-02-17T12:58:50.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.180+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc78c0417a0 con 0x7fc79c0aff30 2024-02-17T12:58:50.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.181+0000 7fc78affd640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc77c06b840 0x7fc77c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.181+0000 7fc79a59c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc77c06b840 0x7fc77c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.181+0000 7fc79a59c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc77c06b840 0x7fc77c06dd00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc794009aa0 tx=0x7fc794009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:50.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.418+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fc78c03c070 con 0x7fc79c0aff30 2024-02-17T12:58:50.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.418+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc78c0782d0 con 0x7fc79c0aff30 2024-02-17T12:58:50.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.596+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc79c0addc0 con 0x7fc79c0aff30 2024-02-17T12:58:50.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.634+0000 7fc78affd640 1 -- 172.21.15.136:0/4199666554 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7fc79c0addc0 con 0x7fc79c0aff30 2024-02-17T12:58:50.625 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:50.625 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:50.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc77c06b840 msgr2=0x7fc77c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc77c06b840 0x7fc77c06dd00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc794009aa0 tx=0x7fc794009190 comp rx=0 tx=0).stop 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 msgr2=0x7fc79c0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c0ae0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc78c02ba70 tx=0x7fc78c004730 comp rx=0 tx=0).stop 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 shutdown_connections 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc77c06b840 0x7fc77c06dd00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c0aff30 0x7fc79c0ae0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc79c06f8d0 0x7fc79c151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 --2- 172.21.15.136:0/4199666554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc79c06f4f0 0x7fc79c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 >> 172.21.15.136:0/4199666554 conn(0x7fc79c06b0f0 msgr2=0x7fc79c0c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 shutdown_connections 2024-02-17T12:58:50.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.636+0000 7fc7a0b6c640 1 -- 172.21.15.136:0/4199666554 wait complete. 2024-02-17T12:58:50.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:57:54.504936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:57:56.035257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T12:58:00.288619+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T12:58:50.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:58:50.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.755+0000 7fa714b9a640 1 Processor -- start 2024-02-17T12:58:50.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.755+0000 7fa714b9a640 1 -- start start 2024-02-17T12:58:50.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.755+0000 7fa714b9a640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa7100c44e0 0x7fa7100ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.755+0000 7fa714b9a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa710154310 con 0x7fa7100ca7c0 2024-02-17T12:58:50.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.755+0000 7fa714b9a640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71015d2c0 con 0x7fa710153f30 2024-02-17T12:58:50.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.755+0000 7fa714b9a640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100cabd0 con 0x7fa7100c44e0 2024-02-17T12:58:50.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.756+0000 7fa70ed9d640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa7100ca7c0 0x7fa710159f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58888/0 (socket says 172.21.15.136:58888) 2024-02-17T12:58:50.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.756+0000 7fa70ed9d640 1 -- 172.21.15.136:0/4181592791 learned_addr learned my addr 172.21.15.136:0/4181592791 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:50.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.756+0000 7fa705d9b640 1 --2- 172.21.15.136:0/4181592791 >> v2:172.21.15.160:3300/0 conn(0x7fa7100c44e0 0x7fa7100ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.759+0000 7fa70dd9b640 1 -- 172.21.15.136:0/4181592791 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217838489 0 0) 0x7fa710154310 con 0x7fa7100ca7c0 2024-02-17T12:58:50.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.759+0000 7fa70dd9b640 1 -- 172.21.15.136:0/4181592791 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6fc003520 con 0x7fa7100ca7c0 2024-02-17T12:58:50.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.760+0000 7fa705d9b640 1 -- 172.21.15.136:0/4181592791 >> v1:172.21.15.160:6789/0 conn(0x7fa710153f30 legacy=0x7fa7100cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.760+0000 7fa705d9b640 1 -- 172.21.15.136:0/4181592791 >> v1:172.21.15.136:6789/0 conn(0x7fa7100ca7c0 legacy=0x7fa710159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.760+0000 7fa705d9b640 1 -- 172.21.15.136:0/4181592791 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71015d560 con 0x7fa7100c44e0 2024-02-17T12:58:50.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.763+0000 7fa705d9b640 1 --2- 172.21.15.136:0/4181592791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7100c44e0 0x7fa7100ca280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80097a0 tx=0x7fa6f802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e81e8c96bad19c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:50.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.767+0000 7fa70dd9b640 1 -- 172.21.15.136:0/4181592791 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8031830 con 0x7fa7100c44e0 2024-02-17T12:58:50.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.767+0000 7fa70dd9b640 1 -- 172.21.15.136:0/4181592791 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8031990 con 0x7fa7100c44e0 2024-02-17T12:58:50.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.767+0000 7fa70dd9b640 1 -- 172.21.15.136:0/4181592791 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8031d20 con 0x7fa7100c44e0 2024-02-17T12:58:50.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.767+0000 7fa714b9a640 1 -- 172.21.15.136:0/4181592791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7100c44e0 msgr2=0x7fa7100ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.767+0000 7fa714b9a640 1 --2- 172.21.15.136:0/4181592791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7100c44e0 0x7fa7100ca280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80097a0 tx=0x7fa6f802b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.768+0000 7fa714b9a640 1 -- 172.21.15.136:0/4181592791 shutdown_connections 2024-02-17T12:58:50.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.768+0000 7fa714b9a640 1 --2- 172.21.15.136:0/4181592791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7100c44e0 0x7fa7100ca280 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.768+0000 7fa714b9a640 1 -- 172.21.15.136:0/4181592791 >> 172.21.15.136:0/4181592791 conn(0x7fa7100721f0 msgr2=0x7fa710072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:50.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.768+0000 7fa714b9a640 1 -- 172.21.15.136:0/4181592791 shutdown_connections 2024-02-17T12:58:50.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.768+0000 7fa714b9a640 1 -- 172.21.15.136:0/4181592791 wait complete. 2024-02-17T12:58:50.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.769+0000 7fa714b9a640 1 Processor -- start 2024-02-17T12:58:50.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.769+0000 7fa714b9a640 1 -- start start 2024-02-17T12:58:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa714b9a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7100c44e0 0x7fa710148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa714b9a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7100ca7c0 0x7fa7101f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa714b9a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 0x7fa7100cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa714b9a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100cea10 con 0x7fa7100ca7c0 2024-02-17T12:58:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa714b9a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710159750 con 0x7fa710153f30 2024-02-17T12:58:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa714b9a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100ceea0 con 0x7fa7100c44e0 2024-02-17T12:58:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa70e59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7100c44e0 0x7fa710148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.770+0000 7fa70ed9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 0x7fa7100cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.771+0000 7fa70ed9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 0x7fa7100cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:42202/0 (socket says 172.21.15.136:42202) 2024-02-17T12:58:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.771+0000 7fa70ed9d640 1 -- 172.21.15.136:0/187133150 learned_addr learned my addr 172.21.15.136:0/187133150 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.771+0000 7fa705d9b640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7100ca7c0 0x7fa7101f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.774+0000 7fa70ed9d640 1 -- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7100c44e0 msgr2=0x7fa710148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.774+0000 7fa70ed9d640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7100c44e0 0x7fa710148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.774+0000 7fa70ed9d640 1 -- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7100ca7c0 msgr2=0x7fa7101f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.774+0000 7fa70ed9d640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7100ca7c0 0x7fa7101f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:50.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.774+0000 7fa70ed9d640 1 -- 172.21.15.136:0/187133150 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009400 con 0x7fa710153f30 2024-02-17T12:58:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.779+0000 7fa70ed9d640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 0x7fa7100cf420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa70800cb30 tx=0x7fa70800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.783+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800aca0 con 0x7fa710153f30 2024-02-17T12:58:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.783+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70800ae00 con 0x7fa710153f30 2024-02-17T12:58:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.783+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa710159190 con 0x7fa710153f30 2024-02-17T12:58:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.783+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708012600 con 0x7fa710153f30 2024-02-17T12:58:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.783+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100ce3c0 con 0x7fa710153f30 2024-02-17T12:58:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.784+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100cebc0 con 0x7fa710153f30 2024-02-17T12:58:50.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.803+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa708007070 con 0x7fa710153f30 2024-02-17T12:58:50.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.804+0000 7fa7077fe640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa6f006b890 0x7fa6f006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:50.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.804+0000 7fa70e59c640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa6f006b890 0x7fa6f006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:50.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:50.804+0000 7fa70e59c640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa6f006b890 0x7fa6f006dd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa700000f60 tx=0x7fa700009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:51.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.035+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fa708059030 con 0x7fa710153f30 2024-02-17T12:58:51.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.048+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7080552d0 con 0x7fa710153f30 2024-02-17T12:58:51.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.225+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7100cebc0 con 0x7fa710153f30 2024-02-17T12:58:51.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.243+0000 7fa7077fe640 1 -- 172.21.15.136:0/187133150 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7100cebc0 con 0x7fa710153f30 2024-02-17T12:58:51.234 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa6f006b890 msgr2=0x7fa6f006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa6f006b890 0x7fa6f006dd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa700000f60 tx=0x7fa700009040 comp rx=0 tx=0).stop 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 msgr2=0x7fa7100cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 0x7fa7100cf420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa70800cb30 tx=0x7fa70800a060 comp rx=0 tx=0).stop 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 shutdown_connections 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa6f006b890 0x7fa6f006dd50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa710153f30 0x7fa7100cf420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7100ca7c0 0x7fa7101f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 --2- 172.21.15.136:0/187133150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7100c44e0 0x7fa710148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 >> 172.21.15.136:0/187133150 conn(0x7fa7100721f0 msgr2=0x7fa710151750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 shutdown_connections 2024-02-17T12:58:51.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.246+0000 7fa714b9a640 1 -- 172.21.15.136:0/187133150 wait complete. 2024-02-17T12:58:51.248 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:58:51.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.361+0000 7f2a6a965640 1 Processor -- start 2024-02-17T12:58:51.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.362+0000 7f2a6a965640 1 -- start start 2024-02-17T12:58:51.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.362+0000 7f2a6a965640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a640cbc00 0x7f2a6406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.362+0000 7f2a6a965640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 0x7f2a641648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.362+0000 7f2a6a965640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640cb470 con 0x7f2a640ca4e0 2024-02-17T12:58:51.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.362+0000 7f2a6a965640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a640cb750 con 0x7f2a640cbc00 2024-02-17T12:58:51.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.362+0000 7f2a6a965640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6415d1f0 con 0x7f2a641624d0 2024-02-17T12:58:51.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.363+0000 7f2a63fff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a640cbc00 0x7f2a6406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.363+0000 7f2a68f02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 0x7f2a641648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.363+0000 7f2a68f02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 0x7f2a641648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:57798/0 (socket says 172.21.15.136:57798) 2024-02-17T12:58:51.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.363+0000 7f2a68f02640 1 -- 172.21.15.136:0/2459716361 learned_addr learned my addr 172.21.15.136:0/2459716361 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:51.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.366+0000 7f2a68f02640 1 -- 172.21.15.136:0/2459716361 >> v2:172.21.15.160:3300/0 conn(0x7f2a640cbc00 msgr2=0x7f2a6406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:51.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.366+0000 7f2a68f02640 1 --2- 172.21.15.136:0/2459716361 >> v2:172.21.15.160:3300/0 conn(0x7f2a640cbc00 0x7f2a6406acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.366+0000 7f2a68f02640 1 -- 172.21.15.136:0/2459716361 >> v1:172.21.15.160:6789/0 conn(0x7f2a640ca4e0 legacy=0x7f2a640cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.366+0000 7f2a68f02640 1 -- 172.21.15.136:0/2459716361 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6415d4d0 con 0x7f2a641624d0 2024-02-17T12:58:51.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.368+0000 7f2a68f02640 1 --2- 172.21.15.136:0/2459716361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 0x7f2a641648c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009e50 tx=0x7f2a5c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26887ec67c54e3b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:51.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.371+0000 7f2a62ffd640 1 -- 172.21.15.136:0/2459716361 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c02cb00 con 0x7f2a641624d0 2024-02-17T12:58:51.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a62ffd640 1 -- 172.21.15.136:0/2459716361 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c02cc60 con 0x7f2a641624d0 2024-02-17T12:58:51.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a62ffd640 1 -- 172.21.15.136:0/2459716361 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0343f0 con 0x7f2a641624d0 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 -- 172.21.15.136:0/2459716361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 msgr2=0x7f2a641648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 --2- 172.21.15.136:0/2459716361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 0x7f2a641648c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009e50 tx=0x7f2a5c02bf60 comp rx=0 tx=0).stop 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 -- 172.21.15.136:0/2459716361 shutdown_connections 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 --2- 172.21.15.136:0/2459716361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a641624d0 0x7f2a641648c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 --2- 172.21.15.136:0/2459716361 >> v2:172.21.15.160:3300/0 conn(0x7f2a640cbc00 0x7f2a6406acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 -- 172.21.15.136:0/2459716361 >> 172.21.15.136:0/2459716361 conn(0x7f2a640721f0 msgr2=0x7f2a640725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 -- 172.21.15.136:0/2459716361 shutdown_connections 2024-02-17T12:58:51.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.372+0000 7f2a6a965640 1 -- 172.21.15.136:0/2459716361 wait complete. 2024-02-17T12:58:51.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.373+0000 7f2a6a965640 1 Processor -- start 2024-02-17T12:58:51.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 -- start start 2024-02-17T12:58:51.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a640ca4e0 0x7f2a64144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 0x7f2a640c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a641624d0 0x7f2a640c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64147150 con 0x7f2a640ca4e0 2024-02-17T12:58:51.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64145910 con 0x7f2a641624d0 2024-02-17T12:58:51.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.374+0000 7f2a6a965640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640c2b10 con 0x7f2a640cbc00 2024-02-17T12:58:51.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.375+0000 7f2a637fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 0x7f2a640c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.375+0000 7f2a63fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a640ca4e0 0x7f2a64144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.375+0000 7f2a68f02640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a641624d0 0x7f2a640c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.375+0000 7f2a637fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 0x7f2a640c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:57806/0 (socket says 172.21.15.136:57806) 2024-02-17T12:58:51.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.375+0000 7f2a637fe640 1 -- 172.21.15.136:0/322425604 learned_addr learned my addr 172.21.15.136:0/322425604 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:51.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.378+0000 7f2a637fe640 1 -- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a641624d0 msgr2=0x7f2a640c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.378+0000 7f2a637fe640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a641624d0 0x7f2a640c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.378+0000 7f2a637fe640 1 -- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a640ca4e0 msgr2=0x7f2a64144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.378+0000 7f2a637fe640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a640ca4e0 0x7f2a64144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.378+0000 7f2a637fe640 1 -- 172.21.15.136:0/322425604 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009b30 con 0x7f2a640cbc00 2024-02-17T12:58:51.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.381+0000 7f2a637fe640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 0x7f2a640c2090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c400 tx=0x7f2a5800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:51.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.384+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580052d0 con 0x7f2a640cbc00 2024-02-17T12:58:51.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.384+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58005470 con 0x7f2a640cbc00 2024-02-17T12:58:51.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.384+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58006a60 con 0x7f2a640cbc00 2024-02-17T12:58:51.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.384+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a641467b0 con 0x7f2a640cbc00 2024-02-17T12:58:51.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.384+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a640cf0b0 con 0x7f2a640cbc00 2024-02-17T12:58:51.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.385+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6414e4c0 con 0x7f2a640cbc00 2024-02-17T12:58:51.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.635+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2a58006bc0 con 0x7f2a640cbc00 2024-02-17T12:58:51.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.635+0000 7f2a60ff9640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2a5006b860 0x7f2a5006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.635+0000 7f2a63fff640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2a5006b860 0x7f2a5006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.636+0000 7f2a63fff640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2a5006b860 0x7f2a5006dd20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009b40 tx=0x7f2a54009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:51.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.638+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f2a58058410 con 0x7f2a640cbc00 2024-02-17T12:58:51.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.649+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a580546b0 con 0x7f2a640cbc00 2024-02-17T12:58:51.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.824+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a641467b0 con 0x7f2a640cbc00 2024-02-17T12:58:51.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.829+0000 7f2a60ff9640 1 -- 172.21.15.136:0/322425604 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a641467b0 con 0x7f2a640cbc00 2024-02-17T12:58:51.820 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:51.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2a5006b860 msgr2=0x7f2a5006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2a5006b860 0x7f2a5006dd20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009b40 tx=0x7f2a54009190 comp rx=0 tx=0).stop 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 msgr2=0x7f2a640c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 0x7f2a640c2090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c400 tx=0x7f2a5800c8c0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 shutdown_connections 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2a5006b860 0x7f2a5006dd20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a641624d0 0x7f2a640c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a640cbc00 0x7f2a640c2090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 --2- 172.21.15.136:0/322425604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a640ca4e0 0x7f2a64144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 >> 172.21.15.136:0/322425604 conn(0x7f2a640721f0 msgr2=0x7f2a640cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:51.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 shutdown_connections 2024-02-17T12:58:51.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.831+0000 7f2a6a965640 1 -- 172.21.15.136:0/322425604 wait complete. 2024-02-17T12:58:51.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:58:51.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.946+0000 7f5f6f1f4640 1 Processor -- start 2024-02-17T12:58:51.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.946+0000 7f5f6f1f4640 1 -- start start 2024-02-17T12:58:51.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.947+0000 7f5f6f1f4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5f680c6100 0x7f5f681518f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.947+0000 7f5f6f1f4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680c6da0 con 0x7f5f6806aac0 2024-02-17T12:58:51.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.947+0000 7f5f6f1f4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680c7640 con 0x7f5f680c5d20 2024-02-17T12:58:51.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.947+0000 7f5f6f1f4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680c8cc0 con 0x7f5f680c6100 2024-02-17T12:58:51.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.948+0000 7f5f6cf90640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5f680c5d20 0x7f5f680c85b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:38056/0 (socket says 172.21.15.136:38056) 2024-02-17T12:58:51.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.948+0000 7f5f6cf90640 1 -- 172.21.15.136:0/1130122931 learned_addr learned my addr 172.21.15.136:0/1130122931 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:51.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.948+0000 7f5f67fff640 1 --2- 172.21.15.136:0/1130122931 >> v2:172.21.15.136:3300/0 conn(0x7f5f680c6100 0x7f5f681518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.951+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881289671 0 0) 0x7f5f680c7640 con 0x7f5f680c5d20 2024-02-17T12:58:51.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.951+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f50003520 con 0x7f5f680c5d20 2024-02-17T12:58:51.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.951+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701259689 0 0) 0x7f5f680c6da0 con 0x7f5f6806aac0 2024-02-17T12:58:51.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.951+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f680c7640 con 0x7f5f6806aac0 2024-02-17T12:58:51.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.953+0000 7f5f67fff640 1 -- 172.21.15.136:0/1130122931 >> v1:172.21.15.160:6789/0 conn(0x7f5f680c5d20 legacy=0x7f5f680c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.953+0000 7f5f67fff640 1 -- 172.21.15.136:0/1130122931 >> v1:172.21.15.136:6789/0 conn(0x7f5f6806aac0 legacy=0x7f5f68157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.953+0000 7f5f67fff640 1 -- 172.21.15.136:0/1130122931 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6806afb0 con 0x7f5f680c6100 2024-02-17T12:58:51.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.956+0000 7f5f67fff640 1 --2- 172.21.15.136:0/1130122931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f680c6100 0x7f5f681518f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0097a0 tx=0x7f5f5c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ab1c6431000ab2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.960+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c030610 con 0x7f5f680c6100 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.960+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c030770 con 0x7f5f680c6100 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.960+0000 7f5f677fe640 1 -- 172.21.15.136:0/1130122931 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c030b00 con 0x7f5f680c6100 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.960+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1130122931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f680c6100 msgr2=0x7f5f681518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.960+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1130122931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f680c6100 0x7f5f681518f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0097a0 tx=0x7f5f5c02b960 comp rx=0 tx=0).stop 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.961+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1130122931 shutdown_connections 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.961+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1130122931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f680c6100 0x7f5f681518f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.961+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1130122931 >> 172.21.15.136:0/1130122931 conn(0x7f5f68071a20 msgr2=0x7f5f68071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:51.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.961+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1130122931 shutdown_connections 2024-02-17T12:58:51.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.961+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1130122931 wait complete. 2024-02-17T12:58:51.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.962+0000 7f5f6f1f4640 1 Processor -- start 2024-02-17T12:58:51.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.962+0000 7f5f6f1f4640 1 -- start start 2024-02-17T12:58:51.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6f1f4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 0x7f5f681e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6f1f4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f680c5d20 0x7f5f680cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6f1f4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f680c6100 0x7f5f681ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6f1f4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681f1e80 con 0x7f5f6806aac0 2024-02-17T12:58:51.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6f1f4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680cc5b0 con 0x7f5f680c6100 2024-02-17T12:58:51.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6f1f4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681f1100 con 0x7f5f680c5d20 2024-02-17T12:58:51.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.963+0000 7f5f6cf90640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 0x7f5f681e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.964+0000 7f5f6d791640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f680c6100 0x7f5f681ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.964+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f680c5d20 0x7f5f680cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.964+0000 7f5f6cf90640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 0x7f5f681e3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39524/0 (socket says 172.21.15.136:39524) 2024-02-17T12:58:51.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.964+0000 7f5f6cf90640 1 -- 172.21.15.136:0/1235621551 learned_addr learned my addr 172.21.15.136:0/1235621551 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:51.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.967+0000 7f5f6cf90640 1 -- 172.21.15.136:0/1235621551 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f680c5d20 msgr2=0x7f5f680cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.967+0000 7f5f6cf90640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f680c5d20 0x7f5f680cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.967+0000 7f5f6cf90640 1 -- 172.21.15.136:0/1235621551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f680c6100 msgr2=0x7f5f681ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:51.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.967+0000 7f5f6cf90640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f680c6100 0x7f5f681ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:51.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.967+0000 7f5f6cf90640 1 -- 172.21.15.136:0/1235621551 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009400 con 0x7f5f6806aac0 2024-02-17T12:58:51.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.969+0000 7f5f6cf90640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 0x7f5f681e3330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c480 tx=0x7f5f5800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:51.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.987+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58005ce0 con 0x7f5f6806aac0 2024-02-17T12:58:51.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.987+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f58005e40 con 0x7f5f6806aac0 2024-02-17T12:58:51.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.987+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f580072b0 con 0x7f5f6806aac0 2024-02-17T12:58:51.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.987+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680cc2d0 con 0x7f5f6806aac0 2024-02-17T12:58:51.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.987+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f681f1680 con 0x7f5f6806aac0 2024-02-17T12:58:51.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:51.988+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f680cd1d0 con 0x7f5f6806aac0 2024-02-17T12:58:51.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.006+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5f58007410 con 0x7f5f6806aac0 2024-02-17T12:58:51.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.006+0000 7f5f657fa640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5f5406b890 0x7f5f5406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:51.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.007+0000 7f5f67fff640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5f5406b890 0x7f5f5406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:51.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.007+0000 7f5f67fff640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5f5406b890 0x7f5f5406dd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c036000 tx=0x7f5f5c008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:52.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.260+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f5f58058500 con 0x7f5f6806aac0 2024-02-17T12:58:52.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.261+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f580547a0 con 0x7f5f6806aac0 2024-02-17T12:58:52.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.451+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f680c7fd0 con 0x7f5f6806aac0 2024-02-17T12:58:52.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.456+0000 7f5f657fa640 1 -- 172.21.15.136:0/1235621551 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f580170a0 con 0x7f5f6806aac0 2024-02-17T12:58:52.446 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-02-17T12:58:52.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.458+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5f5406b890 msgr2=0x7f5f5406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.458+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5f5406b890 0x7f5f5406dd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c036000 tx=0x7f5f5c008030 comp rx=0 tx=0).stop 2024-02-17T12:58:52.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.458+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 msgr2=0x7f5f681e3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.458+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 0x7f5f681e3330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c480 tx=0x7f5f5800c940 comp rx=0 tx=0).stop 2024-02-17T12:58:52.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 shutdown_connections 2024-02-17T12:58:52.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f5f5406b890 0x7f5f5406dd50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f680c6100 0x7f5f681ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f680c5d20 0x7f5f680cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 --2- 172.21.15.136:0/1235621551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f6806aac0 0x7f5f681e3330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 >> 172.21.15.136:0/1235621551 conn(0x7f5f68071a20 msgr2=0x7f5f68156420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:52.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 shutdown_connections 2024-02-17T12:58:52.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.459+0000 7f5f6f1f4640 1 -- 172.21.15.136:0/1235621551 wait complete. 2024-02-17T12:58:52.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T12:58:52.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.573+0000 7fe710c42640 1 Processor -- start 2024-02-17T12:58:52.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.573+0000 7fe710c42640 1 -- start start 2024-02-17T12:58:52.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.574+0000 7fe710c42640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe70c0c7940 0x7fe70c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:52.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.574+0000 7fe710c42640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c06df40 con 0x7fe70c14e3b0 2024-02-17T12:58:52.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.574+0000 7fe710c42640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c071b40 con 0x7fe70c0708f0 2024-02-17T12:58:52.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.574+0000 7fe710c42640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0c6420 con 0x7fe70c0c7940 2024-02-17T12:58:52.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.575+0000 7fe70ad9d640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe70c0708f0 0x7fe70c0c4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:38072/0 (socket says 172.21.15.136:38072) 2024-02-17T12:58:52.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.575+0000 7fe70ad9d640 1 -- 172.21.15.136:0/4115687368 learned_addr learned my addr 172.21.15.136:0/4115687368 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:52.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.575+0000 7fe703fff640 1 --2- 172.21.15.136:0/4115687368 >> v2:172.21.15.136:3300/0 conn(0x7fe70c0c7940 0x7fe70c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:52.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.577+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010289368 0 0) 0x7fe70c071b40 con 0x7fe70c0708f0 2024-02-17T12:58:52.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.577+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f8003520 con 0x7fe70c0708f0 2024-02-17T12:58:52.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.578+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268383727 0 0) 0x7fe70c06df40 con 0x7fe70c14e3b0 2024-02-17T12:58:52.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.578+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c071b40 con 0x7fe70c14e3b0 2024-02-17T12:58:52.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.580+0000 7fe703fff640 1 -- 172.21.15.136:0/4115687368 >> v1:172.21.15.160:6789/0 conn(0x7fe70c0708f0 legacy=0x7fe70c0c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.580+0000 7fe703fff640 1 -- 172.21.15.136:0/4115687368 >> v1:172.21.15.136:6789/0 conn(0x7fe70c14e3b0 legacy=0x7fe70c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.580+0000 7fe703fff640 1 -- 172.21.15.136:0/4115687368 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c14e790 con 0x7fe70c0c7940 2024-02-17T12:58:52.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.583+0000 7fe703fff640 1 --2- 172.21.15.136:0/4115687368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c0c5d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097a0 tx=0x7fe6f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42c8002da625677 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:52.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4031830 con 0x7fe70c0c7940 2024-02-17T12:58:52.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4031990 con 0x7fe70c0c7940 2024-02-17T12:58:52.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe709d9b640 1 -- 172.21.15.136:0/4115687368 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4031d20 con 0x7fe70c0c7940 2024-02-17T12:58:52.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 -- 172.21.15.136:0/4115687368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 msgr2=0x7fe70c0c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 --2- 172.21.15.136:0/4115687368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c0c5d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097a0 tx=0x7fe6f402b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 -- 172.21.15.136:0/4115687368 shutdown_connections 2024-02-17T12:58:52.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 --2- 172.21.15.136:0/4115687368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c0c5d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 -- 172.21.15.136:0/4115687368 >> 172.21.15.136:0/4115687368 conn(0x7fe70c0c7e90 msgr2=0x7fe70c0c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:52.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 -- 172.21.15.136:0/4115687368 shutdown_connections 2024-02-17T12:58:52.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.587+0000 7fe710c42640 1 -- 172.21.15.136:0/4115687368 wait complete. 2024-02-17T12:58:52.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.589+0000 7fe710c42640 1 Processor -- start 2024-02-17T12:58:52.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.589+0000 7fe710c42640 1 -- start start 2024-02-17T12:58:52.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe710c42640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe70c0708f0 0x7fe70c158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:52.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe710c42640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c1f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:52.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe710c42640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 0x7fe70c143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:52.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe710c42640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1f1760 con 0x7fe70c0c7940 2024-02-17T12:58:52.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe710c42640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1edbb0 con 0x7fe70c14e3b0 2024-02-17T12:58:52.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe710c42640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1ed2a0 con 0x7fe70c0708f0 2024-02-17T12:58:52.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe70ad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 0x7fe70c143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:52.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.590+0000 7fe70a59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe70c0708f0 0x7fe70c158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:52.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.591+0000 7fe70ad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 0x7fe70c143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:48606/0 (socket says 172.21.15.136:48606) 2024-02-17T12:58:52.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.591+0000 7fe70ad9d640 1 -- 172.21.15.136:0/896764379 learned_addr learned my addr 172.21.15.136:0/896764379 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:52.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.592+0000 7fe703fff640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c1f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:52.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.594+0000 7fe70ad9d640 1 -- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe70c0708f0 msgr2=0x7fe70c158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.594+0000 7fe70ad9d640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe70c0708f0 0x7fe70c158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.594+0000 7fe70ad9d640 1 -- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 msgr2=0x7fe70c1f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:52.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.594+0000 7fe70ad9d640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c1f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:52.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.594+0000 7fe70ad9d640 1 -- 172.21.15.136:0/896764379 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009400 con 0x7fe70c14e3b0 2024-02-17T12:58:52.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.596+0000 7fe70ad9d640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 0x7fe70c143e60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe70400caa0 tx=0x7fe70400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:52.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.600+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400ac00 con 0x7fe70c14e3b0 2024-02-17T12:58:52.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.600+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400ad80 con 0x7fe70c14e3b0 2024-02-17T12:58:52.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.600+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704012640 con 0x7fe70c14e3b0 2024-02-17T12:58:52.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.600+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c14b130 con 0x7fe70c14e3b0 2024-02-17T12:58:52.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.600+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c1ed560 con 0x7fe70c14e3b0 2024-02-17T12:58:52.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.601+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c04efc0 con 0x7fe70c14e3b0 2024-02-17T12:58:52.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.845+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe704007070 con 0x7fe70c14e3b0 2024-02-17T12:58:52.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.845+0000 7fe702ffd640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6ec06b860 0x7fe6ec06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:52.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.845+0000 7fe70a59c640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6ec06b860 0x7fe6ec06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:52.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.845+0000 7fe70a59c640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6ec06b860 0x7fe6ec06dd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc007fd0 tx=0x7fe6fc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:52.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.847+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fe704058d70 con 0x7fe70c14e3b0 2024-02-17T12:58:52.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:52.857+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe704055010 con 0x7fe70c14e3b0 2024-02-17T12:58:53.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.028+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe70c06d5c0 con 0x7fe70c14e3b0 2024-02-17T12:58:53.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.035+0000 7fe702ffd640 1 -- 172.21.15.136:0/896764379 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7040170a0 con 0x7fe70c14e3b0 2024-02-17T12:58:53.025 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T12:58:53.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6ec06b860 msgr2=0x7fe6ec06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6ec06b860 0x7fe6ec06dd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc007fd0 tx=0x7fe6fc009040 comp rx=0 tx=0).stop 2024-02-17T12:58:53.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 msgr2=0x7fe70c143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 0x7fe70c143e60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe70400caa0 tx=0x7fe70400cf60 comp rx=0 tx=0).stop 2024-02-17T12:58:53.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 shutdown_connections 2024-02-17T12:58:53.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe6ec06b860 0x7fe6ec06dd20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe70c14e3b0 0x7fe70c143e60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70c0c7940 0x7fe70c1f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 --2- 172.21.15.136:0/896764379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe70c0708f0 0x7fe70c158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 >> 172.21.15.136:0/896764379 conn(0x7fe70c0c7e90 msgr2=0x7fe70c06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:53.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 shutdown_connections 2024-02-17T12:58:53.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.037+0000 7fe710c42640 1 -- 172.21.15.136:0/896764379 wait complete. 2024-02-17T12:58:53.039 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:58:53.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.148+0000 7f29a2302640 1 Processor -- start 2024-02-17T12:58:53.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.148+0000 7f29a2302640 1 -- start start 2024-02-17T12:58:53.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.149+0000 7f29a2302640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c06f6d0 0x7f299c06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.149+0000 7f29a2302640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f299c0723e0 0x7f299c072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.149+0000 7f29a2302640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0c65a0 con 0x7f299c153fb0 2024-02-17T12:58:53.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.149+0000 7f29a2302640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c070010 con 0x7f299c0723e0 2024-02-17T12:58:53.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.149+0000 7f29a2302640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c072d50 con 0x7f299c06f6d0 2024-02-17T12:58:53.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.150+0000 7f299bfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f299c153fb0 0x7f299c159d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:39366/0 (socket says 172.21.15.136:39366) 2024-02-17T12:58:53.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.150+0000 7f299bfff640 1 -- 172.21.15.136:0/1700889504 learned_addr learned my addr 172.21.15.136:0/1700889504 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:53.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.150+0000 7f29a089f640 1 --2- 172.21.15.136:0/1700889504 >> v2:172.21.15.160:3300/0 conn(0x7f299c0723e0 0x7f299c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.150+0000 7f299b7fe640 1 --2- 172.21.15.136:0/1700889504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c06f6d0 0x7f299c06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.152+0000 7f299affd640 1 -- 172.21.15.136:0/1700889504 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276317664 0 0) 0x7f299c0c65a0 con 0x7f299c153fb0 2024-02-17T12:58:53.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.152+0000 7f299affd640 1 -- 172.21.15.136:0/1700889504 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2984003520 con 0x7f299c153fb0 2024-02-17T12:58:53.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.153+0000 7f299b7fe640 1 -- 172.21.15.136:0/1700889504 >> v2:172.21.15.160:3300/0 conn(0x7f299c0723e0 msgr2=0x7f299c072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:53.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.153+0000 7f299b7fe640 1 --2- 172.21.15.136:0/1700889504 >> v2:172.21.15.160:3300/0 conn(0x7f299c0723e0 0x7f299c072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.153+0000 7f299b7fe640 1 -- 172.21.15.136:0/1700889504 >> v1:172.21.15.136:6789/0 conn(0x7f299c153fb0 legacy=0x7f299c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.153+0000 7f299b7fe640 1 -- 172.21.15.136:0/1700889504 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c06af20 con 0x7f299c06f6d0 2024-02-17T12:58:53.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.155+0000 7f299b7fe640 1 --2- 172.21.15.136:0/1700889504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c06f6d0 0x7f299c06fad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29900097a0 tx=0x7f299002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c8f36f18a84dbd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:53.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.158+0000 7f299affd640 1 -- 172.21.15.136:0/1700889504 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990031830 con 0x7f299c06f6d0 2024-02-17T12:58:53.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.158+0000 7f299affd640 1 -- 172.21.15.136:0/1700889504 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990031990 con 0x7f299c06f6d0 2024-02-17T12:58:53.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.158+0000 7f299affd640 1 -- 172.21.15.136:0/1700889504 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990031d20 con 0x7f299c06f6d0 2024-02-17T12:58:53.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 -- 172.21.15.136:0/1700889504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c06f6d0 msgr2=0x7f299c06fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 --2- 172.21.15.136:0/1700889504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c06f6d0 0x7f299c06fad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29900097a0 tx=0x7f299002b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 -- 172.21.15.136:0/1700889504 shutdown_connections 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 --2- 172.21.15.136:0/1700889504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c06f6d0 0x7f299c06fad0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 --2- 172.21.15.136:0/1700889504 >> v2:172.21.15.160:3300/0 conn(0x7f299c0723e0 0x7f299c072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 -- 172.21.15.136:0/1700889504 >> 172.21.15.136:0/1700889504 conn(0x7f299c06bbd0 msgr2=0x7f299c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 -- 172.21.15.136:0/1700889504 shutdown_connections 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.159+0000 7f29a2302640 1 -- 172.21.15.136:0/1700889504 wait complete. 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.160+0000 7f29a2302640 1 Processor -- start 2024-02-17T12:58:53.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.160+0000 7f29a2302640 1 -- start start 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f29a2302640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 0x7f299c1ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f29a2302640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c0723e0 0x7f299c142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f29a2302640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f299c153fb0 0x7f299c142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f29a2302640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1432f0 con 0x7f299c06f6d0 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f29a2302640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c143590 con 0x7f299c153fb0 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f29a2302640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1443d0 con 0x7f299c0723e0 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f299bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 0x7f299c1ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.161+0000 7f299b7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c0723e0 0x7f299c142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.162+0000 7f29a089f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f299c153fb0 0x7f299c142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.162+0000 7f299bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 0x7f299c1ef930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39562/0 (socket says 172.21.15.136:39562) 2024-02-17T12:58:53.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.162+0000 7f299bfff640 1 -- 172.21.15.136:0/2527286787 learned_addr learned my addr 172.21.15.136:0/2527286787 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:53.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.165+0000 7f299bfff640 1 -- 172.21.15.136:0/2527286787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c0723e0 msgr2=0x7f299c142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.165+0000 7f299bfff640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c0723e0 0x7f299c142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.165+0000 7f299bfff640 1 -- 172.21.15.136:0/2527286787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f299c153fb0 msgr2=0x7f299c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.165+0000 7f299bfff640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f299c153fb0 0x7f299c142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.165+0000 7f299bfff640 1 -- 172.21.15.136:0/2527286787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009400 con 0x7f299c06f6d0 2024-02-17T12:58:53.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.167+0000 7f299bfff640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 0x7f299c1ef930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c390 tx=0x7f298c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:53.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.171+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c005ce0 con 0x7f299c06f6d0 2024-02-17T12:58:53.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.171+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c005e40 con 0x7f299c06f6d0 2024-02-17T12:58:53.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.171+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c143850 con 0x7f299c06f6d0 2024-02-17T12:58:53.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.171+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0072f0 con 0x7f299c06f6d0 2024-02-17T12:58:53.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.171+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c143e10 con 0x7f299c06f6d0 2024-02-17T12:58:53.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.172+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c06b480 con 0x7f299c06f6d0 2024-02-17T12:58:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.412+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f298c007450 con 0x7f299c06f6d0 2024-02-17T12:58:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.412+0000 7f2998ff9640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f298806b810 0x7f298806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.412+0000 7f299b7fe640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f298806b810 0x7f298806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.413+0000 7f299b7fe640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f298806b810 0x7f298806dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2990036000 tx=0x7f299003c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:53.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.426+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f298c058250 con 0x7f299c06f6d0 2024-02-17T12:58:53.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.426+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f298c0544f0 con 0x7f299c06f6d0 2024-02-17T12:58:53.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.640+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f299c06b480 con 0x7f299c06f6d0 2024-02-17T12:58:53.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.653+0000 7f2998ff9640 1 -- 172.21.15.136:0/2527286787 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6599 (secure 0 0 0) 0x7f299c06b480 con 0x7f299c06f6d0 2024-02-17T12:58:53.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:53.643 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:37.333637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4288,"mds_2":4248,"mds_3":4245,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4245":{"gid":4245,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4248":{"gid":4248,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:58:53.643 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 18 2024-02-17T12:58:53.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f298806b810 msgr2=0x7f298806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f298806b810 0x7f298806dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2990036000 tx=0x7f299003c040 comp rx=0 tx=0).stop 2024-02-17T12:58:53.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 msgr2=0x7f299c1ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 0x7f299c1ef930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c390 tx=0x7f298c00c850 comp rx=0 tx=0).stop 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 shutdown_connections 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f298806b810 0x7f298806dcd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f299c153fb0 0x7f299c142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f299c0723e0 0x7f299c142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 --2- 172.21.15.136:0/2527286787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f299c06f6d0 0x7f299c1ef930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 >> 172.21.15.136:0/2527286787 conn(0x7f299c06bbd0 msgr2=0x7f299c071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 shutdown_connections 2024-02-17T12:58:53.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.655+0000 7f29a2302640 1 -- 172.21.15.136:0/2527286787 wait complete. 2024-02-17T12:58:53.657 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:58:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.767+0000 7f4215888640 1 Processor -- start 2024-02-17T12:58:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.767+0000 7f4215888640 1 -- start start 2024-02-17T12:58:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f4215888640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4210151da0 0x7f42101583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f4215888640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f421015aea0 0x7f42100c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f4215888640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f42100ca6c0 0x7f42100ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f4215888640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100b00e0 con 0x7f42100ca6c0 2024-02-17T12:58:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f4215888640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42101588f0 con 0x7f4210151da0 2024-02-17T12:58:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f4215888640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c80e0 con 0x7f421015aea0 2024-02-17T12:58:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.768+0000 7f420f7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f42100ca6c0 0x7f42100ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.769+0000 7f420f7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f42100ca6c0 0x7f42100ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39572/0 (socket says 172.21.15.136:39572) 2024-02-17T12:58:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.769+0000 7f420f7fe640 1 -- 172.21.15.136:0/3423505875 learned_addr learned my addr 172.21.15.136:0/3423505875 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.769+0000 7f420e7fc640 1 --2- 172.21.15.136:0/3423505875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f421015aea0 0x7f42100c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.769+0000 7f420effd640 1 --2- 172.21.15.136:0/3423505875 >> v2:172.21.15.160:3300/0 conn(0x7f4210151da0 0x7f42101583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.771+0000 7f420f7fe640 1 -- 172.21.15.136:0/3423505875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f421015aea0 msgr2=0x7f42100c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.771+0000 7f420f7fe640 1 --2- 172.21.15.136:0/3423505875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f421015aea0 0x7f42100c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.771+0000 7f420f7fe640 1 -- 172.21.15.136:0/3423505875 >> v2:172.21.15.160:3300/0 conn(0x7f4210151da0 msgr2=0x7f42101583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.771+0000 7f420f7fe640 1 --2- 172.21.15.136:0/3423505875 >> v2:172.21.15.160:3300/0 conn(0x7f4210151da0 0x7f42101583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.771+0000 7f420f7fe640 1 -- 172.21.15.136:0/3423505875 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421015b350 con 0x7f42100ca6c0 2024-02-17T12:58:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.773+0000 7f420f7fe640 1 --2- 172.21.15.136:0/3423505875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42100ca6c0 0x7f42100ca100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f421006fc90 tx=0x7f420802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de70e646127c188a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:53.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.781+0000 7f420dffb640 1 -- 172.21.15.136:0/3423505875 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208031870 con 0x7f42100ca6c0 2024-02-17T12:58:53.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.781+0000 7f420dffb640 1 -- 172.21.15.136:0/3423505875 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42080319d0 con 0x7f42100ca6c0 2024-02-17T12:58:53.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.781+0000 7f420dffb640 1 -- 172.21.15.136:0/3423505875 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208031d60 con 0x7f42100ca6c0 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 -- 172.21.15.136:0/3423505875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42100ca6c0 msgr2=0x7f42100ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 --2- 172.21.15.136:0/3423505875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42100ca6c0 0x7f42100ca100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f421006fc90 tx=0x7f420802b910 comp rx=0 tx=0).stop 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 -- 172.21.15.136:0/3423505875 shutdown_connections 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 --2- 172.21.15.136:0/3423505875 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42100ca6c0 0x7f42100ca100 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 --2- 172.21.15.136:0/3423505875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f421015aea0 0x7f42100c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 --2- 172.21.15.136:0/3423505875 >> v2:172.21.15.160:3300/0 conn(0x7f4210151da0 0x7f42101583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 -- 172.21.15.136:0/3423505875 >> 172.21.15.136:0/3423505875 conn(0x7f4210066d00 msgr2=0x7f4210067110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 -- 172.21.15.136:0/3423505875 shutdown_connections 2024-02-17T12:58:53.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.782+0000 7f4215888640 1 -- 172.21.15.136:0/3423505875 wait complete. 2024-02-17T12:58:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.783+0000 7f4215888640 1 Processor -- start 2024-02-17T12:58:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 -- start start 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42100ca6c0 0x7f421006beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4210151da0 0x7f421014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 0x7f42101562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4210155590 con 0x7f421015aea0 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421015ac30 con 0x7f4210151da0 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.784+0000 7f4215888640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421006d690 con 0x7f42100ca6c0 2024-02-17T12:58:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.785+0000 7f420f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 0x7f42101562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.785+0000 7f420effd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42100ca6c0 0x7f421006beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.785+0000 7f420f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 0x7f42101562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39586/0 (socket says 172.21.15.136:39586) 2024-02-17T12:58:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.785+0000 7f420f7fe640 1 -- 172.21.15.136:0/3015723332 learned_addr learned my addr 172.21.15.136:0/3015723332 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.786+0000 7f420e7fc640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4210151da0 0x7f421014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.788+0000 7f420f7fe640 1 -- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42100ca6c0 msgr2=0x7f421006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.788+0000 7f420f7fe640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42100ca6c0 0x7f421006beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.788+0000 7f420f7fe640 1 -- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4210151da0 msgr2=0x7f421014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.788+0000 7f420f7fe640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4210151da0 0x7f421014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.788+0000 7f420f7fe640 1 -- 172.21.15.136:0/3015723332 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080094d0 con 0x7f421015aea0 2024-02-17T12:58:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.791+0000 7f420f7fe640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 0x7f42101562c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f420802b950 tx=0x7f42080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.798+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420803ac60 con 0x7f421015aea0 2024-02-17T12:58:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.798+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420803ade0 con 0x7f421015aea0 2024-02-17T12:58:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.798+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208044630 con 0x7f421015aea0 2024-02-17T12:58:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.798+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421006d970 con 0x7f421015aea0 2024-02-17T12:58:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.798+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4210155ac0 con 0x7f421015aea0 2024-02-17T12:58:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:53.799+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42100670e0 con 0x7f421015aea0 2024-02-17T12:58:54.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.049+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4208044790 con 0x7f421015aea0 2024-02-17T12:58:54.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.050+0000 7f41f7fff640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f41fc06b890 0x7f41fc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.050+0000 7f420effd640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f41fc06b890 0x7f41fc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.050+0000 7f420effd640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f41fc06b890 0x7f41fc06dd50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f42000113e0 tx=0x7f420000b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:54.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.064+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f420802d040 con 0x7f421015aea0 2024-02-17T12:58:54.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.064+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42080778d0 con 0x7f421015aea0 2024-02-17T12:58:54.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.247+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f421006dc50 con 0x7f421015aea0 2024-02-17T12:58:54.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.286+0000 7f41f7fff640 1 -- 172.21.15.136:0/3015723332 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f4208035090 con 0x7f421015aea0 2024-02-17T12:58:54.276 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:54.276 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:58:54.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f41fc06b890 msgr2=0x7f41fc06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f41fc06b890 0x7f41fc06dd50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f42000113e0 tx=0x7f420000b040 comp rx=0 tx=0).stop 2024-02-17T12:58:54.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 msgr2=0x7f42101562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 0x7f42101562c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f420802b950 tx=0x7f42080046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 shutdown_connections 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f41fc06b890 0x7f41fc06dd50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f421015aea0 0x7f42101562c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4210151da0 0x7f421014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 --2- 172.21.15.136:0/3015723332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42100ca6c0 0x7f421006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 >> 172.21.15.136:0/3015723332 conn(0x7f4210066d00 msgr2=0x7f42101510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 shutdown_connections 2024-02-17T12:58:54.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.288+0000 7f4215888640 1 -- 172.21.15.136:0/3015723332 wait complete. 2024-02-17T12:58:54.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:58:54.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.399+0000 7fa9f3d6c640 1 Processor -- start 2024-02-17T12:58:54.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.399+0000 7fa9f3d6c640 1 -- start start 2024-02-17T12:58:54.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.400+0000 7fa9f3d6c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa9ec0ca090 0x7fa9ec0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.400+0000 7fa9f3d6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec1573e0 0x7fa9ec15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.400+0000 7fa9f3d6c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec0c3690 con 0x7fa9ec150b50 2024-02-17T12:58:54.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.400+0000 7fa9f3d6c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec159f50 con 0x7fa9ec0ca090 2024-02-17T12:58:54.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.400+0000 7fa9f3d6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec157890 con 0x7fa9ec1573e0 2024-02-17T12:58:54.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.401+0000 7fa9f1b08640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa9ec150b50 0x7fa9ec0c51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:39368/0 (socket says 172.21.15.136:39368) 2024-02-17T12:58:54.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.401+0000 7fa9f1b08640 1 -- 172.21.15.136:0/245419521 learned_addr learned my addr 172.21.15.136:0/245419521 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:54.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.401+0000 7fa9f2309640 1 --2- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec1573e0 0x7fa9ec15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.401+0000 7fa9f1307640 1 --2- 172.21.15.136:0/245419521 >> v2:172.21.15.160:3300/0 conn(0x7fa9ec0ca090 0x7fa9ec0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.403+0000 7fa9f0b06640 1 -- 172.21.15.136:0/245419521 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464862351 0 0) 0x7fa9ec0c3690 con 0x7fa9ec150b50 2024-02-17T12:58:54.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.403+0000 7fa9f0b06640 1 -- 172.21.15.136:0/245419521 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d4005730 con 0x7fa9ec150b50 2024-02-17T12:58:54.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.403+0000 7fa9f1307640 1 -- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec1573e0 msgr2=0x7fa9ec15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:54.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.403+0000 7fa9f1307640 1 --2- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec1573e0 0x7fa9ec15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.403+0000 7fa9f1307640 1 -- 172.21.15.136:0/245419521 >> v1:172.21.15.136:6789/0 conn(0x7fa9ec150b50 legacy=0x7fa9ec0c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.403+0000 7fa9f1307640 1 -- 172.21.15.136:0/245419521 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0c38e0 con 0x7fa9ec0ca090 2024-02-17T12:58:54.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.406+0000 7fa9f1307640 1 --2- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec0726e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00097a0 tx=0x7fa9e002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162178f30691a798 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:54.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.409+0000 7fa9f0b06640 1 -- 172.21.15.136:0/245419521 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0031830 con 0x7fa9ec0ca090 2024-02-17T12:58:54.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.409+0000 7fa9f0b06640 1 -- 172.21.15.136:0/245419521 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e0031990 con 0x7fa9ec0ca090 2024-02-17T12:58:54.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.409+0000 7fa9f0b06640 1 -- 172.21.15.136:0/245419521 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0031d20 con 0x7fa9ec0ca090 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec0ca090 msgr2=0x7fa9ec0726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec0726e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00097a0 tx=0x7fa9e002b8d0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/245419521 shutdown_connections 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec1573e0 0x7fa9ec15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/245419521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec0726e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/245419521 >> 172.21.15.136:0/245419521 conn(0x7fa9ec06bbd0 msgr2=0x7fa9ec06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/245419521 shutdown_connections 2024-02-17T12:58:54.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.410+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/245419521 wait complete. 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.411+0000 7fa9f3d6c640 1 Processor -- start 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.411+0000 7fa9f3d6c640 1 -- start start 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f3d6c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f3d6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec150b50 0x7fa9ec158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f3d6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec1573e0 0x7fa9ec1e1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f3d6c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec153bd0 con 0x7fa9ec0ca090 2024-02-17T12:58:54.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f3d6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0cbe90 con 0x7fa9ec1573e0 2024-02-17T12:58:54.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f3d6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0cc170 con 0x7fa9ec150b50 2024-02-17T12:58:54.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.412+0000 7fa9f1b08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.413+0000 7fa9f1307640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec150b50 0x7fa9ec158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.413+0000 7fa9f2309640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec1573e0 0x7fa9ec1e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.413+0000 7fa9f1b08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39600/0 (socket says 172.21.15.136:39600) 2024-02-17T12:58:54.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.413+0000 7fa9f1b08640 1 -- 172.21.15.136:0/3135603399 learned_addr learned my addr 172.21.15.136:0/3135603399 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:54.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.416+0000 7fa9f1b08640 1 -- 172.21.15.136:0/3135603399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec150b50 msgr2=0x7fa9ec158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.416+0000 7fa9f1b08640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec150b50 0x7fa9ec158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.416+0000 7fa9f1b08640 1 -- 172.21.15.136:0/3135603399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec1573e0 msgr2=0x7fa9ec1e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.416+0000 7fa9f1b08640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec1573e0 0x7fa9ec1e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.416+0000 7fa9f1b08640 1 -- 172.21.15.136:0/3135603399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009400 con 0x7fa9ec0ca090 2024-02-17T12:58:54.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.418+0000 7fa9f1b08640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec153eb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00cb40 tx=0x7fa9dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:54.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.422+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00aca0 con 0x7fa9ec0ca090 2024-02-17T12:58:54.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.422+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00ae00 con 0x7fa9ec0ca090 2024-02-17T12:58:54.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.422+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec0cc450 con 0x7fa9ec0ca090 2024-02-17T12:58:54.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.422+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc012620 con 0x7fa9ec0ca090 2024-02-17T12:58:54.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.422+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec159ab0 con 0x7fa9ec0ca090 2024-02-17T12:58:54.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.423+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec072d70 con 0x7fa9ec0ca090 2024-02-17T12:58:54.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.667+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa9dc007070 con 0x7fa9ec0ca090 2024-02-17T12:58:54.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.667+0000 7fa9ea7fc640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa9d806b890 0x7fa9d806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:54.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.667+0000 7fa9f1307640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa9d806b890 0x7fa9d806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:54.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.668+0000 7fa9f1307640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa9d806b890 0x7fa9d806dd50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0036000 tx=0x7fa9e003c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:54.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.682+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fa9dc058e40 con 0x7fa9ec0ca090 2024-02-17T12:58:54.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.682+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9dc0550e0 con 0x7fa9ec0ca090 2024-02-17T12:58:54.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.904+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9ec1e0f50 con 0x7fa9ec0ca090 2024-02-17T12:58:54.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.916+0000 7fa9ea7fc640 1 -- 172.21.15.136:0/3135603399 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6599 (secure 0 0 0) 0x7fa9dc0587a0 con 0x7fa9ec0ca090 2024-02-17T12:58:54.907 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T12:58:54.907 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:37.333637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4288,"mds_2":4248,"mds_3":4245,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4245":{"gid":4245,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4248":{"gid":4248,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:58:54.908 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 18 2024-02-17T12:58:54.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.918+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa9d806b890 msgr2=0x7fa9d806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.918+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa9d806b890 0x7fa9d806dd50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0036000 tx=0x7fa9e003c040 comp rx=0 tx=0).stop 2024-02-17T12:58:54.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.918+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 msgr2=0x7fa9ec153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:54.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.918+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec153eb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00cb40 tx=0x7fa9dc00a060 comp rx=0 tx=0).stop 2024-02-17T12:58:54.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 shutdown_connections 2024-02-17T12:58:54.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa9d806b890 0x7fa9d806dd50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9ec1573e0 0x7fa9ec1e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9ec150b50 0x7fa9ec158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 --2- 172.21.15.136:0/3135603399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9ec0ca090 0x7fa9ec153eb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:54.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 >> 172.21.15.136:0/3135603399 conn(0x7fa9ec06bbd0 msgr2=0x7fa9ec14eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:54.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 shutdown_connections 2024-02-17T12:58:54.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:54.919+0000 7fa9f3d6c640 1 -- 172.21.15.136:0/3135603399 wait complete. 2024-02-17T12:58:55.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T12:57:57.313077+0000', 'modified': '2024-02-17T12:58:37.333637+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4297, 'mds_1': 4288, 'mds_2': 4248, 'mds_3': 4245, 'mds_4': 4244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4244': {'gid': 4244, 'name': 'd', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.160:6837/1130191707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 1130191707}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 1130191707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4245': {'gid': 4245, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.160:6835/1618847363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 1618847363}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 1618847363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4248': {'gid': 4248, 'name': 'c', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.136:6837/4146413895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 4146413895}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 4146413895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.160:6833/2957750090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 2957750090}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 2957750090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4297': {'gid': 4297, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.136:6839/2320874090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 2320874090}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 2320874090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T12:58:55.526 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-02-17T12:58:55.526 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-17T12:58:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.639+0000 7f0b6ff02640 1 Processor -- start 2024-02-17T12:58:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.640+0000 7f0b6ff02640 1 -- start start 2024-02-17T12:58:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.640+0000 7f0b6ff02640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b680c2640 0x7f0b680668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.640+0000 7f0b6ff02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b6806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.640+0000 7f0b6ff02640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680c6580 con 0x7f0b6806c010 2024-02-17T12:58:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.640+0000 7f0b6ff02640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680c2e00 con 0x7f0b680c2640 2024-02-17T12:58:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.640+0000 7f0b6ff02640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c6860 con 0x7f0b680c2a20 2024-02-17T12:58:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.641+0000 7f0b6dc9e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b680c2640 0x7f0b680668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.641+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b6806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.641+0000 7f0b6dc9e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b680c2640 0x7f0b680668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39616/0 (socket says 172.21.15.136:39616) 2024-02-17T12:58:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.641+0000 7f0b6e49f640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f0b6806c010 0x7f0b680c6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:38080/0 (socket says 172.21.15.136:38080) 2024-02-17T12:58:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.641+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1197309823 learned_addr learned my addr 172.21.15.136:0/1197309823 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.643+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1197309823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 msgr2=0x7f0b6806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.643+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/1197309823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b6806bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.643+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1197309823 >> v1:172.21.15.160:6789/0 conn(0x7f0b6806c010 legacy=0x7f0b680c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.643+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1197309823 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68159fe0 con 0x7f0b680c2640 2024-02-17T12:58:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.645+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/1197309823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b680668e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009870 tx=0x7f0b6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6db82b78f5a67e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.649+0000 7f0b6cc9c640 1 -- 172.21.15.136:0/1197309823 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64030840 con 0x7f0b680c2640 2024-02-17T12:58:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.649+0000 7f0b6cc9c640 1 -- 172.21.15.136:0/1197309823 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b640309a0 con 0x7f0b680c2640 2024-02-17T12:58:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.649+0000 7f0b6cc9c640 1 -- 172.21.15.136:0/1197309823 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64030d30 con 0x7f0b680c2640 2024-02-17T12:58:55.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 -- 172.21.15.136:0/1197309823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 msgr2=0x7f0b680668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/1197309823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b680668e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009870 tx=0x7f0b6402b980 comp rx=0 tx=0).stop 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 -- 172.21.15.136:0/1197309823 shutdown_connections 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/1197309823 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b6806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/1197309823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b680668e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 -- 172.21.15.136:0/1197309823 >> 172.21.15.136:0/1197309823 conn(0x7f0b680c8680 msgr2=0x7f0b680c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 -- 172.21.15.136:0/1197309823 shutdown_connections 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.650+0000 7f0b6ff02640 1 -- 172.21.15.136:0/1197309823 wait complete. 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.651+0000 7f0b6ff02640 1 Processor -- start 2024-02-17T12:58:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.651+0000 7f0b6ff02640 1 -- start start 2024-02-17T12:58:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6ff02640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b6806c010 0x7f0b68151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6ff02640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b681e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6ff02640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b681e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6ff02640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681e3930 con 0x7f0b680c2640 2024-02-17T12:58:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6ff02640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681e3c70 con 0x7f0b6806c010 2024-02-17T12:58:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6ff02640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681e5ae0 con 0x7f0b680c2a20 2024-02-17T12:58:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.652+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b681e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.653+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b681e5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39630/0 (socket says 172.21.15.136:39630) 2024-02-17T12:58:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.653+0000 7f0b6d49d640 1 -- 172.21.15.136:0/2713420032 learned_addr learned my addr 172.21.15.136:0/2713420032 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.653+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b681e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.654+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b6806c010 0x7f0b68151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.656+0000 7f0b6d49d640 1 -- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 msgr2=0x7f0b681e55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.656+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b681e55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.656+0000 7f0b6d49d640 1 -- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b6806c010 msgr2=0x7f0b68151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.656+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b6806c010 0x7f0b68151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.656+0000 7f0b6d49d640 1 -- 172.21.15.136:0/2713420032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640094d0 con 0x7f0b680c2640 2024-02-17T12:58:55.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.658+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b681e5060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9b0 tx=0x7f0b5800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.664+0000 7f0b5e7fc640 1 -- 172.21.15.136:0/2713420032 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58009670 con 0x7f0b680c2640 2024-02-17T12:58:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.664+0000 7f0b5e7fc640 1 -- 172.21.15.136:0/2713420032 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800c9a0 con 0x7f0b680c2640 2024-02-17T12:58:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.664+0000 7f0b5e7fc640 1 -- 172.21.15.136:0/2713420032 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800cd50 con 0x7f0b680c2640 2024-02-17T12:58:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.664+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6806b430 con 0x7f0b680c2640 2024-02-17T12:58:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.664+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6806b680 con 0x7f0b680c2640 2024-02-17T12:58:55.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 Processor -- start 2024-02-17T12:58:55.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 -- start start 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db45e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db46350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db44490 0x55b28db85290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28db00cd0 con 0x55b28db8f8b0 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28dab3f20 con 0x55b28db44490 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.667+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b28dab1450 con 0x55b28db45a30 2024-02-17T12:58:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.668+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db45e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.668+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db44490 0x55b28db85290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.668+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db45e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58512/0 (socket says 172.21.15.136:58512) 2024-02-17T12:58:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.668+0000 7f0b6e49f640 1 -- 172.21.15.136:0/3741476829 learned_addr learned my addr 172.21.15.136:0/3741476829 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.670+0000 7f0b6d49d640 1 -- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 msgr2=0x55b28db45e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.670+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db45e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.670+0000 7f0b6d49d640 1 -- 172.21.15.136:0/3741476829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 msgr2=0x55b28db46350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.670+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db46350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.670+0000 7f0b6d49d640 1 -- 172.21.15.136:0/3741476829 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b28da61f20 con 0x55b28db44490 2024-02-17T12:58:55.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.673+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db44490 0x55b28db85290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b68150c30 tx=0x7f0b58013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68bf1d64138287a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.676+0000 7f0b4b7fe640 1 -- 172.21.15.136:0/3741476829 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58013670 con 0x55b28db44490 2024-02-17T12:58:55.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.676+0000 7f0b4b7fe640 1 -- 172.21.15.136:0/3741476829 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580137d0 con 0x55b28db44490 2024-02-17T12:58:55.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.676+0000 7f0b4b7fe640 1 -- 172.21.15.136:0/3741476829 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58013c00 con 0x55b28db44490 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db44490 msgr2=0x55b28db85290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db44490 0x55b28db85290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b68150c30 tx=0x7f0b58013000 comp rx=0 tx=0).stop 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3741476829 shutdown_connections 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db44490 0x55b28db85290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db46350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3741476829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db45e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3741476829 >> 172.21.15.136:0/3741476829 conn(0x55b28db421a0 msgr2=0x55b28db44ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3741476829 shutdown_connections 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.677+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3741476829 wait complete. 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.678+0000 7f0b72bb2740 1 -- start start 2024-02-17T12:58:55.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.678+0000 7f0b72bb2740 1 Processor -- start 2024-02-17T12:58:55.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db86bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db8f8b0 0x55b28db9a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28daacc30 con 0x55b28db68e80 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28da51d30 con 0x55b28db8f8b0 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b28d780310 con 0x55b28db45a30 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b72bb2740 10 client.0 _ll_register_callbacks cb 0x55b28da59d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b6dc9e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db8f8b0 0x55b28db9a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db86bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db86bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58528/0 (socket says 172.21.15.136:58528) 2024-02-17T12:58:55.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.679+0000 7f0b6e49f640 1 -- 172.21.15.136:0/1229561066 learned_addr learned my addr 172.21.15.136:0/1229561066 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:55.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.683+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 msgr2=0x55b28db86bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.683+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db86bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.683+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1229561066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 msgr2=0x55b28db968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.683+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.683+0000 7f0b6dc9e640 1 -- 172.21.15.136:0/1229561066 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6806b680 con 0x55b28db8f8b0 2024-02-17T12:58:55.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.683+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db86bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:58:55.674 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.685+0000 7f0b5e7fc640 1 -- 172.21.15.136:0/2713420032 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0b58013470 con 0x7f0b680c2640 2024-02-17T12:58:55.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.685+0000 7f0b5e7fc640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0b4c06b800 0x7f0b4c06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.685+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db8f8b0 0x55b28db9a0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0b64033000 tx=0x7f0b640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec6a1b9ca2fbea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.685+0000 7f0b48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-02-17T12:58:55.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.685+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0b4c06b800 0x7f0b4c06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.685+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0b4c06b800 0x7f0b4c06dcc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b600017e0 tx=0x7f0b60006040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.688+0000 7f0b5e7fc640 1 -- 172.21.15.136:0/2713420032 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0b58006860 con 0x7f0b680c2640 2024-02-17T12:58:55.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.689+0000 7f0b48ff9640 1 -- 172.21.15.136:0/1229561066 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64039920 con 0x55b28db8f8b0 2024-02-17T12:58:55.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.689+0000 7f0b48ff9640 1 -- 172.21.15.136:0/1229561066 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0b64030e40 con 0x55b28db8f8b0 2024-02-17T12:58:55.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.689+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b28d7ac6c0 con 0x55b28db8f8b0 2024-02-17T12:58:55.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.690+0000 7f0b48ff9640 1 -- 172.21.15.136:0/1229561066 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b64039a80 con 0x55b28db8f8b0 2024-02-17T12:58:55.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.690+0000 7f0b72bb2740 10 client.4756 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:55.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.690+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b28daab2b0 con 0x55b28db8f8b0 2024-02-17T12:58:55.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b48ff9640 1 -- 172.21.15.136:0/1229561066 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b28d7ac6c0 con 0x55b28db8f8b0 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b48ff9640 1 -- 172.21.15.136:0/1229561066 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f0b64042070 con 0x55b28db8f8b0 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b72bb2740 10 client.4756 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b72bb2740 10 client.4756 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b72bb2740 20 client.4756 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28db96df0 0x55b28db859d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b72bb2740 4 client.4756 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.703+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 --> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b28d7fd270 con 0x55b28db96df0 2024-02-17T12:58:55.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.704+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28db96df0 0x55b28db859d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.751+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28db96df0 0x55b28db859d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=153bc5db3986db62 server_cookie=186b2a7f65b9e20e in_seq=0 out_seq=0 2024-02-17T12:58:55.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.751+0000 7f0b48ff9640 10 client.4756 ms_handle_connect on v2:172.21.15.160:6836/1130191707 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b48ff9640 1 -- 172.21.15.136:0/1229561066 <== mds.4 v2:172.21.15.160:6836/1130191707 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b28d7fd270 con 0x55b28db96df0 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b48ff9640 10 client.4756 handle_command_reply: tid=0 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 client.4756 shutdown 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db8f8b0 msgr2=0x55b28db9a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db8f8b0 0x55b28db9a0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0b64033000 tx=0x7f0b640046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 shutdown_connections 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28db96df0 0x55b28db859d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db8f8b0 0x55b28db9a0f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b48ff9640 0 client.4756 ms_handle_reset on v2:172.21.15.160:6836/1130191707 2024-02-17T12:58:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1229561066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db45a30 0x55b28db86bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 >> 172.21.15.136:0/1229561066 conn(0x55b28db44490 msgr2=0x55b28db3ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 shutdown_connections 2024-02-17T12:58:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1229561066 wait complete. 2024-02-17T12:58:55.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.863+0000 7f0b72bb2740 20 client.4756 trim_cache size 0 max 16384 2024-02-17T12:58:55.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 Processor -- start 2024-02-17T12:58:55.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 -- start start 2024-02-17T12:58:55.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dba9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db40e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db8f8b0 0x55b28db413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28da32490 con 0x55b28db68e80 2024-02-17T12:58:55.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28db8a8e0 con 0x55b28db45a30 2024-02-17T12:58:55.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.879+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b28db69300 con 0x55b28db8f8b0 2024-02-17T12:58:55.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.883+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db40e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.883+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db8f8b0 0x55b28db413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.883+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db40e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39656/0 (socket says 172.21.15.136:39656) 2024-02-17T12:58:55.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.883+0000 7f0b6d49d640 1 -- 172.21.15.136:0/1311101753 learned_addr learned my addr 172.21.15.136:0/1311101753 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:55.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.886+0000 7f0b6d49d640 1 -- 172.21.15.136:0/1311101753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db8f8b0 msgr2=0x55b28db413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.886+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db8f8b0 0x55b28db413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.886+0000 7f0b6d49d640 1 -- 172.21.15.136:0/1311101753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 msgr2=0x55b28dba9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.886+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dba9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.886+0000 7f0b6d49d640 1 -- 172.21.15.136:0/1311101753 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b28da47a20 con 0x55b28db68e80 2024-02-17T12:58:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.889+0000 7f0b6d49d640 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db40e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b5808aee0 tx=0x7f0b58013740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fe223adcfcdce6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.894+0000 7f0b4affd640 1 -- 172.21.15.136:0/1311101753 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58063a80 con 0x55b28db68e80 2024-02-17T12:58:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b4affd640 1 -- 172.21.15.136:0/1311101753 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58059720 con 0x55b28db68e80 2024-02-17T12:58:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b4affd640 1 -- 172.21.15.136:0/1311101753 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5805f120 con 0x55b28db68e80 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1311101753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 msgr2=0x55b28db40e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db40e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b5808aee0 tx=0x7f0b58013740 comp rx=0 tx=0).stop 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1311101753 shutdown_connections 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db8f8b0 0x55b28db413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db68e80 0x55b28db40e90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/1311101753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dba9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1311101753 >> 172.21.15.136:0/1311101753 conn(0x55b28db44490 msgr2=0x55b28db965e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1311101753 shutdown_connections 2024-02-17T12:58:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.895+0000 7f0b72bb2740 1 -- 172.21.15.136:0/1311101753 wait complete. 2024-02-17T12:58:55.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.896+0000 7f0b72bb2740 1 -- start start 2024-02-17T12:58:55.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.896+0000 7f0b72bb2740 1 Processor -- start 2024-02-17T12:58:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dbf4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db68e80 0x55b28dbeb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db9ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28dba9840 con 0x55b28db8f8b0 2024-02-17T12:58:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b28db45460 con 0x55b28db45a30 2024-02-17T12:58:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b28db6e850 con 0x55b28db68e80 2024-02-17T12:58:55.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b72bb2740 10 client.0 _ll_register_callbacks cb 0x7f0b5801f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:55.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db9ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b6dc9e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dbf4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.897+0000 7f0b6d49d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db68e80 0x55b28dbeb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.898+0000 7f0b6e49f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db9ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39664/0 (socket says 172.21.15.136:39664) 2024-02-17T12:58:55.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.898+0000 7f0b6e49f640 1 -- 172.21.15.136:0/3662726577 learned_addr learned my addr 172.21.15.136:0/3662726577 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:55.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.901+0000 7f0b6e49f640 1 -- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db68e80 msgr2=0x55b28dbeb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.901+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db68e80 0x55b28dbeb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.901+0000 7f0b6e49f640 1 -- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 msgr2=0x55b28dbf4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:55.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.901+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dbf4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.901+0000 7f0b6e49f640 1 -- 172.21.15.136:0/3662726577 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b28da61f20 con 0x55b28db8f8b0 2024-02-17T12:58:55.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.903+0000 7f0b6e49f640 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db9ca60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b60007920 tx=0x7f0b60001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c10ac1064dff5c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:55.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.903+0000 7f0b48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-02-17T12:58:55.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.906+0000 7f0b48ff9640 1 -- 172.21.15.136:0/3662726577 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600215f0 con 0x55b28db8f8b0 2024-02-17T12:58:55.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.906+0000 7f0b48ff9640 1 -- 172.21.15.136:0/3662726577 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0b60029c30 con 0x55b28db8f8b0 2024-02-17T12:58:55.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.906+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b580137d0 con 0x55b28db8f8b0 2024-02-17T12:58:55.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.908+0000 7f0b48ff9640 1 -- 172.21.15.136:0/3662726577 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b60029df0 con 0x55b28db8f8b0 2024-02-17T12:58:55.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.908+0000 7f0b72bb2740 10 client.4734 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:55.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.908+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b28da6d780 con 0x55b28db8f8b0 2024-02-17T12:58:55.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b48ff9640 1 -- 172.21.15.136:0/3662726577 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580137d0 con 0x55b28db8f8b0 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b48ff9640 1 -- 172.21.15.136:0/3662726577 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f0b6002c070 con 0x55b28db8f8b0 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b72bb2740 10 client.4734 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b72bb2740 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b72bb2740 20 client.4734 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28dbf10f0 0x55b28dbf14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b72bb2740 4 client.4734 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:58:55.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.912+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 --> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b28d7e9610 con 0x55b28dbf10f0 2024-02-17T12:58:55.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.913+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28dbf10f0 0x55b28dbf14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:55.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.916+0000 7f0b6dc9e640 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28dbf10f0 0x55b28dbf14d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed23d32e616f9c53 server_cookie=6758708d212a6202 in_seq=0 out_seq=0 2024-02-17T12:58:55.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.916+0000 7f0b48ff9640 10 client.4734 ms_handle_connect on v2:172.21.15.160:6836/1130191707 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b48ff9640 1 -- 172.21.15.136:0/3662726577 <== mds.4 v2:172.21.15.160:6836/1130191707 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b28d7e9610 con 0x55b28dbf10f0 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b48ff9640 10 client.4734 handle_command_reply: tid=0 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 client.4734 shutdown 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 msgr2=0x55b28db9ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db9ca60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b60007920 tx=0x7f0b60001400 comp rx=0 tx=0).stop 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 shutdown_connections 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:6836/1130191707,v1:172.21.15.160:6837/1130191707] conn(0x55b28dbf10f0 0x55b28dbf14d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b28db8f8b0 0x55b28db9ca60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b28db68e80 0x55b28dbeb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b48ff9640 0 client.4734 ms_handle_reset on v2:172.21.15.160:6836/1130191707 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 --2- 172.21.15.136:0/3662726577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b28db45a30 0x55b28dbf4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 >> 172.21.15.136:0/3662726577 conn(0x55b28db44490 msgr2=0x55b28db622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 shutdown_connections 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 1 -- 172.21.15.136:0/3662726577 wait complete. 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.934+0000 7f0b72bb2740 20 client.4734 trim_cache size 0 max 16384 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "b14cc0e2-9a6d-442e-8d67-bc5380021b88", 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 4, 2024-02-17T12:58:55.926 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4244, 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 20.142733611000001, 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 18, 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 26, 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 26, 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 67.440785434000006 2024-02-17T12:58:55.927 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:55.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0b4c06b800 msgr2=0x7f0b4c06dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0b4c06b800 0x7f0b4c06dcc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b600017e0 tx=0x7f0b60006040 comp rx=0 tx=0).stop 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 msgr2=0x7f0b681e5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b681e5060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9b0 tx=0x7f0b5800ee70 comp rx=0 tx=0).stop 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 shutdown_connections 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0b4c06b800 0x7f0b4c06dcc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b680c2a20 0x7f0b681e55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b680c2640 0x7f0b681e5060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 --2- 172.21.15.136:0/2713420032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b6806c010 0x7f0b68151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 >> 172.21.15.136:0/2713420032 conn(0x7f0b680c8680 msgr2=0x7f0b680c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 shutdown_connections 2024-02-17T12:58:55.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:55.935+0000 7f0b6ff02640 1 -- 172.21.15.136:0/2713420032 wait complete. 2024-02-17T12:58:55.936 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-02-17T12:58:56.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.048+0000 7fb0c688f640 1 Processor -- start 2024-02-17T12:58:56.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 -- start start 2024-02-17T12:58:56.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb0c0150b50 0x7fb0c00726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb0c00ca090 0x7fb0c01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00c51b0 0x7fb0c00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c0157920 con 0x7fb0c00ca090 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c00c3690 con 0x7fb0c0150b50 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.049+0000 7fb0c688f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c0159f50 con 0x7fb0c00c51b0 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.050+0000 7fb0bf7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb0c00ca090 0x7fb0c01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.050+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00c51b0 0x7fb0c00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.050+0000 7fb0bffff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb0c0150b50 0x7fb0c00726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.050+0000 7fb0bf7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb0c00ca090 0x7fb0c01573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39678/0 (socket says 172.21.15.136:39678) 2024-02-17T12:58:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.050+0000 7fb0bf7fe640 1 -- 172.21.15.136:0/1339916114 learned_addr learned my addr 172.21.15.136:0/1339916114 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.052+0000 7fb0bf7fe640 1 -- 172.21.15.136:0/1339916114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00c51b0 msgr2=0x7fb0c00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.052+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/1339916114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00c51b0 0x7fb0c00c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.052+0000 7fb0bf7fe640 1 -- 172.21.15.136:0/1339916114 >> v2:172.21.15.160:3300/0 conn(0x7fb0c0150b50 msgr2=0x7fb0c00726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.052+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/1339916114 >> v2:172.21.15.160:3300/0 conn(0x7fb0c0150b50 0x7fb0c00726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.052+0000 7fb0bf7fe640 1 -- 172.21.15.136:0/1339916114 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c00c38e0 con 0x7fb0c00ca090 2024-02-17T12:58:56.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.054+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/1339916114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00ca090 0x7fb0c01573e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0070da0 tx=0x7fb0b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f408c1ef083269 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0beffd640 1 -- 172.21.15.136:0/1339916114 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4031870 con 0x7fb0c00ca090 2024-02-17T12:58:56.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0beffd640 1 -- 172.21.15.136:0/1339916114 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b40319d0 con 0x7fb0c00ca090 2024-02-17T12:58:56.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0beffd640 1 -- 172.21.15.136:0/1339916114 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4031d60 con 0x7fb0c00ca090 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 -- 172.21.15.136:0/1339916114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00ca090 msgr2=0x7fb0c01573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 --2- 172.21.15.136:0/1339916114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00ca090 0x7fb0c01573e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0070da0 tx=0x7fb0b402b910 comp rx=0 tx=0).stop 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 -- 172.21.15.136:0/1339916114 shutdown_connections 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 --2- 172.21.15.136:0/1339916114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00c51b0 0x7fb0c00c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 --2- 172.21.15.136:0/1339916114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00ca090 0x7fb0c01573e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 --2- 172.21.15.136:0/1339916114 >> v2:172.21.15.160:3300/0 conn(0x7fb0c0150b50 0x7fb0c00726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 -- 172.21.15.136:0/1339916114 >> 172.21.15.136:0/1339916114 conn(0x7fb0c006bbd0 msgr2=0x7fb0c006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 -- 172.21.15.136:0/1339916114 shutdown_connections 2024-02-17T12:58:56.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.058+0000 7fb0c688f640 1 -- 172.21.15.136:0/1339916114 wait complete. 2024-02-17T12:58:56.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.060+0000 7fb0c688f640 1 Processor -- start 2024-02-17T12:58:56.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.060+0000 7fb0c688f640 1 -- start start 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0c688f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 0x7fb0c01f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0c688f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00ca090 0x7fb0c00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0c688f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0c0150b50 0x7fb0c0155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0c688f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c01f1120 con 0x7fb0c00c51b0 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0c688f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c01ecc60 con 0x7fb0c0150b50 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0c688f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00c6b30 con 0x7fb0c00ca090 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0bffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 0x7fb0c01f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0bf7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00ca090 0x7fb0c00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0bffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 0x7fb0c01f0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39690/0 (socket says 172.21.15.136:39690) 2024-02-17T12:58:56.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.061+0000 7fb0bffff640 1 -- 172.21.15.136:0/2908325788 learned_addr learned my addr 172.21.15.136:0/2908325788 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.062+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0c0150b50 0x7fb0c0155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.065+0000 7fb0bffff640 1 -- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00ca090 msgr2=0x7fb0c00c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.065+0000 7fb0bffff640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00ca090 0x7fb0c00c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.065+0000 7fb0bffff640 1 -- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0c0150b50 msgr2=0x7fb0c0155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.065+0000 7fb0bffff640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0c0150b50 0x7fb0c0155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.065+0000 7fb0bffff640 1 -- 172.21.15.136:0/2908325788 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40094d0 con 0x7fb0c00c51b0 2024-02-17T12:58:56.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.067+0000 7fb0bffff640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 0x7fb0c01f0be0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009f60 tx=0x7fb0b0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.071+0000 7fb0bcff9640 1 -- 172.21.15.136:0/2908325788 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0009670 con 0x7fb0c00c51b0 2024-02-17T12:58:56.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.071+0000 7fb0bcff9640 1 -- 172.21.15.136:0/2908325788 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b000ca00 con 0x7fb0c00c51b0 2024-02-17T12:58:56.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.071+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c00c6e10 con 0x7fb0c00c51b0 2024-02-17T12:58:56.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.071+0000 7fb0bcff9640 1 -- 172.21.15.136:0/2908325788 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000cdb0 con 0x7fb0c00c51b0 2024-02-17T12:58:56.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.071+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c01ed150 con 0x7fb0c00c51b0 2024-02-17T12:58:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.073+0000 7fb0c945d740 1 Processor -- start 2024-02-17T12:58:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 -- start start 2024-02-17T12:58:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58ed150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 0x55f6e593a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e58e9220 0x55f6e593a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e58a6cd0 con 0x55f6e592b7d0 2024-02-17T12:58:56.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e5859f20 con 0x55f6e592b3f0 2024-02-17T12:58:56.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.074+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6e5857450 con 0x55f6e58e9220 2024-02-17T12:58:56.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.075+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.075+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:48742/0 (socket says 172.21.15.136:48742) 2024-02-17T12:58:56.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.075+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/221715220 learned_addr learned my addr 172.21.15.136:0/221715220 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.077+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e58e9220 msgr2=0x55f6e593a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.077+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e58e9220 0x55f6e593a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.077+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/221715220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 msgr2=0x55f6e593a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.077+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 0x55f6e593a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.077+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/221715220 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6e5807f20 con 0x55f6e592b3f0 2024-02-17T12:58:56.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.079+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58ed150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80112e0 tx=0x7fb0b800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de6c082f136e20df server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.081+0000 7fb0a5ffb640 1 -- 172.21.15.136:0/221715220 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8010040 con 0x55f6e592b3f0 2024-02-17T12:58:56.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0a5ffb640 1 -- 172.21.15.136:0/221715220 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8016860 con 0x55f6e592b3f0 2024-02-17T12:58:56.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0a5ffb640 1 -- 172.21.15.136:0/221715220 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8011ee0 con 0x55f6e592b3f0 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 -- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 msgr2=0x55f6e58ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58ed150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80112e0 tx=0x7fb0b800b040 comp rx=0 tx=0).stop 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 -- 172.21.15.136:0/221715220 shutdown_connections 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e58e9220 0x55f6e593a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 0x55f6e593a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 --2- 172.21.15.136:0/221715220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58ed150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.083+0000 7fb0c945d740 1 -- 172.21.15.136:0/221715220 >> 172.21.15.136:0/221715220 conn(0x55f6e58e81a0 msgr2=0x55f6e58eaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.084+0000 7fb0c945d740 1 -- 172.21.15.136:0/221715220 shutdown_connections 2024-02-17T12:58:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.084+0000 7fb0c945d740 1 -- 172.21.15.136:0/221715220 wait complete. 2024-02-17T12:58:56.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.084+0000 7fb0c945d740 1 -- start start 2024-02-17T12:58:56.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.084+0000 7fb0c945d740 1 Processor -- start 2024-02-17T12:58:56.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 0x55f6e5912ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5948c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e5852c30 con 0x55f6e592b7d0 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e57f7d30 con 0x55f6e592b3f0 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6e5526310 con 0x55f6e5919de0 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c945d740 10 client.0 _ll_register_callbacks cb 0x55f6e57ffd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.085+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.086+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:48746/0 (socket says 172.21.15.136:48746) 2024-02-17T12:58:56.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.086+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/3624070768 learned_addr learned my addr 172.21.15.136:0/3624070768 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.089+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 msgr2=0x55f6e5948c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.089+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5948c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.089+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/3624070768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 msgr2=0x55f6e5912ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.089+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 0x55f6e5912ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.089+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/3624070768 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b8009dd0 con 0x55f6e592b3f0 2024-02-17T12:58:56.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.091+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58e62e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80155e0 tx=0x7fb0b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e351a9047f1be41c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.091+0000 7fb09effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-02-17T12:58:56.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.092+0000 7fb0bcff9640 1 -- 172.21.15.136:0/2908325788 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb0b0019440 con 0x7fb0c00c51b0 2024-02-17T12:58:56.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.092+0000 7fb0bcff9640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb0ac06b800 0x7fb0ac06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.092+0000 7fb0bffff640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb0ac06b800 0x7fb0ac06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.093+0000 7fb0bffff640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb0ac06b800 0x7fb0ac06dcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0058240 tx=0x7fb0b0013040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.094+0000 7fb09effd640 1 -- 172.21.15.136:0/3624070768 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8010030 con 0x55f6e592b3f0 2024-02-17T12:58:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.094+0000 7fb09effd640 1 -- 172.21.15.136:0/3624070768 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb0b8003ba0 con 0x55f6e592b3f0 2024-02-17T12:58:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.094+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6e55526c0 con 0x55f6e592b3f0 2024-02-17T12:58:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.095+0000 7fb0bcff9640 1 -- 172.21.15.136:0/2908325788 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb0b0058540 con 0x7fb0c00c51b0 2024-02-17T12:58:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.096+0000 7fb09effd640 1 -- 172.21.15.136:0/3624070768 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0b8016e80 con 0x55f6e592b3f0 2024-02-17T12:58:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.096+0000 7fb0c945d740 10 client.4771 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.096+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f6e58512b0 con 0x55f6e592b3f0 2024-02-17T12:58:56.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb09effd640 1 -- 172.21.15.136:0/3624070768 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f6e55526c0 con 0x55f6e592b3f0 2024-02-17T12:58:56.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb09effd640 1 -- 172.21.15.136:0/3624070768 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fb0b8015740 con 0x55f6e592b3f0 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb0c945d740 10 client.4771 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb0c945d740 10 client.4771 resolve_mds: resolved name 'f' to daemon mds.f 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb0c945d740 20 client.4771 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb0c945d740 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5951be0 0x55f6e5953fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb0c945d740 4 client.4771 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.100+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 --> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6e55a3270 con 0x55f6e5951be0 2024-02-17T12:58:56.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.101+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5951be0 0x55f6e5953fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.140+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5951be0 0x55f6e5953fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1d5d653f47cf22a1 server_cookie=fefbcd518ede2764 in_seq=0 out_seq=0 2024-02-17T12:58:56.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.140+0000 7fb09effd640 10 client.4771 ms_handle_connect on v2:172.21.15.160:6834/1618847363 2024-02-17T12:58:56.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.241+0000 7fb09effd640 1 -- 172.21.15.136:0/3624070768 <== mds.3 v2:172.21.15.160:6834/1618847363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f6e55a3270 con 0x55f6e5951be0 2024-02-17T12:58:56.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.241+0000 7fb09effd640 10 client.4771 handle_command_reply: tid=0 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.241+0000 7fb0c945d740 1 client.4771 shutdown 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 msgr2=0x55f6e58e62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58e62e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80155e0 tx=0x7fb0b8004a40 comp rx=0 tx=0).stop 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 shutdown_connections 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5951be0 0x55f6e5953fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5948c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b7d0 0x55f6e5912ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 --2- 172.21.15.136:0/3624070768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b3f0 0x55f6e58e62e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb09effd640 0 client.4771 ms_handle_reset on v2:172.21.15.160:6834/1618847363 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 >> 172.21.15.136:0/3624070768 conn(0x55f6e58e9220 msgr2=0x55f6e58eb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 shutdown_connections 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 1 -- 172.21.15.136:0/3624070768 wait complete. 2024-02-17T12:58:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.242+0000 7fb0c945d740 20 client.4771 trim_cache size 0 max 16384 2024-02-17T12:58:56.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.257+0000 7fb0c945d740 1 Processor -- start 2024-02-17T12:58:56.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.257+0000 7fb0c945d740 1 -- start start 2024-02-17T12:58:56.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.258+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 0x55f6e592d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.258+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e592b3f0 0x55f6e592daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.258+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e5957ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.258+0000 7fb0c945d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e57d8490 con 0x55f6e5919de0 2024-02-17T12:58:56.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.258+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e5915320 con 0x55f6e592b7d0 2024-02-17T12:58:56.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.258+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6e58e5190 con 0x55f6e592b3f0 2024-02-17T12:58:56.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.259+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 0x55f6e592d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.259+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e5957ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.259+0000 7fb0bf7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e592b3f0 0x55f6e592daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.259+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 0x55f6e592d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39726/0 (socket says 172.21.15.136:39726) 2024-02-17T12:58:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.259+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/562747843 learned_addr learned my addr 172.21.15.136:0/562747843 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.261+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/562747843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e592b3f0 msgr2=0x55f6e592daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.261+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e592b3f0 0x55f6e592daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.261+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/562747843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 msgr2=0x55f6e5957ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.261+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e5957ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.261+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/562747843 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6e57eda20 con 0x55f6e5919de0 2024-02-17T12:58:56.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.263+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 0x55f6e592d560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8011d30 tx=0x7fb0b8021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6750d224b8e71e45 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.267+0000 7fb0a57fa640 1 -- 172.21.15.136:0/562747843 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8010030 con 0x55f6e5919de0 2024-02-17T12:58:56.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.267+0000 7fb0a57fa640 1 -- 172.21.15.136:0/562747843 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b80153b0 con 0x55f6e5919de0 2024-02-17T12:58:56.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.267+0000 7fb0a57fa640 1 -- 172.21.15.136:0/562747843 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8015610 con 0x55f6e5919de0 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 -- 172.21.15.136:0/562747843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 msgr2=0x55f6e592d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 0x55f6e592d560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8011d30 tx=0x7fb0b8021070 comp rx=0 tx=0).stop 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 -- 172.21.15.136:0/562747843 shutdown_connections 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e5957ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e592b3f0 0x55f6e592daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 --2- 172.21.15.136:0/562747843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e5919de0 0x55f6e592d560 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 -- 172.21.15.136:0/562747843 >> 172.21.15.136:0/562747843 conn(0x55f6e58e9220 msgr2=0x55f6e593b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 -- 172.21.15.136:0/562747843 shutdown_connections 2024-02-17T12:58:56.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 -- 172.21.15.136:0/562747843 wait complete. 2024-02-17T12:58:56.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 -- start start 2024-02-17T12:58:56.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.268+0000 7fb0c945d740 1 Processor -- start 2024-02-17T12:58:56.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5958590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b3f0 0x55f6e5938630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e59998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e59a3ce0 con 0x55f6e592b3f0 2024-02-17T12:58:56.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6e599fb30 con 0x55f6e592b7d0 2024-02-17T12:58:56.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6e593b800 con 0x55f6e5919de0 2024-02-17T12:58:56.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.269+0000 7fb0c945d740 10 client.0 _ll_register_callbacks cb 0x7fb0b8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:56.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.270+0000 7fb0bf7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b3f0 0x55f6e5938630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.270+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5958590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.270+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e59998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.270+0000 7fb0c4e2c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5958590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58594/0 (socket says 172.21.15.136:58594) 2024-02-17T12:58:56.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.270+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/1387490192 learned_addr learned my addr 172.21.15.136:0/1387490192 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.273+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 msgr2=0x55f6e5958590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.273+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5958590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.273+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/1387490192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b3f0 msgr2=0x55f6e5938630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.273+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b3f0 0x55f6e5938630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.273+0000 7fb0c4e2c640 1 -- 172.21.15.136:0/1387490192 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6e58512b0 con 0x55f6e592b7d0 2024-02-17T12:58:56.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.275+0000 7fb0c4e2c640 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e59998f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8011d30 tx=0x7fb0b800b070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42feb90bb653ab24 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.275+0000 7fb09effd640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-02-17T12:58:56.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.279+0000 7fb09effd640 1 -- 172.21.15.136:0/1387490192 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b802d060 con 0x55f6e592b7d0 2024-02-17T12:58:56.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.279+0000 7fb09effd640 1 -- 172.21.15.136:0/1387490192 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb0b8011070 con 0x55f6e592b7d0 2024-02-17T12:58:56.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.279+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb0b8016860 con 0x55f6e592b7d0 2024-02-17T12:58:56.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.281+0000 7fb09effd640 1 -- 172.21.15.136:0/1387490192 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0b80157b0 con 0x55f6e592b7d0 2024-02-17T12:58:56.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.281+0000 7fb0c945d740 10 client.4777 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:56.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.281+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f6e5813780 con 0x55f6e592b7d0 2024-02-17T12:58:56.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb09effd640 1 -- 172.21.15.136:0/1387490192 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8016860 con 0x55f6e592b7d0 2024-02-17T12:58:56.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb09effd640 1 -- 172.21.15.136:0/1387490192 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fb0b8028470 con 0x55f6e592b7d0 2024-02-17T12:58:56.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0c945d740 10 client.4777 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:56.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0c945d740 10 client.4777 resolve_mds: resolved name 'f' to daemon mds.f 2024-02-17T12:58:56.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0c945d740 20 client.4777 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:56.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0c945d740 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5928a90 0x55f6e5928e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0c945d740 4 client.4777 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:58:56.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 --> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f6e558f610 con 0x55f6e5928a90 2024-02-17T12:58:56.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.285+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5928a90 0x55f6e5928e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.289+0000 7fb0bf7fe640 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5928a90 0x55f6e5928e70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=22550dd0f2a85648 server_cookie=6b9f177d8503b96a in_seq=0 out_seq=0 2024-02-17T12:58:56.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.289+0000 7fb09effd640 10 client.4777 ms_handle_connect on v2:172.21.15.160:6834/1618847363 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb09effd640 1 -- 172.21.15.136:0/1387490192 <== mds.3 v2:172.21.15.160:6834/1618847363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f6e558f610 con 0x55f6e5928a90 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb09effd640 10 client.4777 handle_command_reply: tid=0 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 client.4777 shutdown 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 msgr2=0x55f6e59998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e59998f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8011d30 tx=0x7fb0b800b070 comp rx=0 tx=0).stop 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 shutdown_connections 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:6834/1618847363,v1:172.21.15.160:6835/1618847363] conn(0x55f6e5928a90 0x55f6e5928e70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6e592b7d0 0x55f6e59998f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f6e592b3f0 0x55f6e5938630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb09effd640 0 client.4777 ms_handle_reset on v2:172.21.15.160:6834/1618847363 2024-02-17T12:58:56.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 --2- 172.21.15.136:0/1387490192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f6e5919de0 0x55f6e5958590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 >> 172.21.15.136:0/1387490192 conn(0x55f6e58e9220 msgr2=0x55f6e592d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 shutdown_connections 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 1 -- 172.21.15.136:0/1387490192 wait complete. 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.306+0000 7fb0c945d740 20 client.4777 trim_cache size 0 max 16384 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "b14cc0e2-9a6d-442e-8d67-bc5380021b88", 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 3, 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4245, 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-02-17T12:58:56.298 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 22.864727859999999, 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 18, 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 26, 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 26, 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 67.846183202000006 2024-02-17T12:58:56.299 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb0ac06b800 msgr2=0x7fb0ac06dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb0ac06b800 0x7fb0ac06dcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0058240 tx=0x7fb0b0013040 comp rx=0 tx=0).stop 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 msgr2=0x7fb0c01f0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 0x7fb0c01f0be0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009f60 tx=0x7fb0b0009f90 comp rx=0 tx=0).stop 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 shutdown_connections 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb0ac06b800 0x7fb0ac06dcc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0c0150b50 0x7fb0c0155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0c00ca090 0x7fb0c00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 --2- 172.21.15.136:0/2908325788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0c00c51b0 0x7fb0c01f0be0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 >> 172.21.15.136:0/2908325788 conn(0x7fb0c006bbd0 msgr2=0x7fb0c014fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 shutdown_connections 2024-02-17T12:58:56.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.307+0000 7fb0c688f640 1 -- 172.21.15.136:0/2908325788 wait complete. 2024-02-17T12:58:56.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-17T12:58:56.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.418+0000 7f057e779640 1 Processor -- start 2024-02-17T12:58:56.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.418+0000 7f057e779640 1 -- start start 2024-02-17T12:58:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.419+0000 7f057e779640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05780c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.419+0000 7f057e779640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057806f340 con 0x7f0578158460 2024-02-17T12:58:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.419+0000 7f057e779640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057814e8a0 con 0x7f0578158020 2024-02-17T12:58:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.419+0000 7f057e779640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057815b290 con 0x7f057814e4c0 2024-02-17T12:58:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.420+0000 7f057cd16640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0578158460 0x7f057806ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:39372/0 (socket says 172.21.15.136:39372) 2024-02-17T12:58:56.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.420+0000 7f057cd16640 1 -- 172.21.15.136:0/1589698298 learned_addr learned my addr 172.21.15.136:0/1589698298 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:56.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.420+0000 7f0577fff640 1 --2- 172.21.15.136:0/1589698298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05780c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.422+0000 7f0576ffd640 1 -- 172.21.15.136:0/1589698298 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614124413 0 0) 0x7f057806f340 con 0x7f0578158460 2024-02-17T12:58:56.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.422+0000 7f0576ffd640 1 -- 172.21.15.136:0/1589698298 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0560003520 con 0x7f0578158460 2024-02-17T12:58:56.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.423+0000 7f0576ffd640 1 -- 172.21.15.136:0/1589698298 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222053215 0 0) 0x7f057814e8a0 con 0x7f0578158020 2024-02-17T12:58:56.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.423+0000 7f0577fff640 1 -- 172.21.15.136:0/1589698298 >> v1:172.21.15.160:6789/0 conn(0x7f0578158020 legacy=0x7f057806e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.423+0000 7f0577fff640 1 -- 172.21.15.136:0/1589698298 >> v1:172.21.15.136:6789/0 conn(0x7f0578158460 legacy=0x7f057806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.423+0000 7f0577fff640 1 -- 172.21.15.136:0/1589698298 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057815b570 con 0x7f057814e4c0 2024-02-17T12:58:56.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.425+0000 7f0577fff640 1 --2- 172.21.15.136:0/1589698298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05780c2bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05680097d0 tx=0x7f056802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475ef76bba10d761 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.429+0000 7f0576ffd640 1 -- 172.21.15.136:0/1589698298 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568031890 con 0x7f057814e4c0 2024-02-17T12:58:56.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.429+0000 7f0576ffd640 1 -- 172.21.15.136:0/1589698298 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680319f0 con 0x7f057814e4c0 2024-02-17T12:58:56.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.429+0000 7f0576ffd640 1 -- 172.21.15.136:0/1589698298 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568031d80 con 0x7f057814e4c0 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 -- 172.21.15.136:0/1589698298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 msgr2=0x7f05780c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 --2- 172.21.15.136:0/1589698298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05780c2bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05680097d0 tx=0x7f056802b930 comp rx=0 tx=0).stop 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 -- 172.21.15.136:0/1589698298 shutdown_connections 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 --2- 172.21.15.136:0/1589698298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05780c2bc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 -- 172.21.15.136:0/1589698298 >> 172.21.15.136:0/1589698298 conn(0x7f057806aac0 msgr2=0x7f057806aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 -- 172.21.15.136:0/1589698298 shutdown_connections 2024-02-17T12:58:56.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.430+0000 7f057e779640 1 -- 172.21.15.136:0/1589698298 wait complete. 2024-02-17T12:58:56.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.431+0000 7f057e779640 1 Processor -- start 2024-02-17T12:58:56.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.431+0000 7f057e779640 1 -- start start 2024-02-17T12:58:56.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.432+0000 7f057e779640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05781f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.432+0000 7f057e779640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0578158020 0x7f05780ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.432+0000 7f057e779640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0578158460 0x7f05781ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.432+0000 7f057e779640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578156f00 con 0x7f0578158020 2024-02-17T12:58:56.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.432+0000 7f057e779640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05781f2ce0 con 0x7f0578158460 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.432+0000 7f057e779640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057815a930 con 0x7f057814e4c0 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.433+0000 7f05777fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0578158020 0x7f05780ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.433+0000 7f0577fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05781f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.433+0000 7f057cd16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0578158460 0x7f05781ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.433+0000 7f0577fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05781f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58604/0 (socket says 172.21.15.136:58604) 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.433+0000 7f05777fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0578158020 0x7f05780ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39740/0 (socket says 172.21.15.136:39740) 2024-02-17T12:58:56.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.433+0000 7f0577fff640 1 -- 172.21.15.136:0/3334567026 learned_addr learned my addr 172.21.15.136:0/3334567026 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.436+0000 7f0577fff640 1 -- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0578158460 msgr2=0x7f05781ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.436+0000 7f0577fff640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0578158460 0x7f05781ef6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.436+0000 7f0577fff640 1 -- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0578158020 msgr2=0x7f05780ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.436+0000 7f0577fff640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0578158020 0x7f05780ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.436+0000 7f0577fff640 1 -- 172.21.15.136:0/3334567026 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009400 con 0x7f057814e4c0 2024-02-17T12:58:56.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.438+0000 7f0577fff640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05781f3780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05680097d0 tx=0x7f05680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.442+0000 7f0574ff9640 1 -- 172.21.15.136:0/3334567026 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568004230 con 0x7f057814e4c0 2024-02-17T12:58:56.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.442+0000 7f0574ff9640 1 -- 172.21.15.136:0/3334567026 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568004390 con 0x7f057814e4c0 2024-02-17T12:58:56.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.442+0000 7f0574ff9640 1 -- 172.21.15.136:0/3334567026 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056803ba20 con 0x7f057814e4c0 2024-02-17T12:58:56.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.442+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057815ac10 con 0x7f057814e4c0 2024-02-17T12:58:56.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.442+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05781f3260 con 0x7f057814e4c0 2024-02-17T12:58:56.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.445+0000 7f058141f740 1 Processor -- start 2024-02-17T12:58:56.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.445+0000 7f058141f740 1 -- start start 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f39e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f058141f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735f3a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f38490 0x555735f79290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f058141f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735ef4cd0 con 0x555735f838b0 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735ea7f20 con 0x555735f38490 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555735ea5450 con 0x555735f39a30 2024-02-17T12:58:56.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f0577fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735f3a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f05777fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f38490 0x555735f79290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f0577fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735f3a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39756/0 (socket says 172.21.15.136:39756) 2024-02-17T12:58:56.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.446+0000 7f0577fff640 1 -- 172.21.15.136:0/4294610628 learned_addr learned my addr 172.21.15.136:0/4294610628 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.448+0000 7f0577fff640 1 -- 172.21.15.136:0/4294610628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 msgr2=0x555735f39e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.448+0000 7f0577fff640 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f39e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.448+0000 7f0577fff640 1 -- 172.21.15.136:0/4294610628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f38490 msgr2=0x555735f79290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.448+0000 7f0577fff640 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f38490 0x555735f79290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.448+0000 7f0577fff640 1 -- 172.21.15.136:0/4294610628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555735e55f20 con 0x555735f838b0 2024-02-17T12:58:56.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.450+0000 7f0577fff640 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735f3a350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05680098f0 tx=0x7f056803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9793e11f7cf498a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f055dffb640 1 -- 172.21.15.136:0/4294610628 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568053040 con 0x555735f838b0 2024-02-17T12:58:56.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f055dffb640 1 -- 172.21.15.136:0/4294610628 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056804e650 con 0x555735f838b0 2024-02-17T12:58:56.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f055dffb640 1 -- 172.21.15.136:0/4294610628 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056804e9e0 con 0x555735f838b0 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 -- 172.21.15.136:0/4294610628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 msgr2=0x555735f3a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735f3a350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05680098f0 tx=0x7f056803e000 comp rx=0 tx=0).stop 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 -- 172.21.15.136:0/4294610628 shutdown_connections 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f38490 0x555735f79290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735f3a350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 --2- 172.21.15.136:0/4294610628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f39e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 -- 172.21.15.136:0/4294610628 >> 172.21.15.136:0/4294610628 conn(0x555735f361a0 msgr2=0x555735f38ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 -- 172.21.15.136:0/4294610628 shutdown_connections 2024-02-17T12:58:56.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.454+0000 7f058141f740 1 -- 172.21.15.136:0/4294610628 wait complete. 2024-02-17T12:58:56.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.455+0000 7f058141f740 1 -- start start 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.455+0000 7f058141f740 1 Processor -- start 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f7d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735ea0c30 con 0x555735f5ef90 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735e45d30 con 0x555735f39a30 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555735b74310 con 0x555735f838b0 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f058141f740 10 client.0 _ll_register_callbacks cb 0x555735e4dd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f05777fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f7d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.456+0000 7f057cd16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.457+0000 7f05777fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f7d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39760/0 (socket says 172.21.15.136:39760) 2024-02-17T12:58:56.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.457+0000 7f05777fe640 1 -- 172.21.15.136:0/2635631182 learned_addr learned my addr 172.21.15.136:0/2635631182 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.459+0000 7f05777fe640 1 -- 172.21.15.136:0/2635631182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 msgr2=0x555735f606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.459+0000 7f05777fe640 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.460+0000 7f05777fe640 1 -- 172.21.15.136:0/2635631182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 msgr2=0x555735f342e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.460+0000 7f05777fe640 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f342e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.460+0000 7f05777fe640 1 -- 172.21.15.136:0/2635631182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05781f3260 con 0x555735f5ef90 2024-02-17T12:58:56.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.462+0000 7f05777fe640 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f7d570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f056c012570 tx=0x7f056c012970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383ef6d87a98a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.462+0000 7f0556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-02-17T12:58:56.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.464+0000 7f0574ff9640 1 -- 172.21.15.136:0/3334567026 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0568043070 con 0x7f057814e4c0 2024-02-17T12:58:56.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.464+0000 7f0574ff9640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f056406b7d0 0x7f056406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.464+0000 7f057cd16640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f056406b7d0 0x7f056406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.464+0000 7f057cd16640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f056406b7d0 0x7f056406dc90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0570001530 tx=0x7f0570006cc0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.465+0000 7f0556ffd640 1 -- 172.21.15.136:0/2635631182 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0052e0 con 0x555735f5ef90 2024-02-17T12:58:56.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.465+0000 7f0556ffd640 1 -- 172.21.15.136:0/2635631182 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f056c005440 con 0x555735f5ef90 2024-02-17T12:58:56.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.465+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555735ba06c0 con 0x555735f5ef90 2024-02-17T12:58:56.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.467+0000 7f0556ffd640 1 -- 172.21.15.136:0/2635631182 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f056c0035f0 con 0x555735f5ef90 2024-02-17T12:58:56.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.467+0000 7f058141f740 10 client.4758 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:56.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.467+0000 7f0574ff9640 1 -- 172.21.15.136:0/3334567026 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0568046e50 con 0x7f057814e4c0 2024-02-17T12:58:56.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.467+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555735e9f2b0 con 0x555735f5ef90 2024-02-17T12:58:56.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.470+0000 7f0556ffd640 1 -- 172.21.15.136:0/2635631182 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555735ba06c0 con 0x555735f5ef90 2024-02-17T12:58:56.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.470+0000 7f0556ffd640 1 -- 172.21.15.136:0/2635631182 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f056c003750 con 0x555735f5ef90 2024-02-17T12:58:56.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f058141f740 10 client.4758 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:56.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f058141f740 10 client.4758 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-17T12:58:56.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f058141f740 20 client.4758 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:56.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f058141f740 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8e670 0x555735f5e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f058141f740 4 client.4758 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:58:56.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 --> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555735bf1270 con 0x555735f8e670 2024-02-17T12:58:56.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.471+0000 7f0577fff640 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8e670 0x555735f5e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.517+0000 7f0577fff640 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8e670 0x555735f5e7f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da2ac59af37ee014 server_cookie=f80140d1548bc196 in_seq=0 out_seq=0 2024-02-17T12:58:56.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.517+0000 7f0556ffd640 10 client.4758 ms_handle_connect on v2:172.21.15.136:6836/4146413895 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f0556ffd640 1 -- 172.21.15.136:0/2635631182 <== mds.2 v2:172.21.15.136:6836/4146413895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555735bf1270 con 0x555735f8e670 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f0556ffd640 10 client.4758 handle_command_reply: tid=0 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 client.4758 shutdown 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 msgr2=0x555735f7d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f7d570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f056c012570 tx=0x7f056c012970 comp rx=0 tx=0).stop 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 shutdown_connections 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8e670 0x555735f5e7f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f7d570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f0556ffd640 0 client.4758 ms_handle_reset on v2:172.21.15.136:6836/4146413895 2024-02-17T12:58:56.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 --2- 172.21.15.136:0/2635631182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 >> 172.21.15.136:0/2635631182 conn(0x555735f38490 msgr2=0x555735f7ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 shutdown_connections 2024-02-17T12:58:56.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 1 -- 172.21.15.136:0/2635631182 wait complete. 2024-02-17T12:58:56.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.626+0000 7f058141f740 20 client.4758 trim_cache size 0 max 16384 2024-02-17T12:58:56.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 Processor -- start 2024-02-17T12:58:56.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 -- start start 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f3a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f38cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f39230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735e26490 con 0x555735f5ef90 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735f32fe0 con 0x555735f39a30 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.642+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555735f37060 con 0x555735f838b0 2024-02-17T12:58:56.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.643+0000 7f05777fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f38cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.643+0000 7f0577fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f3a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.643+0000 7f057cd16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f39230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.643+0000 7f05777fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f38cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39774/0 (socket says 172.21.15.136:39774) 2024-02-17T12:58:56.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.643+0000 7f05777fe640 1 -- 172.21.15.136:0/2042634084 learned_addr learned my addr 172.21.15.136:0/2042634084 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.645+0000 7f05777fe640 1 -- 172.21.15.136:0/2042634084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 msgr2=0x555735f39230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.645+0000 7f05777fe640 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f39230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.645+0000 7f05777fe640 1 -- 172.21.15.136:0/2042634084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 msgr2=0x555735f3a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.645+0000 7f05777fe640 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f3a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.645+0000 7f05777fe640 1 -- 172.21.15.136:0/2042634084 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555735e3ba20 con 0x555735f5ef90 2024-02-17T12:58:56.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.647+0000 7f05777fe640 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f38cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f056c009010 tx=0x7f056c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1e56fd454cb59a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.650+0000 7f055d7fa640 1 -- 172.21.15.136:0/2042634084 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c02c070 con 0x555735f5ef90 2024-02-17T12:58:56.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.650+0000 7f055d7fa640 1 -- 172.21.15.136:0/2042634084 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c012350 con 0x555735f5ef90 2024-02-17T12:58:56.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.650+0000 7f055d7fa640 1 -- 172.21.15.136:0/2042634084 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c007e40 con 0x555735f5ef90 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 -- 172.21.15.136:0/2042634084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 msgr2=0x555735f38cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f38cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f056c009010 tx=0x7f056c00c000 comp rx=0 tx=0).stop 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 -- 172.21.15.136:0/2042634084 shutdown_connections 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f838b0 0x555735f39230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f5ef90 0x555735f38cf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 --2- 172.21.15.136:0/2042634084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f39a30 0x555735f3a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 -- 172.21.15.136:0/2042634084 >> 172.21.15.136:0/2042634084 conn(0x555735f38490 msgr2=0x555735f340f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 -- 172.21.15.136:0/2042634084 shutdown_connections 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.651+0000 7f058141f740 1 -- 172.21.15.136:0/2042634084 wait complete. 2024-02-17T12:58:56.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.652+0000 7f058141f740 1 -- start start 2024-02-17T12:58:56.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.652+0000 7f058141f740 1 Processor -- start 2024-02-17T12:58:56.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f5ef90 0x555735f8f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735fdf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735f7c7a0 con 0x555735f838b0 2024-02-17T12:58:56.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555735fe9130 con 0x555735f5ef90 2024-02-17T12:58:56.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555735f37cc0 con 0x555735f39a30 2024-02-17T12:58:56.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f058141f740 10 client.0 _ll_register_callbacks cb 0x7f056c007bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:56.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.653+0000 7f057cd16640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735fdf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.654+0000 7f057cd16640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735fdf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39790/0 (socket says 172.21.15.136:39790) 2024-02-17T12:58:56.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.654+0000 7f057cd16640 1 -- 172.21.15.136:0/3508439888 learned_addr learned my addr 172.21.15.136:0/3508439888 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.654+0000 7f0577fff640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.655+0000 7f05777fe640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f5ef90 0x555735f8f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.657+0000 7f057cd16640 1 -- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 msgr2=0x555735f7c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.657+0000 7f057cd16640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f7c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.657+0000 7f057cd16640 1 -- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f5ef90 msgr2=0x555735f8f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.657+0000 7f057cd16640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f5ef90 0x555735f8f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.657+0000 7f057cd16640 1 -- 172.21.15.136:0/3508439888 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555735e9f2b0 con 0x555735f838b0 2024-02-17T12:58:56.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.659+0000 7f057cd16640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735fdf050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f05700012e0 tx=0x7f0570001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47723338973a07b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.659+0000 7f0556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-02-17T12:58:56.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.663+0000 7f0556ffd640 1 -- 172.21.15.136:0/3508439888 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570014920 con 0x555735f838b0 2024-02-17T12:58:56.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.663+0000 7f0556ffd640 1 -- 172.21.15.136:0/3508439888 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0570014a80 con 0x555735f838b0 2024-02-17T12:58:56.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.663+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f056804e650 con 0x555735f838b0 2024-02-17T12:58:56.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.665+0000 7f0556ffd640 1 -- 172.21.15.136:0/3508439888 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0570014c40 con 0x555735f838b0 2024-02-17T12:58:56.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.666+0000 7f058141f740 10 client.4764 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:56.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.666+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555735e61780 con 0x555735f838b0 2024-02-17T12:58:56.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.667+0000 7f0556ffd640 1 -- 172.21.15.136:0/3508439888 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056804e650 con 0x555735f838b0 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f0556ffd640 1 -- 172.21.15.136:0/3508439888 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f057002b420 con 0x555735f838b0 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f058141f740 10 client.4764 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f058141f740 10 client.4764 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f058141f740 20 client.4764 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f058141f740 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8a6c0 0x555735f8aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f058141f740 4 client.4764 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:58:56.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.669+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 --> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555735bdd610 con 0x555735f8a6c0 2024-02-17T12:58:56.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.670+0000 7f0577fff640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8a6c0 0x555735f8aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.673+0000 7f0556ffd640 10 client.4764 ms_handle_connect on v2:172.21.15.136:6836/4146413895 2024-02-17T12:58:56.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.673+0000 7f0577fff640 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8a6c0 0x555735f8aaa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e8d5366a689385c server_cookie=5b63b92672935b6 in_seq=0 out_seq=0 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f0556ffd640 1 -- 172.21.15.136:0/3508439888 <== mds.2 v2:172.21.15.136:6836/4146413895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555735bdd610 con 0x555735f8a6c0 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f0556ffd640 10 client.4764 handle_command_reply: tid=0 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 client.4764 shutdown 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 msgr2=0x555735fdf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735fdf050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f05700012e0 tx=0x7f0570001970 comp rx=0 tx=0).stop 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 shutdown_connections 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:6836/4146413895,v1:172.21.15.136:6837/4146413895] conn(0x555735f8a6c0 0x555735f8aaa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555735f838b0 0x555735fdf050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555735f5ef90 0x555735f8f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 --2- 172.21.15.136:0/3508439888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555735f39a30 0x555735f7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f0556ffd640 0 client.4764 ms_handle_reset on v2:172.21.15.136:6836/4146413895 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 >> 172.21.15.136:0/3508439888 conn(0x555735f38490 msgr2=0x555735f5f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 shutdown_connections 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.690+0000 7f058141f740 1 -- 172.21.15.136:0/3508439888 wait complete. 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f058141f740 20 client.4764 trim_cache size 0 max 16384 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "b14cc0e2-9a6d-442e-8d67-bc5380021b88", 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 2, 2024-02-17T12:58:56.682 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4248, 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 25.781825962999999, 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 18, 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 26, 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 26, 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 68.243385473999993 2024-02-17T12:58:56.683 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:56.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f056406b7d0 msgr2=0x7f056406dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f056406b7d0 0x7f056406dc90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0570001530 tx=0x7f0570006cc0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 msgr2=0x7f05781f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05781f3780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05680097d0 tx=0x7f05680046c0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 shutdown_connections 2024-02-17T12:58:56.684 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f056406b7d0 0x7f056406dc90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.685 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0578158460 0x7f05781ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.685 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0578158020 0x7f05780ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.685 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 --2- 172.21.15.136:0/3334567026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057814e4c0 0x7f05781f3780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.685 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 >> 172.21.15.136:0/3334567026 conn(0x7f057806aac0 msgr2=0x7f05780c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.685 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.691+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 shutdown_connections 2024-02-17T12:58:56.685 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.692+0000 7f057e779640 1 -- 172.21.15.136:0/3334567026 wait complete. 2024-02-17T12:58:56.693 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-17T12:58:56.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.805+0000 7f9baaf6c640 1 Processor -- start 2024-02-17T12:58:56.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.805+0000 7f9baaf6c640 1 -- start start 2024-02-17T12:58:56.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9baaf6c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ba40c4e80 0x7f9ba406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9baaf6c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba4150f30 con 0x7f9ba4150b50 2024-02-17T12:58:56.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9baaf6c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40c5f10 con 0x7f9ba406aac0 2024-02-17T12:58:56.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9baaf6c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba40c64d0 con 0x7f9ba40c4e80 2024-02-17T12:58:56.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9b9bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ba40c4e80 0x7f9ba406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9ba9509640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f9ba406aac0 0x7f9ba40c7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:38106/0 (socket says 172.21.15.136:38106) 2024-02-17T12:58:56.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.806+0000 7f9ba9509640 1 -- 172.21.15.136:0/619729809 learned_addr learned my addr 172.21.15.136:0/619729809 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:56.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.809+0000 7f9b9b7fe640 1 -- 172.21.15.136:0/619729809 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473438462 0 0) 0x7f9ba40c5f10 con 0x7f9ba406aac0 2024-02-17T12:58:56.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.809+0000 7f9b9b7fe640 1 -- 172.21.15.136:0/619729809 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8c005730 con 0x7f9ba406aac0 2024-02-17T12:58:56.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.809+0000 7f9b9bfff640 1 -- 172.21.15.136:0/619729809 >> v1:172.21.15.160:6789/0 conn(0x7f9ba406aac0 legacy=0x7f9ba40c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.809+0000 7f9b9bfff640 1 -- 172.21.15.136:0/619729809 >> v1:172.21.15.136:6789/0 conn(0x7f9ba4150b50 legacy=0x7f9ba40c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.809+0000 7f9b9bfff640 1 -- 172.21.15.136:0/619729809 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40c61f0 con 0x7f9ba40c4e80 2024-02-17T12:58:56.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.814+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/619729809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba40c4e80 0x7f9ba406db70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b940097a0 tx=0x7f9b9402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef70a4eddaf93e8a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.818+0000 7f9b9b7fe640 1 -- 172.21.15.136:0/619729809 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94030610 con 0x7f9ba40c4e80 2024-02-17T12:58:56.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.818+0000 7f9b9b7fe640 1 -- 172.21.15.136:0/619729809 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94030770 con 0x7f9ba40c4e80 2024-02-17T12:58:56.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.818+0000 7f9b9b7fe640 1 -- 172.21.15.136:0/619729809 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94030b00 con 0x7f9ba40c4e80 2024-02-17T12:58:56.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 -- 172.21.15.136:0/619729809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba40c4e80 msgr2=0x7f9ba406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/619729809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba40c4e80 0x7f9ba406db70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b940097a0 tx=0x7f9b9402b960 comp rx=0 tx=0).stop 2024-02-17T12:58:56.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 -- 172.21.15.136:0/619729809 shutdown_connections 2024-02-17T12:58:56.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/619729809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba40c4e80 0x7f9ba406db70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 -- 172.21.15.136:0/619729809 >> 172.21.15.136:0/619729809 conn(0x7f9ba40c7e90 msgr2=0x7f9ba40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 -- 172.21.15.136:0/619729809 shutdown_connections 2024-02-17T12:58:56.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.819+0000 7f9baaf6c640 1 -- 172.21.15.136:0/619729809 wait complete. 2024-02-17T12:58:56.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.820+0000 7f9baaf6c640 1 Processor -- start 2024-02-17T12:58:56.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.820+0000 7f9baaf6c640 1 -- start start 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.821+0000 7f9baaf6c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 0x7f9ba41e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.821+0000 7f9baaf6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ba40c4e80 0x7f9ba41e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.821+0000 7f9baaf6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ba4150b50 0x7f9ba4147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.821+0000 7f9baaf6c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41dffa0 con 0x7f9ba406aac0 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.821+0000 7f9baaf6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41e10c0 con 0x7f9ba4150b50 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.821+0000 7f9baaf6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba413fc90 con 0x7f9ba40c4e80 2024-02-17T12:58:56.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.822+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 0x7f9ba41e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.822+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 0x7f9ba41e0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39808/0 (socket says 172.21.15.136:39808) 2024-02-17T12:58:56.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.822+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3758384256 learned_addr learned my addr 172.21.15.136:0/3758384256 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.822+0000 7f9ba9509640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ba4150b50 0x7f9ba4147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.822+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ba40c4e80 0x7f9ba41e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.826+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ba40c4e80 msgr2=0x7f9ba41e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.826+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ba40c4e80 0x7f9ba41e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.826+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ba4150b50 msgr2=0x7f9ba4147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.826+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ba4150b50 0x7f9ba4147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.826+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3758384256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009400 con 0x7f9ba406aac0 2024-02-17T12:58:56.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.828+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 0x7f9ba41e0b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c430 tx=0x7f9ba000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.831+0000 7f9b997fa640 1 -- 172.21.15.136:0/3758384256 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00052d0 con 0x7f9ba406aac0 2024-02-17T12:58:56.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.831+0000 7f9b997fa640 1 -- 172.21.15.136:0/3758384256 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0005450 con 0x7f9ba406aac0 2024-02-17T12:58:56.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.831+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba413ff70 con 0x7f9ba406aac0 2024-02-17T12:58:56.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.831+0000 7f9b997fa640 1 -- 172.21.15.136:0/3758384256 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0007260 con 0x7f9ba406aac0 2024-02-17T12:58:56.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.831+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba41408e0 con 0x7f9ba406aac0 2024-02-17T12:58:56.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.834+0000 7f9badc1b740 1 Processor -- start 2024-02-17T12:58:56.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.834+0000 7f9badc1b740 1 -- start start 2024-02-17T12:58:56.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde41e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 0x5638bde42350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde40490 0x5638bde81290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9badc1b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bddfccd0 con 0x5638bde41a30 2024-02-17T12:58:56.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bddaff20 con 0x5638bde40490 2024-02-17T12:58:56.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638bddad450 con 0x5638bde8b8b0 2024-02-17T12:58:56.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 0x5638bde42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.835+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde40490 0x5638bde81290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.836+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 0x5638bde42350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58646/0 (socket says 172.21.15.136:58646) 2024-02-17T12:58:56.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.836+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3492221593 learned_addr learned my addr 172.21.15.136:0/3492221593 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.838+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde40490 msgr2=0x5638bde81290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.838+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde40490 0x5638bde81290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.838+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3492221593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 msgr2=0x5638bde41e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.838+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde41e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.838+0000 7f9ba8d08640 1 -- 172.21.15.136:0/3492221593 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638bdd5df20 con 0x5638bde8b8b0 2024-02-17T12:58:56.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.840+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 0x5638bde42350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ba41e00e0 tx=0x7f9ba0011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d75580497f601f1d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.843+0000 7f9b8a7fc640 1 -- 172.21.15.136:0/3492221593 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0007480 con 0x5638bde8b8b0 2024-02-17T12:58:56.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9b8a7fc640 1 -- 172.21.15.136:0/3492221593 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0003d40 con 0x5638bde8b8b0 2024-02-17T12:58:56.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9b8a7fc640 1 -- 172.21.15.136:0/3492221593 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00117b0 con 0x5638bde8b8b0 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 -- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 msgr2=0x5638bde42350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 0x5638bde42350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ba41e00e0 tx=0x7f9ba0011000 comp rx=0 tx=0).stop 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 -- 172.21.15.136:0/3492221593 shutdown_connections 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde40490 0x5638bde81290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde8b8b0 0x5638bde42350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3492221593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde41e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 -- 172.21.15.136:0/3492221593 >> 172.21.15.136:0/3492221593 conn(0x5638bde3e1a0 msgr2=0x5638bde40ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:56.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 -- 172.21.15.136:0/3492221593 shutdown_connections 2024-02-17T12:58:56.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.844+0000 7f9badc1b740 1 -- 172.21.15.136:0/3492221593 wait complete. 2024-02-17T12:58:56.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.845+0000 7f9badc1b740 1 -- start start 2024-02-17T12:58:56.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.845+0000 7f9badc1b740 1 Processor -- start 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde60970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde8b8b0 0x5638bde923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 0x5638bde5d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bdda8c30 con 0x5638bde8b8b0 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bdd4dd30 con 0x5638bde64c50 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638bda7c310 con 0x5638bde41a30 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9badc1b740 10 client.0 _ll_register_callbacks cb 0x5638bdd55d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:56.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.846+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 0x5638bde5d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.847+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 0x5638bde5d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:48846/0 (socket says 172.21.15.136:48846) 2024-02-17T12:58:56.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.847+0000 7f9b9bfff640 1 -- 172.21.15.136:0/3577664676 learned_addr learned my addr 172.21.15.136:0/3577664676 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:56.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.848+0000 7f9ba9509640 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde60970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.850+0000 7f9b9bfff640 1 -- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 msgr2=0x5638bde60970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.850+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde60970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.850+0000 7f9b9bfff640 1 -- 172.21.15.136:0/3577664676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde8b8b0 msgr2=0x5638bde923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:56.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.850+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde8b8b0 0x5638bde923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:56.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.850+0000 7f9b9bfff640 1 -- 172.21.15.136:0/3577664676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba41408e0 con 0x5638bde64c50 2024-02-17T12:58:56.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.852+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 0x5638bde5d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402bf70 tx=0x7f9b94004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d06051dd05bf271d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.852+0000 7f9b837fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-02-17T12:58:56.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.855+0000 7f9b837fe640 1 -- 172.21.15.136:0/3577664676 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9403e040 con 0x5638bde64c50 2024-02-17T12:58:56.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.855+0000 7f9b837fe640 1 -- 172.21.15.136:0/3577664676 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f9b94039860 con 0x5638bde64c50 2024-02-17T12:58:56.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.855+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638bdaa86c0 con 0x5638bde64c50 2024-02-17T12:58:56.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.856+0000 7f9b997fa640 1 -- 172.21.15.136:0/3758384256 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9ba0011590 con 0x7f9ba406aac0 2024-02-17T12:58:56.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.857+0000 7f9b997fa640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9b9006b7d0 0x7f9b9006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.857+0000 7f9ba9509640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9b9006b7d0 0x7f9b9006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.857+0000 7f9ba9509640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9b9006b7d0 0x7f9b9006dc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c001530 tx=0x7f9b9c006cc0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:56.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.860+0000 7f9b997fa640 1 -- 172.21.15.136:0/3758384256 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f9ba005a8e0 con 0x7f9ba406aac0 2024-02-17T12:58:56.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.918+0000 7f9b837fe640 1 -- 172.21.15.136:0/3577664676 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b94039a20 con 0x5638bde64c50 2024-02-17T12:58:56.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.918+0000 7f9badc1b740 10 client.4807 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:56.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.918+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5638bdda72b0 con 0x5638bde64c50 2024-02-17T12:58:56.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9b837fe640 1 -- 172.21.15.136:0/3577664676 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5638bdaa86c0 con 0x5638bde64c50 2024-02-17T12:58:56.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9b837fe640 1 -- 172.21.15.136:0/3577664676 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9b94039b80 con 0x5638bde64c50 2024-02-17T12:58:56.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9badc1b740 10 client.4807 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:56.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9badc1b740 10 client.4807 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T12:58:56.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9badc1b740 20 client.4807 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:56.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bdea1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:56.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9badc1b740 4 client.4807 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:58:56.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.925+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 --> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638bdaf9270 con 0x5638bde9ef10 2024-02-17T12:58:56.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.926+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bdea1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:56.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.972+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bdea1300 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84811fc7e09899a0 server_cookie=4f9725fe5a238f4e in_seq=0 out_seq=0 2024-02-17T12:58:56.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:56.972+0000 7f9b837fe640 10 client.4807 ms_handle_connect on v2:172.21.15.160:6832/2957750090 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9b837fe640 1 -- 172.21.15.136:0/3577664676 <== mds.1 v2:172.21.15.160:6832/2957750090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5638bdaf9270 con 0x5638bde9ef10 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9b837fe640 10 client.4807 handle_command_reply: tid=0 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 client.4807 shutdown 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 msgr2=0x5638bde5d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 0x5638bde5d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402bf70 tx=0x7f9b94004730 comp rx=0 tx=0).stop 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 shutdown_connections 2024-02-17T12:58:57.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bdea1300 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde64c50 0x5638bde5d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9b837fe640 0 client.4807 ms_handle_reset on v2:172.21.15.160:6832/2957750090 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde8b8b0 0x5638bde923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 --2- 172.21.15.136:0/3577664676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde60970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 >> 172.21.15.136:0/3577664676 conn(0x5638bde40490 msgr2=0x5638bde3af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 shutdown_connections 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 1 -- 172.21.15.136:0/3577664676 wait complete. 2024-02-17T12:58:57.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.099+0000 7f9badc1b740 20 client.4807 trim_cache size 0 max 16384 2024-02-17T12:58:57.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.114+0000 7f9badc1b740 1 Processor -- start 2024-02-17T12:58:57.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.114+0000 7f9badc1b740 1 -- start start 2024-02-17T12:58:57.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde9c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde64c50 0x5638bde60780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bde60cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9badc1b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bdd2e490 con 0x5638bde41a30 2024-02-17T12:58:57.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bdda1c50 con 0x5638bde8b8b0 2024-02-17T12:58:57.105 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638bde5dc90 con 0x5638bde64c50 2024-02-17T12:58:57.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde9c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.115+0000 7f9ba9509640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bde60cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.116+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde64c50 0x5638bde60780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.116+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde9c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39826/0 (socket says 172.21.15.136:39826) 2024-02-17T12:58:57.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.116+0000 7f9ba8d08640 1 -- 172.21.15.136:0/475284868 learned_addr learned my addr 172.21.15.136:0/475284868 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.118+0000 7f9b9bfff640 1 -- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 msgr2=0x5638bde60cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.118+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bde60cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.118+0000 7f9b9bfff640 1 -- 172.21.15.136:0/475284868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 msgr2=0x5638bde9c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.118+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde9c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.109 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.118+0000 7f9b9bfff640 1 -- 172.21.15.136:0/475284868 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638bdd43a20 con 0x5638bde64c50 2024-02-17T12:58:57.110 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.120+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde64c50 0x5638bde60780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9b94000c00 tx=0x7f9b94042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e6a72454356912 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9b89ffb640 1 -- 172.21.15.136:0/475284868 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9403e070 con 0x5638bde64c50 2024-02-17T12:58:57.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9b89ffb640 1 -- 172.21.15.136:0/475284868 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94030c40 con 0x5638bde64c50 2024-02-17T12:58:57.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9b89ffb640 1 -- 172.21.15.136:0/475284868 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94004230 con 0x5638bde64c50 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 -- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde64c50 msgr2=0x5638bde60780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde64c50 0x5638bde60780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9b94000c00 tx=0x7f9b94042000 comp rx=0 tx=0).stop 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 -- 172.21.15.136:0/475284868 shutdown_connections 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bde60cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde64c50 0x5638bde60780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 --2- 172.21.15.136:0/475284868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde41a30 0x5638bde9c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 -- 172.21.15.136:0/475284868 >> 172.21.15.136:0/475284868 conn(0x5638bde40490 msgr2=0x5638bde41e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 -- 172.21.15.136:0/475284868 shutdown_connections 2024-02-17T12:58:57.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.124+0000 7f9badc1b740 1 -- 172.21.15.136:0/475284868 wait complete. 2024-02-17T12:58:57.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.125+0000 7f9badc1b740 1 -- start start 2024-02-17T12:58:57.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.125+0000 7f9badc1b740 1 Processor -- start 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde9ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde64c50 0x5638bdee72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bdee77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bde9bf70 con 0x5638bde64c50 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bdef12d0 con 0x5638bde8b8b0 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638bde3d390 con 0x5638bde41a30 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9badc1b740 10 client.0 _ll_register_callbacks cb 0x7f9ba001e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.126+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde9ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.127+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde64c50 0x5638bdee72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.127+0000 7f9ba9509640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bdee77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.127+0000 7f9ba8d08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde9ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58664/0 (socket says 172.21.15.136:58664) 2024-02-17T12:58:57.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.127+0000 7f9ba8d08640 1 -- 172.21.15.136:0/614034096 learned_addr learned my addr 172.21.15.136:0/614034096 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.130+0000 7f9ba8d08640 1 -- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 msgr2=0x5638bdee77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.130+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bdee77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.130+0000 7f9ba8d08640 1 -- 172.21.15.136:0/614034096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde64c50 msgr2=0x5638bdee72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.130+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde64c50 0x5638bdee72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.130+0000 7f9ba8d08640 1 -- 172.21.15.136:0/614034096 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638bdda72b0 con 0x5638bde41a30 2024-02-17T12:58:57.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.132+0000 7f9ba8d08640 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde9ba30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ba005aaa0 tx=0x7f9ba0029040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ce3ad903bbb945 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.132+0000 7f9b837fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3301/0 2024-02-17T12:58:57.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.135+0000 7f9b837fe640 1 -- 172.21.15.136:0/614034096 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0086070 con 0x5638bde41a30 2024-02-17T12:58:57.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.135+0000 7f9b837fe640 1 -- 172.21.15.136:0/614034096 <== mon.2 v2:172.21.15.160:3301/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f9ba00073c0 con 0x5638bde41a30 2024-02-17T12:58:57.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.135+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ba0003d40 con 0x5638bde41a30 2024-02-17T12:58:57.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.137+0000 7f9b837fe640 1 -- 172.21.15.136:0/614034096 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba0058980 con 0x5638bde41a30 2024-02-17T12:58:57.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.137+0000 7f9badc1b740 10 client.4709 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:57.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.137+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5638bdd69780 con 0x5638bde41a30 2024-02-17T12:58:57.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9b837fe640 1 -- 172.21.15.136:0/614034096 <== mon.2 v2:172.21.15.160:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0003d40 con 0x5638bde41a30 2024-02-17T12:58:57.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9b837fe640 1 -- 172.21.15.136:0/614034096 <== mon.2 v2:172.21.15.160:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9ba0056f50 con 0x5638bde41a30 2024-02-17T12:58:57.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9badc1b740 10 client.4709 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:57.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9badc1b740 10 client.4709 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T12:58:57.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9badc1b740 20 client.4709 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:57.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9badc1b740 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bde7e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9badc1b740 4 client.4709 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:58:57.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.142+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 --> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5638bdae5610 con 0x5638bde9ef10 2024-02-17T12:58:57.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.143+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bde7e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.145+0000 7f9b9bfff640 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bde7e710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ce011c981dfa004 server_cookie=1b269e7e9c452b37 in_seq=0 out_seq=0 2024-02-17T12:58:57.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.145+0000 7f9b837fe640 10 client.4709 ms_handle_connect on v2:172.21.15.160:6832/2957750090 2024-02-17T12:58:57.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.162+0000 7f9b837fe640 1 -- 172.21.15.136:0/614034096 <== mds.1 v2:172.21.15.160:6832/2957750090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5638bdae5610 con 0x5638bde9ef10 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.162+0000 7f9b837fe640 10 client.4709 handle_command_reply: tid=0 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.162+0000 7f9badc1b740 1 client.4709 shutdown 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 msgr2=0x5638bde9ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde9ba30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ba005aaa0 tx=0x7f9ba0029040 comp rx=0 tx=0).stop 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 shutdown_connections 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:6832/2957750090,v1:172.21.15.160:6833/2957750090] conn(0x5638bde9ef10 0x5638bde7e710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638bde8b8b0 0x5638bdee77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9b837fe640 0 client.4709 ms_handle_reset on v2:172.21.15.160:6832/2957750090 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5638bde64c50 0x5638bdee72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 --2- 172.21.15.136:0/614034096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5638bde41a30 0x5638bde9ba30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 >> 172.21.15.136:0/614034096 conn(0x5638bde40490 msgr2=0x5638bde3af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 shutdown_connections 2024-02-17T12:58:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 1 -- 172.21.15.136:0/614034096 wait complete. 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9badc1b740 20 client.4709 trim_cache size 0 max 16384 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "b14cc0e2-9a6d-442e-8d67-bc5380021b88", 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 1, 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4288, 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 28.434285132999999, 2024-02-17T12:58:57.155 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 18, 2024-02-17T12:58:57.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 26, 2024-02-17T12:58:57.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 26, 2024-02-17T12:58:57.156 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 68.794079838000002 2024-02-17T12:58:57.156 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9b9006b7d0 msgr2=0x7f9b9006dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9b9006b7d0 0x7f9b9006dc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c001530 tx=0x7f9b9c006cc0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 msgr2=0x7f9ba41e0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 0x7f9ba41e0b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c430 tx=0x7f9ba000c8f0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 shutdown_connections 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9b9006b7d0 0x7f9b9006dc90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ba4150b50 0x7f9ba4147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ba40c4e80 0x7f9ba41e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 --2- 172.21.15.136:0/3758384256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ba406aac0 0x7f9ba41e0b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 >> 172.21.15.136:0/3758384256 conn(0x7f9ba40c7e90 msgr2=0x7f9ba406b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.163+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 shutdown_connections 2024-02-17T12:58:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.164+0000 7f9baaf6c640 1 -- 172.21.15.136:0/3758384256 wait complete. 2024-02-17T12:58:57.165 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-17T12:58:57.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.276+0000 7f335b0d4640 1 Processor -- start 2024-02-17T12:58:57.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.276+0000 7f335b0d4640 1 -- start start 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.277+0000 7f335b0d4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f33541572b0 0x7f335406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.277+0000 7f335b0d4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540c8b60 con 0x7f3354157690 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.277+0000 7f335b0d4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335415a030 con 0x7f33540c9730 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.277+0000 7f335b0d4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3354159e40 con 0x7f33541572b0 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.278+0000 7f3353fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3354157690 0x7f33540c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:39388/0 (socket says 172.21.15.136:39388) 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.278+0000 7f3353fff640 1 -- 172.21.15.136:0/4111061228 learned_addr learned my addr 172.21.15.136:0/4111061228 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T12:58:57.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.278+0000 7f3358e70640 1 --2- 172.21.15.136:0/4111061228 >> v2:172.21.15.160:3300/0 conn(0x7f33541572b0 0x7f335406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.280+0000 7f33537fe640 1 -- 172.21.15.136:0/4111061228 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955696657 0 0) 0x7f33540c8b60 con 0x7f3354157690 2024-02-17T12:58:57.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.280+0000 7f33537fe640 1 -- 172.21.15.136:0/4111061228 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f333c003520 con 0x7f3354157690 2024-02-17T12:58:57.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.282+0000 7f3358e70640 1 -- 172.21.15.136:0/4111061228 >> v1:172.21.15.160:6789/0 conn(0x7f33540c9730 legacy=0x7f33540cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.282+0000 7f3358e70640 1 -- 172.21.15.136:0/4111061228 >> v1:172.21.15.136:6789/0 conn(0x7f3354157690 legacy=0x7f33540c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.282+0000 7f3358e70640 1 -- 172.21.15.136:0/4111061228 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335415a310 con 0x7f33541572b0 2024-02-17T12:58:57.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.286+0000 7f3358e70640 1 --2- 172.21.15.136:0/4111061228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f335406afe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33440097a0 tx=0x7f334402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ca4832fd6ca345 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.290+0000 7f33537fe640 1 -- 172.21.15.136:0/4111061228 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344030610 con 0x7f33541572b0 2024-02-17T12:58:57.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.290+0000 7f33537fe640 1 -- 172.21.15.136:0/4111061228 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344030770 con 0x7f33541572b0 2024-02-17T12:58:57.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.290+0000 7f33537fe640 1 -- 172.21.15.136:0/4111061228 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344030b00 con 0x7f33541572b0 2024-02-17T12:58:57.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 -- 172.21.15.136:0/4111061228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 msgr2=0x7f335406afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 --2- 172.21.15.136:0/4111061228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f335406afe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33440097a0 tx=0x7f334402b960 comp rx=0 tx=0).stop 2024-02-17T12:58:57.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 -- 172.21.15.136:0/4111061228 shutdown_connections 2024-02-17T12:58:57.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 --2- 172.21.15.136:0/4111061228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f335406afe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 -- 172.21.15.136:0/4111061228 >> 172.21.15.136:0/4111061228 conn(0x7f335406bbd0 msgr2=0x7f335406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 -- 172.21.15.136:0/4111061228 shutdown_connections 2024-02-17T12:58:57.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.291+0000 7f335b0d4640 1 -- 172.21.15.136:0/4111061228 wait complete. 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.292+0000 7f335b0d4640 1 Processor -- start 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.292+0000 7f335b0d4640 1 -- start start 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f335b0d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33540c9730 0x7f33541f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f335b0d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f33540c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f335b0d4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 0x7f335414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f335b0d4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33541517a0 con 0x7f3354157690 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f335b0d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3354151a80 con 0x7f33541572b0 2024-02-17T12:58:57.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f335b0d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3354151d60 con 0x7f33540c9730 2024-02-17T12:58:57.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f3359671640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 0x7f335414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f3353fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f33540c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.293+0000 7f3358e70640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33540c9730 0x7f33541f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.294+0000 7f3359671640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 0x7f335414cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39832/0 (socket says 172.21.15.136:39832) 2024-02-17T12:58:57.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.294+0000 7f3359671640 1 -- 172.21.15.136:0/1609676742 learned_addr learned my addr 172.21.15.136:0/1609676742 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.297+0000 7f3359671640 1 -- 172.21.15.136:0/1609676742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33540c9730 msgr2=0x7f33541f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.297+0000 7f3359671640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33540c9730 0x7f33541f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.297+0000 7f3359671640 1 -- 172.21.15.136:0/1609676742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 msgr2=0x7f33540c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.297+0000 7f3359671640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f33540c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.297+0000 7f3359671640 1 -- 172.21.15.136:0/1609676742 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344009400 con 0x7f3354157690 2024-02-17T12:58:57.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.299+0000 7f3359671640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 0x7f335414cfa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f334c00c730 tx=0x7f334c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.302+0000 7f33517fa640 1 -- 172.21.15.136:0/1609676742 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c003b70 con 0x7f3354157690 2024-02-17T12:58:57.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.303+0000 7f33517fa640 1 -- 172.21.15.136:0/1609676742 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c003cd0 con 0x7f3354157690 2024-02-17T12:58:57.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.303+0000 7f33517fa640 1 -- 172.21.15.136:0/1609676742 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00aa90 con 0x7f3354157690 2024-02-17T12:58:57.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.303+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33541ef9f0 con 0x7f3354157690 2024-02-17T12:58:57.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.303+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33541548c0 con 0x7f3354157690 2024-02-17T12:58:57.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.305+0000 7f335dd86740 1 Processor -- start 2024-02-17T12:58:57.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.305+0000 7f335dd86740 1 -- start start 2024-02-17T12:58:57.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.306+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6ae6a30 0x55c6d6ae6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.306+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6ae7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.306+0000 7f335dd86740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae5490 0x55c6d6b26290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.306+0000 7f335dd86740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6aa1cd0 con 0x55c6d6ae5490 2024-02-17T12:58:57.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.306+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6a54f20 con 0x55c6d6ae6a30 2024-02-17T12:58:57.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.306+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6a52450 con 0x55c6d6b308b0 2024-02-17T12:58:57.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.307+0000 7f3358e70640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6ae7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.307+0000 7f3353fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6ae6a30 0x55c6d6ae6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.307+0000 7f3358e70640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6ae7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58676/0 (socket says 172.21.15.136:58676) 2024-02-17T12:58:57.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.307+0000 7f3358e70640 1 -- 172.21.15.136:0/2193202384 learned_addr learned my addr 172.21.15.136:0/2193202384 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.309+0000 7f3358e70640 1 -- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6ae6a30 msgr2=0x55c6d6ae6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.309+0000 7f3358e70640 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6ae6a30 0x55c6d6ae6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.309+0000 7f3358e70640 1 -- 172.21.15.136:0/2193202384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae5490 msgr2=0x55c6d6b26290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.309+0000 7f3358e70640 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae5490 0x55c6d6b26290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.309+0000 7f3358e70640 1 -- 172.21.15.136:0/2193202384 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6d6a02f20 con 0x55c6d6b308b0 2024-02-17T12:58:57.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.311+0000 7f3358e70640 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6ae7350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33440097a0 tx=0x7f3344030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7132540d7990f0c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f333a7fc640 1 -- 172.21.15.136:0/2193202384 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334403e040 con 0x55c6d6b308b0 2024-02-17T12:58:57.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f333a7fc640 1 -- 172.21.15.136:0/2193202384 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344030b00 con 0x55c6d6b308b0 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f333a7fc640 1 -- 172.21.15.136:0/2193202384 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344045480 con 0x55c6d6b308b0 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 -- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 msgr2=0x55c6d6ae7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6ae7350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33440097a0 tx=0x7f3344030000 comp rx=0 tx=0).stop 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 -- 172.21.15.136:0/2193202384 shutdown_connections 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae5490 0x55c6d6b26290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6ae7350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 --2- 172.21.15.136:0/2193202384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6ae6a30 0x55c6d6ae6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 -- 172.21.15.136:0/2193202384 >> 172.21.15.136:0/2193202384 conn(0x55c6d6ae31a0 msgr2=0x55c6d6ae5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 -- 172.21.15.136:0/2193202384 shutdown_connections 2024-02-17T12:58:57.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.315+0000 7f335dd86740 1 -- 172.21.15.136:0/2193202384 wait complete. 2024-02-17T12:58:57.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.316+0000 7f335dd86740 1 -- start start 2024-02-17T12:58:57.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.316+0000 7f335dd86740 1 Processor -- start 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6ae6a30 0x55c6d6b28c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 0x55c6d6b2afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b0b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6a4dc30 con 0x55c6d6b0bf90 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d69f2d30 con 0x55c6d6b308b0 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6721310 con 0x55c6d6ae6a30 2024-02-17T12:58:57.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.317+0000 7f335dd86740 10 client.0 _ll_register_callbacks cb 0x55c6d69fad40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:57.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.318+0000 7f3358e70640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 0x55c6d6b2afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.318+0000 7f3353fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6ae6a30 0x55c6d6b28c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.318+0000 7f3358e70640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 0x55c6d6b2afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:48896/0 (socket says 172.21.15.136:48896) 2024-02-17T12:58:57.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.318+0000 7f3358e70640 1 -- 172.21.15.136:0/1052319271 learned_addr learned my addr 172.21.15.136:0/1052319271 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.321+0000 7f3358e70640 1 -- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6ae6a30 msgr2=0x55c6d6b28c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.321+0000 7f3358e70640 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6ae6a30 0x55c6d6b28c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.321+0000 7f3358e70640 1 -- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6b0bf90 msgr2=0x55c6d6b0b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.321+0000 7f3358e70640 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b0b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.321+0000 7f3358e70640 1 -- 172.21.15.136:0/1052319271 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335415a310 con 0x55c6d6b308b0 2024-02-17T12:58:57.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.322+0000 7f33517fa640 1 -- 172.21.15.136:0/1609676742 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f334c00abf0 con 0x7f3354157690 2024-02-17T12:58:57.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.322+0000 7f33517fa640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f334006b800 0x7f334006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.322+0000 7f3353fff640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f334006b800 0x7f334006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.323+0000 7f3353fff640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f334006b800 0x7f334006dcc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55c6d6b2ad30 tx=0x7f33480014b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.323+0000 7f3358e70640 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 0x55c6d6b2afb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f33440098c0 tx=0x7f3344004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c105eb97d34ac8f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.323+0000 7f33337fe640 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-02-17T12:58:57.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.325+0000 7f33517fa640 1 -- 172.21.15.136:0/1609676742 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f334c00ce40 con 0x7f3354157690 2024-02-17T12:58:57.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.327+0000 7f33337fe640 1 -- 172.21.15.136:0/1052319271 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334403e040 con 0x55c6d6b308b0 2024-02-17T12:58:57.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.327+0000 7f33337fe640 1 -- 172.21.15.136:0/1052319271 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f3344003a20 con 0x55c6d6b308b0 2024-02-17T12:58:57.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.327+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6d674d6c0 con 0x55c6d6b308b0 2024-02-17T12:58:57.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.328+0000 7f33337fe640 1 -- 172.21.15.136:0/1052319271 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33440309a0 con 0x55c6d6b308b0 2024-02-17T12:58:57.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.328+0000 7f335dd86740 10 client.4828 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:57.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.328+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55c6d6a4c2b0 con 0x55c6d6b308b0 2024-02-17T12:58:57.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.332+0000 7f33337fe640 1 -- 172.21.15.136:0/1052319271 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6d674d6c0 con 0x55c6d6b308b0 2024-02-17T12:58:57.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.332+0000 7f33337fe640 1 -- 172.21.15.136:0/1052319271 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f3344041030 con 0x55c6d6b308b0 2024-02-17T12:58:57.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.332+0000 7f335dd86740 10 client.4828 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:57.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.332+0000 7f335dd86740 10 client.4828 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-17T12:58:57.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.332+0000 7f335dd86740 20 client.4828 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:57.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.333+0000 7f335dd86740 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b31910 0x55c6d6b45f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.333+0000 7f335dd86740 4 client.4828 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:58:57.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.333+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 --> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6d679e270 con 0x55c6d6b31910 2024-02-17T12:58:57.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.333+0000 7f3353fff640 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b31910 0x55c6d6b45f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.336+0000 7f3353fff640 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b31910 0x55c6d6b45f30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e8cdc9f49a87a7 server_cookie=703d4c754fd9f5d7 in_seq=0 out_seq=0 2024-02-17T12:58:57.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.336+0000 7f33337fe640 10 client.4828 ms_handle_connect on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f33337fe640 1 -- 172.21.15.136:0/1052319271 <== mds.0 v2:172.21.15.136:6838/2320874090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c6d679e270 con 0x55c6d6b31910 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f33337fe640 10 client.4828 handle_command_reply: tid=0 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 client.4828 shutdown 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 msgr2=0x55c6d6b2afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 0x55c6d6b2afb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f33440098c0 tx=0x7f3344004730 comp rx=0 tx=0).stop 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 shutdown_connections 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b31910 0x55c6d6b45f30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b0b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b308b0 0x55c6d6b2afb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 --2- 172.21.15.136:0/1052319271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6ae6a30 0x55c6d6b28c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f33337fe640 0 client.4828 ms_handle_reset on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:57.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 >> 172.21.15.136:0/1052319271 conn(0x55c6d6ae5490 msgr2=0x55c6d6b27c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 shutdown_connections 2024-02-17T12:58:57.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 1 -- 172.21.15.136:0/1052319271 wait complete. 2024-02-17T12:58:57.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.354+0000 7f335dd86740 20 client.4828 trim_cache size 0 max 16384 2024-02-17T12:58:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 Processor -- start 2024-02-17T12:58:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 -- start start 2024-02-17T12:58:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6adff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b27c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b28160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d69d3490 con 0x55c6d6ae6a30 2024-02-17T12:58:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6ae8390 con 0x55c6d6b0bf90 2024-02-17T12:58:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.370+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6b3f500 con 0x55c6d6b308b0 2024-02-17T12:58:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.371+0000 7f3358e70640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6adff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.371+0000 7f3359671640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b28160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.371+0000 7f3353fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b27c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.371+0000 7f3359671640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b28160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58686/0 (socket says 172.21.15.136:58686) 2024-02-17T12:58:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.371+0000 7f3359671640 1 -- 172.21.15.136:0/2180876143 learned_addr learned my addr 172.21.15.136:0/2180876143 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.373+0000 7f3358e70640 1 -- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 msgr2=0x55c6d6b28160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.373+0000 7f3358e70640 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b28160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.373+0000 7f3358e70640 1 -- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 msgr2=0x55c6d6b27c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.373+0000 7f3358e70640 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b27c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.373+0000 7f3358e70640 1 -- 172.21.15.136:0/2180876143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6d69e8a20 con 0x55c6d6ae6a30 2024-02-17T12:58:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.373+0000 7f3359671640 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b28160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:58:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.375+0000 7f3358e70640 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6adff40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f334402b9a0 tx=0x7f334404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ca93ea8e417e40 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.379+0000 7f3339ffb640 1 -- 172.21.15.136:0/2180876143 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334403e040 con 0x55c6d6ae6a30 2024-02-17T12:58:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.379+0000 7f3339ffb640 1 -- 172.21.15.136:0/2180876143 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344030590 con 0x55c6d6ae6a30 2024-02-17T12:58:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.379+0000 7f3339ffb640 1 -- 172.21.15.136:0/2180876143 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33440309a0 con 0x55c6d6ae6a30 2024-02-17T12:58:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 -- 172.21.15.136:0/2180876143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 msgr2=0x55c6d6adff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6adff40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f334402b9a0 tx=0x7f334404b000 comp rx=0 tx=0).stop 2024-02-17T12:58:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 -- 172.21.15.136:0/2180876143 shutdown_connections 2024-02-17T12:58:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b28160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b27c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 --2- 172.21.15.136:0/2180876143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6adff40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 -- 172.21.15.136:0/2180876143 >> 172.21.15.136:0/2180876143 conn(0x55c6d6ae5490 msgr2=0x55c6d6ae1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 -- 172.21.15.136:0/2180876143 shutdown_connections 2024-02-17T12:58:57.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 -- 172.21.15.136:0/2180876143 wait complete. 2024-02-17T12:58:57.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.380+0000 7f335dd86740 1 -- start start 2024-02-17T12:58:57.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 Processor -- start 2024-02-17T12:58:57.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6b2f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b34200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b34740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6b0ad50 con 0x55c6d6ae6a30 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6b2f760 con 0x55c6d6b0bf90 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6d6b2fed0 con 0x55c6d6b308b0 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.381+0000 7f335dd86740 10 client.0 _ll_register_callbacks cb 0x7f3344009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.382+0000 7f3358e70640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6b2f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.382+0000 7f3359671640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b34740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.382+0000 7f3353fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b34200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.382+0000 7f3359671640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b34740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:58688/0 (socket says 172.21.15.136:58688) 2024-02-17T12:58:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.382+0000 7f3359671640 1 -- 172.21.15.136:0/2931092970 learned_addr learned my addr 172.21.15.136:0/2931092970 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.385+0000 7f3358e70640 1 -- 172.21.15.136:0/2931092970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 msgr2=0x55c6d6b34740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.385+0000 7f3358e70640 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b34740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.385+0000 7f3358e70640 1 -- 172.21.15.136:0/2931092970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 msgr2=0x55c6d6b34200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.385+0000 7f3358e70640 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b34200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.385+0000 7f3358e70640 1 -- 172.21.15.136:0/2931092970 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33541548c0 con 0x55c6d6ae6a30 2024-02-17T12:58:57.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.387+0000 7f3358e70640 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6b2f220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3344001000 tx=0x7f3344008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b3cb7c9d1c3d9f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.387+0000 7f33337fe640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-02-17T12:58:57.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.390+0000 7f33337fe640 1 -- 172.21.15.136:0/2931092970 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334403e040 con 0x55c6d6ae6a30 2024-02-17T12:58:57.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.390+0000 7f33337fe640 1 -- 172.21.15.136:0/2931092970 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f3344000e40 con 0x55c6d6ae6a30 2024-02-17T12:58:57.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.390+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6d6b30400 con 0x55c6d6ae6a30 2024-02-17T12:58:57.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.392+0000 7f33337fe640 1 -- 172.21.15.136:0/2931092970 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33440309a0 con 0x55c6d6ae6a30 2024-02-17T12:58:57.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.392+0000 7f335dd86740 10 client.4791 fetch_fsmap learned FSMap version 18 2024-02-17T12:58:57.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.392+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55c6d6a4c2b0 con 0x55c6d6ae6a30 2024-02-17T12:58:57.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.394+0000 7f33337fe640 1 -- 172.21.15.136:0/2931092970 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6d6b30400 con 0x55c6d6ae6a30 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f33337fe640 1 -- 172.21.15.136:0/2931092970 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f3344041070 con 0x55c6d6ae6a30 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f335dd86740 10 client.4791 fetch_fsmap finished waiting for FSMap version 18 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f335dd86740 10 client.4791 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f335dd86740 20 client.4791 populate_metadata read hostname 'smithi136' 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f335dd86740 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b8cd80 0x55c6d6b0ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f335dd86740 4 client.4791 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.396+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 --> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f3344030b00 con 0x55c6d6b8cd80 2024-02-17T12:58:57.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.397+0000 7f3353fff640 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b8cd80 0x55c6d6b0ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.400+0000 7f3353fff640 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b8cd80 0x55c6d6b0ccf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e8d101784030e48 server_cookie=11ed7a4634377e46 in_seq=0 out_seq=0 2024-02-17T12:58:57.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.400+0000 7f33337fe640 10 client.4791 ms_handle_connect on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f33337fe640 1 -- 172.21.15.136:0/2931092970 <== mds.0 v2:172.21.15.136:6838/2320874090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f3344030b00 con 0x55c6d6b8cd80 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f33337fe640 10 client.4791 handle_command_reply: tid=0 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 client.4791 shutdown 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 msgr2=0x55c6d6b2f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6b2f220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3344001000 tx=0x7f3344008030 comp rx=0 tx=0).stop 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 shutdown_connections 2024-02-17T12:58:57.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:6838/2320874090,v1:172.21.15.136:6839/2320874090] conn(0x55c6d6b8cd80 0x55c6d6b0ccf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c6d6b308b0 0x55c6d6b34740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c6d6b0bf90 0x55c6d6b34200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f33337fe640 0 client.4791 ms_handle_reset on v2:172.21.15.136:6838/2320874090 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 --2- 172.21.15.136:0/2931092970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c6d6ae6a30 0x55c6d6b2f220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 >> 172.21.15.136:0/2931092970 conn(0x55c6d6ae5490 msgr2=0x55c6d6b2ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 shutdown_connections 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.403+0000 7f335dd86740 1 -- 172.21.15.136:0/2931092970 wait complete. 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335dd86740 20 client.4791 trim_cache size 0 max 16384 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "b14cc0e2-9a6d-442e-8d67-bc5380021b88", 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2024-02-17T12:58:57.395 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4297, 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 59.602455935000002, 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 18, 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 26, 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 26, 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 68.899715572999995 2024-02-17T12:58:57.396 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:58:57.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f334006b800 msgr2=0x7f334006dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f334006b800 0x7f334006dcc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55c6d6b2ad30 tx=0x7f33480014b0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 msgr2=0x7f335414cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 0x7f335414cfa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f334c00c730 tx=0x7f334c00cbf0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 shutdown_connections 2024-02-17T12:58:57.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f334006b800 0x7f334006dcc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3354157690 0x7f335414cfa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33541572b0 0x7f33540c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 --2- 172.21.15.136:0/1609676742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33540c9730 0x7f33541f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 >> 172.21.15.136:0/1609676742 conn(0x7f335406bbd0 msgr2=0x7f33541587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 shutdown_connections 2024-02-17T12:58:57.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.404+0000 7f335b0d4640 1 -- 172.21.15.136:0/1609676742 wait complete. 2024-02-17T12:58:57.406 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-17T12:58:57.419 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-17T12:58:57.419 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-02-17T12:58:57.419 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-02-17T12:58:57.419 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T12:58:57.419 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:58:57.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:57.420 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-02-17T12:58:57.437 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-02-17T12:58:57.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:57.438 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T12:58:57.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:57.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-02-17T12:58:57.601 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-17T12:58:57.601 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:58:57.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.712+0000 7fc9fb3e9640 1 Processor -- start 2024-02-17T12:58:57.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.712+0000 7fc9fb3e9640 1 -- start start 2024-02-17T12:58:57.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.713+0000 7fc9fb3e9640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc9f4150b50 0x7fc9f406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.713+0000 7fc9fb3e9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f40c4e80 0x7fc9f40c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.713+0000 7fc9fb3e9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc9f406aac0 0x7fc9f40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.713+0000 7fc9fb3e9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f40c64d0 con 0x7fc9f406aac0 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.713+0000 7fc9fb3e9640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f40c2dd0 con 0x7fc9f4150b50 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.713+0000 7fc9fb3e9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4150f30 con 0x7fc9f40c4e80 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.714+0000 7fc9f9986640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc9f406aac0 0x7fc9f40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.714+0000 7fc9f8984640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f40c4e80 0x7fc9f40c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.714+0000 7fc9f9986640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc9f406aac0 0x7fc9f40c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39864/0 (socket says 172.21.15.136:39864) 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.714+0000 7fc9f9986640 1 -- 172.21.15.136:0/1892244511 learned_addr learned my addr 172.21.15.136:0/1892244511 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.714+0000 7fc9f9185640 1 --2- 172.21.15.136:0/1892244511 >> v2:172.21.15.160:3300/0 conn(0x7fc9f4150b50 0x7fc9f406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.716+0000 7fc9f9986640 1 -- 172.21.15.136:0/1892244511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f40c4e80 msgr2=0x7fc9f40c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.716+0000 7fc9f9986640 1 --2- 172.21.15.136:0/1892244511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f40c4e80 0x7fc9f40c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.716+0000 7fc9f9986640 1 -- 172.21.15.136:0/1892244511 >> v2:172.21.15.160:3300/0 conn(0x7fc9f4150b50 msgr2=0x7fc9f406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:58:57.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.716+0000 7fc9f9986640 1 --2- 172.21.15.136:0/1892244511 >> v2:172.21.15.160:3300/0 conn(0x7fc9f4150b50 0x7fc9f406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.716+0000 7fc9f9986640 1 -- 172.21.15.136:0/1892244511 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40c5f10 con 0x7fc9f406aac0 2024-02-17T12:58:57.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.718+0000 7fc9f9986640 1 --2- 172.21.15.136:0/1892244511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f40c7150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9f406e1c0 tx=0x7fc9ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e6938f142a8207 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.722+0000 7fc9ebfff640 1 -- 172.21.15.136:0/1892244511 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec02ca70 con 0x7fc9f406aac0 2024-02-17T12:58:57.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.722+0000 7fc9ebfff640 1 -- 172.21.15.136:0/1892244511 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec02cbd0 con 0x7fc9f406aac0 2024-02-17T12:58:57.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.722+0000 7fc9ebfff640 1 -- 172.21.15.136:0/1892244511 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0343f0 con 0x7fc9f406aac0 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.722+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1892244511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 msgr2=0x7fc9f40c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.722+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1892244511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f40c7150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9f406e1c0 tx=0x7fc9ec02bed0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1892244511 shutdown_connections 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1892244511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f40c7150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1892244511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f40c4e80 0x7fc9f40c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1892244511 >> v2:172.21.15.160:3300/0 conn(0x7fc9f4150b50 0x7fc9f406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1892244511 >> 172.21.15.136:0/1892244511 conn(0x7fc9f40c7e90 msgr2=0x7fc9f40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1892244511 shutdown_connections 2024-02-17T12:58:57.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.723+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1892244511 wait complete. 2024-02-17T12:58:57.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.724+0000 7fc9fb3e9640 1 Processor -- start 2024-02-17T12:58:57.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.724+0000 7fc9fb3e9640 1 -- start start 2024-02-17T12:58:57.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9fb3e9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9fb3e9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f40c4e80 0x7fc9f4154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9fb3e9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f4150b50 0x7fc9f4155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9fb3e9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f41f1990 con 0x7fc9f406aac0 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9fb3e9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f41f0ac0 con 0x7fc9f40c4e80 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9fb3e9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f41f0d80 con 0x7fc9f4150b50 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9f9185640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.725+0000 7fc9f9986640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f4150b50 0x7fc9f4155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.726+0000 7fc9f8984640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f40c4e80 0x7fc9f4154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.726+0000 7fc9f9185640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f414fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39878/0 (socket says 172.21.15.136:39878) 2024-02-17T12:58:57.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.726+0000 7fc9f9185640 1 -- 172.21.15.136:0/1942270951 learned_addr learned my addr 172.21.15.136:0/1942270951 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T12:58:57.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.729+0000 7fc9f9185640 1 -- 172.21.15.136:0/1942270951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f4150b50 msgr2=0x7fc9f4155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.729+0000 7fc9f9185640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f4150b50 0x7fc9f4155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.729+0000 7fc9f9185640 1 -- 172.21.15.136:0/1942270951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f40c4e80 msgr2=0x7fc9f4154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:57.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.729+0000 7fc9f9185640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f40c4e80 0x7fc9f4154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:57.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.729+0000 7fc9f9185640 1 -- 172.21.15.136:0/1942270951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec009b30 con 0x7fc9f406aac0 2024-02-17T12:58:57.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.731+0000 7fc9f9185640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f414fd20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000e9b0 tx=0x7fc9f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.734+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0009670 con 0x7fc9f406aac0 2024-02-17T12:58:57.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.734+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f000c9a0 con 0x7fc9f406aac0 2024-02-17T12:58:57.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.734+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000cd50 con 0x7fc9f406aac0 2024-02-17T12:58:57.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.734+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f41f1060 con 0x7fc9f406aac0 2024-02-17T12:58:57.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.735+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f41f1620 con 0x7fc9f406aac0 2024-02-17T12:58:57.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.736+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f404efc0 con 0x7fc9f406aac0 2024-02-17T12:58:57.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.755+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc9f0013470 con 0x7fc9f406aac0 2024-02-17T12:58:57.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.755+0000 7fc9e9ffb640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc9d806b840 0x7fc9d806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:58:57.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.755+0000 7fc9f8984640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc9d806b840 0x7fc9d806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:58:57.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.756+0000 7fc9f8984640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc9d806b840 0x7fc9d806dd00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40727a0 tx=0x7fc9e4009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:58:57.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.996+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fc9f0059390 con 0x7fc9f406aac0 2024-02-17T12:58:57.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:57.996+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9f0055630 con 0x7fc9f406aac0 2024-02-17T12:58:58.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.210+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9f4071e10 con 0x7fc9f406aac0 2024-02-17T12:58:58.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.216+0000 7fc9e9ffb640 1 -- 172.21.15.136:0/1942270951 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc9f0017070 con 0x7fc9f406aac0 2024-02-17T12:58:58.207 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T12:58:58.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.218+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc9d806b840 msgr2=0x7fc9d806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:58.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.218+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc9d806b840 0x7fc9d806dd00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40727a0 tx=0x7fc9e4009190 comp rx=0 tx=0).stop 2024-02-17T12:58:58.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 msgr2=0x7fc9f414fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:58:58.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f414fd20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000e9b0 tx=0x7fc9f000ee70 comp rx=0 tx=0).stop 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 shutdown_connections 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc9d806b840 0x7fc9d806dd00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9f4150b50 0x7fc9f4155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9f40c4e80 0x7fc9f4154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 --2- 172.21.15.136:0/1942270951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9f406aac0 0x7fc9f414fd20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 >> 172.21.15.136:0/1942270951 conn(0x7fc9f40c7e90 msgr2=0x7fc9f414eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 shutdown_connections 2024-02-17T12:58:58.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:58:58.219+0000 7fc9fb3e9640 1 -- 172.21.15.136:0/1942270951 wait complete. 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:58:58.220 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:58:58.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.221 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:58:58.236 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T12:58:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:58:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:58:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-17T12:58:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42282sec preferred_lft 42282sec 2024-02-17T12:58:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-02-17T12:58:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:58:58.240 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T12:58:58.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.240 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:58.241 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:58.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-02-17T12:58:58.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-02-17T12:58:58.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-02-17T12:58:58.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T12:58:58.241 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:58.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.345 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:58:58.370 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-02-17T12:58:58.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.372 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-02-17T12:58:58.427 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-02-17T12:58:58.428 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:58:58.428 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:58:58.428 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:58:58.428 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:58:58.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.428 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:58.428 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:58.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:58:58.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:58:58.429 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:58:58.429 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:58.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.525 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-02-17T12:58:58.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.540 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-02-17T12:58:58.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.595 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:58.595 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:58.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:58:58.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-17T12:58:58.595 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:58.678 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-17T12:58:58.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-17T12:58:58.678 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:58.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:58.804 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2024-02-17T12:58:58.804 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-02-17T12:58:58.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-02-17T12:58:58.805 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T12:58:58.805 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-02-17T12:58:58.846 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-02-17T12:58:58.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:58:58.847 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:58:58.902 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:58:58.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:58:58.902 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:58:58.957 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-17T12:58:58.957 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:58:59.026 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:58:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:58:59.084 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:58:59.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:59.086 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:58:59.138 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-17T12:58:59.138 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-17T12:58:59.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:58:59.208 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:58:59.265 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:58:59.265 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:58:59.265 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:58:59.265 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:58:59.266 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:58:59.267 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:58:59.268 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:58:59.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:58:59.268 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:58:59.352 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:58:59.364 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:59:00.423 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:59:00.453 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:59:00.509 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:59:00.510 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:00.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:00.511 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:59:01.665 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:59:01.693 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:59:01.749 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:59:01.750 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:01.751 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:01.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:01.752 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:59:02.905 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:59:02.932 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:59:02.990 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:59:02.991 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:59:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:59:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:59:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:59:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:02.992 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:02.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:02.992 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:59:04.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:59:04.174 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:59:04.230 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:59:04.231 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:04.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:04.232 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:59:04.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:ceph-fuse[48670]: starting ceph client 2024-02-17T12:59:04.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:2024-02-17T12:59:04.778+0000 6503100 -1 init, newargv = 0x79ff260 newargc=15 2024-02-17T12:59:05.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:59:05.413 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:59:05.470 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:59:05.471 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:05.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:05.472 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:59:05.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:ceph-fuse[48670]: starting fuse 2024-02-17T12:59:06.626 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-02-17T12:59:06.656 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T12:59:06.712 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-02-17T12:59:06.712 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-02-17T12:59:06.712 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-02-17T12:59:06.712 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-02-17T12:59:06.712 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-02-17T12:59:06.712 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-02-17T12:59:06.713 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T12:59:06.714 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-02-17T12:59:06.715 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:06.715 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:59:06.715 INFO:teuthology.orchestra.run.smithi136.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:06.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:06.715 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-02-17T12:59:06.767 INFO:teuthology.orchestra.run.smithi136.stdout:41 2024-02-17T12:59:06.767 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-02-17T12:59:06.767 DEBUG:teuthology.orchestra.run.smithi136:> sudo stdin-killer -- python3 -c ' 2024-02-17T12:59:06.767 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2024-02-17T12:59:06.767 DEBUG:teuthology.orchestra.run.smithi136:> import re 2024-02-17T12:59:06.767 DEBUG:teuthology.orchestra.run.smithi136:> import os 2024-02-17T12:59:06.767 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> def _find_admin_socket(client_name): 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2024-02-17T12:59:06.768 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> contents = proc_f.read() 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> if mountpoint in contents: 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> return f 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> print(_find_admin_socket("client.0")) 2024-02-17T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi136:> ' 2024-02-17T12:59:06.888 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.0.48670.asok 2024-02-17T12:59:06.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T12:59:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-17T12:59:06.898 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48670.asok 2024-02-17T12:59:06.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:06.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48670.asok status 2024-02-17T12:59:07.130 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T12:59:07.130 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2024-02-17T12:59:07.130 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "6822c7b54e949006be7a0802650d01723d834d1d", 2024-02-17T12:59:07.130 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 19.0.0-1515-g6822c7b5 (6822c7b54e949006be7a0802650d01723d834d1d) squid (dev)", 2024-02-17T12:59:07.130 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "0", 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "48670", 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4800, 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 4800 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:59:07.131 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "192.168.0.1:0", 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3466033535 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "192.168.0.1:0", 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 3466033535 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.4800 192.168.0.1:0/3466033535", 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "192.168.0.1:0/3466033535", 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 18, 2024-02-17T12:59:07.132 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 26, 2024-02-17T12:59:07.133 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2024-02-17T12:59:07.133 INFO:teuthology.orchestra.run.smithi136.stdout: "blocklisted": false, 2024-02-17T12:59:07.133 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2024-02-17T12:59:07.133 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T12:59:07.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:07.139 DEBUG:teuthology.orchestra.run.smithi136:> stat --file-system '--printf=%T 2024-02-17T12:59:07.139 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:07.188 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2024-02-17T12:59:07.189 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:07.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:59:07.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:07.242 INFO:teuthology.run_tasks:Running task workunit... 2024-02-17T12:59:07.256 INFO:tasks.workunit:Pulling workunits from ref 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:59:07.256 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-17T12:59:07.256 INFO:tasks.workunit:timeout=3h 2024-02-17T12:59:07.256 INFO:tasks.workunit:cleanup=True 2024-02-17T12:59:07.257 DEBUG:teuthology.orchestra.run.smithi136:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:07.272 INFO:teuthology.orchestra.run.smithi136.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:07.272 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-02-17 12:57:58.124360794 +0000 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-02-17 12:58:11.509299520 +0000 2024-02-17T12:59:07.273 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-02-17T12:59:07.273 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-17T12:59:07.273 DEBUG:teuthology.orchestra.run.smithi136:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-17T12:59:07.931 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:59:07.946 INFO:tasks.workunit.client.0.smithi136.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-17T12:59:29.541 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:59:29.544 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:59:56.771 INFO:tasks.workunit.client.0.smithi136.stderr:Note: switching to '6822c7b54e949006be7a0802650d01723d834d1d'. 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr:state without impacting any branches by switching back to a branch. 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: git switch -c 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr:Or undo this operation with: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.772 INFO:tasks.workunit.client.0.smithi136.stderr: git switch - 2024-02-17T12:59:56.773 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.773 INFO:tasks.workunit.client.0.smithi136.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-17T12:59:56.773 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-02-17T12:59:56.773 INFO:tasks.workunit.client.0.smithi136.stderr:HEAD is now at 6822c7b54e9 Merge pull request #55453 from ronen-fr/wip-rf-0741-logs 2024-02-17T12:59:56.775 DEBUG:teuthology.orchestra.run.smithi136:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-17T12:59:56.827 INFO:tasks.workunit.client.0.smithi136.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-17T12:59:56.829 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-17T12:59:56.830 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-17T12:59:57.486 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-17T12:59:57.556 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-17T12:59:57.596 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-17T12:59:57.597 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-17T12:59:57.598 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-17T12:59:57.636 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-17T12:59:57.639 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T12:59:57.640 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-17T12:59:57.655 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-02-17T12:59:57.656 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-02-17T12:59:57.657 DEBUG:teuthology.orchestra.run.smithi136:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6822c7b54e949006be7a0802650d01723d834d1d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-02-17T12:59:57.910 INFO:tasks.workunit.client.0.smithi136.stderr:+ dbench 1 2024-02-17T12:59:57.919 INFO:tasks.workunit.client.0.smithi136.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-02-17T12:59:57.919 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-02-17T12:59:57.919 INFO:tasks.workunit.client.0.smithi136.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-02-17T12:59:57.925 INFO:tasks.workunit.client.0.smithi136.stdout:0 of 1 processes prepared for launch 0 sec 2024-02-17T12:59:58.025 INFO:tasks.workunit.client.0.smithi136.stdout:1 of 1 processes prepared for launch 0 sec 2024-02-17T12:59:58.025 INFO:tasks.workunit.client.0.smithi136.stdout:releasing clients 2024-02-17T12:59:59.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 47.724 ms 2024-02-17T12:59:59.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:59:59.841 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:00:00.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 113 2.62 MB/sec warmup 2 sec latency 185.782 ms 2024-02-17T13:00:01.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 155 2.18 MB/sec warmup 3 sec latency 178.706 ms 2024-02-17T13:00:02.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 199 1.96 MB/sec warmup 4 sec latency 178.097 ms 2024-02-17T13:00:03.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 247 1.88 MB/sec warmup 5 sec latency 162.225 ms 2024-02-17T13:00:04.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 287 1.78 MB/sec warmup 6 sec latency 179.877 ms 2024-02-17T13:00:05.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 329 1.71 MB/sec warmup 7 sec latency 231.523 ms 2024-02-17T13:00:06.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 365 1.63 MB/sec warmup 8 sec latency 212.512 ms 2024-02-17T13:00:07.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 405 1.59 MB/sec warmup 9 sec latency 236.762 ms 2024-02-17T13:00:08.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 445 1.56 MB/sec warmup 10 sec latency 290.721 ms 2024-02-17T13:00:09.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 477 1.52 MB/sec warmup 11 sec latency 290.937 ms 2024-02-17T13:00:10.025 INFO:tasks.workunit.client.0.smithi136.stdout: 1 513 1.48 MB/sec warmup 12 sec latency 213.964 ms 2024-02-17T13:00:11.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 606 1.61 MB/sec warmup 13 sec latency 233.709 ms 2024-02-17T13:00:12.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 644 1.50 MB/sec warmup 14 sec latency 351.991 ms 2024-02-17T13:00:13.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 653 1.40 MB/sec warmup 15 sec latency 428.104 ms 2024-02-17T13:00:14.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 676 1.32 MB/sec warmup 16 sec latency 337.120 ms 2024-02-17T13:00:15.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 699 1.25 MB/sec warmup 17 sec latency 409.008 ms 2024-02-17T13:00:16.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 730 1.18 MB/sec warmup 18 sec latency 269.098 ms 2024-02-17T13:00:17.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 747 1.12 MB/sec warmup 19 sec latency 409.522 ms 2024-02-17T13:00:18.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 796 1.07 MB/sec warmup 20 sec latency 220.914 ms 2024-02-17T13:00:19.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 813 1.02 MB/sec warmup 21 sec latency 365.274 ms 2024-02-17T13:00:20.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 853 0.98 MB/sec warmup 22 sec latency 442.626 ms 2024-02-17T13:00:21.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 862 0.94 MB/sec warmup 23 sec latency 387.337 ms 2024-02-17T13:00:22.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 882 0.90 MB/sec warmup 24 sec latency 324.162 ms 2024-02-17T13:00:23.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 923 0.87 MB/sec warmup 25 sec latency 221.802 ms 2024-02-17T13:00:24.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 930 0.84 MB/sec warmup 26 sec latency 319.828 ms 2024-02-17T13:00:25.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 942 0.81 MB/sec warmup 27 sec latency 297.251 ms 2024-02-17T13:00:26.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 971 0.78 MB/sec warmup 28 sec latency 296.225 ms 2024-02-17T13:00:27.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1027 0.79 MB/sec warmup 29 sec latency 345.827 ms 2024-02-17T13:00:28.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1042 0.76 MB/sec warmup 30 sec latency 309.952 ms 2024-02-17T13:00:29.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1048 0.74 MB/sec warmup 31 sec latency 374.600 ms 2024-02-17T13:00:29.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:00:29.975 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:00:30.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1084 0.72 MB/sec warmup 32 sec latency 443.675 ms 2024-02-17T13:00:31.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1100 0.70 MB/sec warmup 33 sec latency 316.869 ms 2024-02-17T13:00:32.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1134 0.68 MB/sec warmup 34 sec latency 295.665 ms 2024-02-17T13:00:33.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1163 0.66 MB/sec warmup 35 sec latency 301.837 ms 2024-02-17T13:00:34.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1172 0.64 MB/sec warmup 36 sec latency 306.346 ms 2024-02-17T13:00:35.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1200 0.62 MB/sec warmup 37 sec latency 222.343 ms 2024-02-17T13:00:36.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1231 0.61 MB/sec warmup 38 sec latency 307.741 ms 2024-02-17T13:00:37.026 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1252 0.59 MB/sec warmup 39 sec latency 374.809 ms 2024-02-17T13:00:38.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1280 0.58 MB/sec warmup 40 sec latency 360.995 ms 2024-02-17T13:00:39.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1296 0.57 MB/sec warmup 41 sec latency 324.964 ms 2024-02-17T13:00:40.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1381 0.62 MB/sec warmup 42 sec latency 302.121 ms 2024-02-17T13:00:41.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1397 0.60 MB/sec warmup 43 sec latency 309.431 ms 2024-02-17T13:00:42.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1418 0.59 MB/sec warmup 44 sec latency 322.069 ms 2024-02-17T13:00:43.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1448 0.58 MB/sec warmup 45 sec latency 181.180 ms 2024-02-17T13:00:44.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1466 0.57 MB/sec warmup 46 sec latency 311.418 ms 2024-02-17T13:00:45.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1490 0.55 MB/sec warmup 47 sec latency 332.379 ms 2024-02-17T13:00:46.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1523 0.54 MB/sec warmup 48 sec latency 329.239 ms 2024-02-17T13:00:47.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1551 0.53 MB/sec warmup 49 sec latency 300.377 ms 2024-02-17T13:00:48.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1572 0.52 MB/sec warmup 50 sec latency 291.783 ms 2024-02-17T13:00:49.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1600 0.51 MB/sec warmup 51 sec latency 318.571 ms 2024-02-17T13:00:50.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1612 0.50 MB/sec warmup 52 sec latency 310.925 ms 2024-02-17T13:00:51.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1641 0.49 MB/sec warmup 53 sec latency 311.138 ms 2024-02-17T13:00:52.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1660 0.49 MB/sec warmup 54 sec latency 327.957 ms 2024-02-17T13:00:53.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1698 0.48 MB/sec warmup 55 sec latency 251.755 ms 2024-02-17T13:00:54.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1725 0.47 MB/sec warmup 56 sec latency 301.045 ms 2024-02-17T13:00:55.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1773 0.46 MB/sec warmup 57 sec latency 313.068 ms 2024-02-17T13:00:56.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1819 0.45 MB/sec warmup 58 sec latency 310.364 ms 2024-02-17T13:00:57.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1837 0.45 MB/sec warmup 59 sec latency 316.819 ms 2024-02-17T13:00:58.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1858 0.44 MB/sec warmup 60 sec latency 320.212 ms 2024-02-17T13:00:59.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1869 0.43 MB/sec warmup 61 sec latency 311.579 ms 2024-02-17T13:01:00.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1903 0.43 MB/sec warmup 62 sec latency 433.587 ms 2024-02-17T13:01:00.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:01:00.582 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:01:01.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1920 0.42 MB/sec warmup 63 sec latency 323.680 ms 2024-02-17T13:01:02.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1973 0.41 MB/sec warmup 64 sec latency 301.523 ms 2024-02-17T13:01:03.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 1998 0.41 MB/sec warmup 65 sec latency 301.616 ms 2024-02-17T13:01:04.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2043 0.40 MB/sec warmup 66 sec latency 297.713 ms 2024-02-17T13:01:05.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2056 0.40 MB/sec warmup 67 sec latency 322.142 ms 2024-02-17T13:01:06.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2079 0.39 MB/sec warmup 68 sec latency 332.343 ms 2024-02-17T13:01:07.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2093 0.39 MB/sec warmup 69 sec latency 343.902 ms 2024-02-17T13:01:08.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2140 0.38 MB/sec warmup 70 sec latency 338.627 ms 2024-02-17T13:01:09.027 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2173 0.38 MB/sec warmup 71 sec latency 348.857 ms 2024-02-17T13:01:10.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2180 0.37 MB/sec warmup 72 sec latency 441.517 ms 2024-02-17T13:01:11.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2202 0.37 MB/sec warmup 73 sec latency 334.217 ms 2024-02-17T13:01:12.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2270 0.36 MB/sec warmup 74 sec latency 296.021 ms 2024-02-17T13:01:13.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2303 0.37 MB/sec warmup 75 sec latency 302.328 ms 2024-02-17T13:01:14.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2321 0.37 MB/sec warmup 76 sec latency 451.792 ms 2024-02-17T13:01:15.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2335 0.36 MB/sec warmup 77 sec latency 364.840 ms 2024-02-17T13:01:16.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2358 0.36 MB/sec warmup 78 sec latency 310.888 ms 2024-02-17T13:01:17.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2364 0.35 MB/sec warmup 79 sec latency 294.456 ms 2024-02-17T13:01:18.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2371 0.35 MB/sec warmup 80 sec latency 572.062 ms 2024-02-17T13:01:19.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2391 0.35 MB/sec warmup 81 sec latency 318.102 ms 2024-02-17T13:01:20.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2410 0.34 MB/sec warmup 82 sec latency 391.199 ms 2024-02-17T13:01:21.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2431 0.34 MB/sec warmup 83 sec latency 370.198 ms 2024-02-17T13:01:22.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2441 0.33 MB/sec warmup 84 sec latency 319.754 ms 2024-02-17T13:01:23.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2470 0.34 MB/sec warmup 85 sec latency 185.105 ms 2024-02-17T13:01:24.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2494 0.33 MB/sec warmup 86 sec latency 342.526 ms 2024-02-17T13:01:25.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2549 0.33 MB/sec warmup 87 sec latency 315.680 ms 2024-02-17T13:01:26.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2560 0.33 MB/sec warmup 88 sec latency 328.313 ms 2024-02-17T13:01:27.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2580 0.33 MB/sec warmup 89 sec latency 304.854 ms 2024-02-17T13:01:28.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2596 0.32 MB/sec warmup 90 sec latency 347.228 ms 2024-02-17T13:01:29.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2609 0.32 MB/sec warmup 91 sec latency 320.857 ms 2024-02-17T13:01:30.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2618 0.32 MB/sec warmup 92 sec latency 309.528 ms 2024-02-17T13:01:30.982 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:01:30.985 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:01:31.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2719 0.34 MB/sec warmup 93 sec latency 325.881 ms 2024-02-17T13:01:32.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2760 0.34 MB/sec warmup 94 sec latency 337.042 ms 2024-02-17T13:01:33.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2780 0.34 MB/sec warmup 95 sec latency 385.647 ms 2024-02-17T13:01:34.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2876 0.34 MB/sec warmup 96 sec latency 307.311 ms 2024-02-17T13:01:35.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2917 0.35 MB/sec warmup 97 sec latency 155.412 ms 2024-02-17T13:01:36.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2938 0.34 MB/sec warmup 98 sec latency 202.357 ms 2024-02-17T13:01:37.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2974 0.34 MB/sec warmup 99 sec latency 317.128 ms 2024-02-17T13:01:38.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 2993 0.34 MB/sec warmup 100 sec latency 393.669 ms 2024-02-17T13:01:39.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3015 0.33 MB/sec warmup 101 sec latency 302.015 ms 2024-02-17T13:01:40.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3031 0.33 MB/sec warmup 102 sec latency 298.114 ms 2024-02-17T13:01:41.028 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3187 0.33 MB/sec warmup 103 sec latency 357.001 ms 2024-02-17T13:01:42.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3212 0.33 MB/sec warmup 104 sec latency 307.428 ms 2024-02-17T13:01:43.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3271 0.34 MB/sec warmup 105 sec latency 302.071 ms 2024-02-17T13:01:44.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3282 0.33 MB/sec warmup 106 sec latency 308.647 ms 2024-02-17T13:01:45.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3286 0.33 MB/sec warmup 107 sec latency 312.380 ms 2024-02-17T13:01:46.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3291 0.33 MB/sec warmup 108 sec latency 339.026 ms 2024-02-17T13:01:47.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3294 0.32 MB/sec warmup 109 sec latency 370.220 ms 2024-02-17T13:01:48.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3299 0.32 MB/sec warmup 110 sec latency 316.479 ms 2024-02-17T13:01:49.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3307 0.32 MB/sec warmup 111 sec latency 357.862 ms 2024-02-17T13:01:50.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3310 0.32 MB/sec warmup 112 sec latency 429.082 ms 2024-02-17T13:01:51.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3313 0.31 MB/sec warmup 113 sec latency 310.735 ms 2024-02-17T13:01:52.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3318 0.31 MB/sec warmup 114 sec latency 308.130 ms 2024-02-17T13:01:53.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3322 0.31 MB/sec warmup 115 sec latency 320.307 ms 2024-02-17T13:01:54.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3325 0.30 MB/sec warmup 116 sec latency 304.348 ms 2024-02-17T13:01:55.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3330 0.30 MB/sec warmup 117 sec latency 306.550 ms 2024-02-17T13:01:56.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3334 0.30 MB/sec warmup 118 sec latency 303.901 ms 2024-02-17T13:01:57.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3337 0.30 MB/sec warmup 119 sec latency 307.535 ms 2024-02-17T13:01:59.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3391 0.05 MB/sec execute 1 sec latency 299.703 ms 2024-02-17T13:02:00.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3395 0.02 MB/sec execute 2 sec latency 428.142 ms 2024-02-17T13:02:01.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3513 0.97 MB/sec execute 3 sec latency 302.638 ms 2024-02-17T13:02:01.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:02:01.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:02:02.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3540 0.73 MB/sec execute 4 sec latency 306.110 ms 2024-02-17T13:02:03.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3560 0.60 MB/sec execute 5 sec latency 316.244 ms 2024-02-17T13:02:04.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3584 0.50 MB/sec execute 6 sec latency 310.726 ms 2024-02-17T13:02:05.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3628 0.45 MB/sec execute 7 sec latency 388.293 ms 2024-02-17T13:02:06.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3646 0.40 MB/sec execute 8 sec latency 326.807 ms 2024-02-17T13:02:07.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3673 0.36 MB/sec execute 9 sec latency 304.568 ms 2024-02-17T13:02:08.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3689 0.33 MB/sec execute 10 sec latency 300.125 ms 2024-02-17T13:02:09.029 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3716 0.30 MB/sec execute 11 sec latency 153.652 ms 2024-02-17T13:02:10.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3767 0.36 MB/sec execute 12 sec latency 288.808 ms 2024-02-17T13:02:11.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3783 0.33 MB/sec execute 13 sec latency 200.586 ms 2024-02-17T13:02:12.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3792 0.31 MB/sec execute 14 sec latency 212.472 ms 2024-02-17T13:02:13.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3805 0.29 MB/sec execute 15 sec latency 230.339 ms 2024-02-17T13:02:14.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3823 0.27 MB/sec execute 16 sec latency 162.807 ms 2024-02-17T13:02:15.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3839 0.25 MB/sec execute 17 sec latency 176.606 ms 2024-02-17T13:02:16.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3854 0.24 MB/sec execute 18 sec latency 248.010 ms 2024-02-17T13:02:17.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3870 0.23 MB/sec execute 19 sec latency 144.230 ms 2024-02-17T13:02:18.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3882 0.22 MB/sec execute 20 sec latency 307.634 ms 2024-02-17T13:02:19.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3898 0.22 MB/sec execute 21 sec latency 296.638 ms 2024-02-17T13:02:20.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3920 0.21 MB/sec execute 22 sec latency 294.585 ms 2024-02-17T13:02:21.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3936 0.20 MB/sec execute 23 sec latency 193.922 ms 2024-02-17T13:02:22.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3944 0.19 MB/sec execute 24 sec latency 193.102 ms 2024-02-17T13:02:23.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3960 0.18 MB/sec execute 25 sec latency 190.908 ms 2024-02-17T13:02:24.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3978 0.18 MB/sec execute 26 sec latency 157.447 ms 2024-02-17T13:02:25.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 3995 0.17 MB/sec execute 27 sec latency 162.960 ms 2024-02-17T13:02:26.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4014 0.17 MB/sec execute 28 sec latency 154.494 ms 2024-02-17T13:02:27.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4027 0.16 MB/sec execute 29 sec latency 204.653 ms 2024-02-17T13:02:28.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4035 0.15 MB/sec execute 30 sec latency 305.121 ms 2024-02-17T13:02:29.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4057 0.15 MB/sec execute 31 sec latency 312.519 ms 2024-02-17T13:02:30.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4068 0.14 MB/sec execute 32 sec latency 405.155 ms 2024-02-17T13:02:31.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4093 0.14 MB/sec execute 33 sec latency 304.274 ms 2024-02-17T13:02:31.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:02:31.225 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:02:32.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4112 0.14 MB/sec execute 34 sec latency 242.682 ms 2024-02-17T13:02:33.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4138 0.13 MB/sec execute 35 sec latency 261.606 ms 2024-02-17T13:02:34.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4157 0.13 MB/sec execute 36 sec latency 398.568 ms 2024-02-17T13:02:35.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4173 0.13 MB/sec execute 37 sec latency 205.083 ms 2024-02-17T13:02:36.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4186 0.12 MB/sec execute 38 sec latency 313.187 ms 2024-02-17T13:02:37.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4217 0.12 MB/sec execute 39 sec latency 356.992 ms 2024-02-17T13:02:38.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4238 0.12 MB/sec execute 40 sec latency 328.158 ms 2024-02-17T13:02:39.030 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4270 0.12 MB/sec execute 41 sec latency 301.901 ms 2024-02-17T13:02:40.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4309 0.12 MB/sec execute 42 sec latency 213.872 ms 2024-02-17T13:02:41.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4340 0.12 MB/sec execute 43 sec latency 324.651 ms 2024-02-17T13:02:42.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4379 0.12 MB/sec execute 44 sec latency 222.651 ms 2024-02-17T13:02:43.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4388 0.11 MB/sec execute 45 sec latency 307.025 ms 2024-02-17T13:02:44.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4424 0.11 MB/sec execute 46 sec latency 311.763 ms 2024-02-17T13:02:45.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4433 0.11 MB/sec execute 47 sec latency 346.830 ms 2024-02-17T13:02:46.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4472 0.11 MB/sec execute 48 sec latency 307.152 ms 2024-02-17T13:02:47.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4497 0.11 MB/sec execute 49 sec latency 280.870 ms 2024-02-17T13:02:48.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4503 0.11 MB/sec execute 50 sec latency 315.246 ms 2024-02-17T13:02:49.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4528 0.11 MB/sec execute 51 sec latency 318.563 ms 2024-02-17T13:02:50.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4563 0.11 MB/sec execute 52 sec latency 272.945 ms 2024-02-17T13:02:51.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4600 0.12 MB/sec execute 53 sec latency 300.947 ms 2024-02-17T13:02:52.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4615 0.12 MB/sec execute 54 sec latency 316.882 ms 2024-02-17T13:02:53.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4629 0.12 MB/sec execute 55 sec latency 316.997 ms 2024-02-17T13:02:54.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4667 0.12 MB/sec execute 56 sec latency 298.150 ms 2024-02-17T13:02:55.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4684 0.12 MB/sec execute 57 sec latency 319.540 ms 2024-02-17T13:02:56.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4724 0.12 MB/sec execute 58 sec latency 188.916 ms 2024-02-17T13:02:57.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4735 0.11 MB/sec execute 59 sec latency 300.941 ms 2024-02-17T13:02:58.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4747 0.11 MB/sec execute 60 sec latency 303.569 ms 2024-02-17T13:02:59.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4780 0.11 MB/sec execute 61 sec latency 371.772 ms 2024-02-17T13:03:00.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4814 0.11 MB/sec execute 62 sec latency 213.560 ms 2024-02-17T13:03:01.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4844 0.11 MB/sec execute 63 sec latency 320.069 ms 2024-02-17T13:03:01.569 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:03:01.571 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:03:02.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4850 0.11 MB/sec execute 64 sec latency 316.494 ms 2024-02-17T13:03:03.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4943 0.15 MB/sec execute 65 sec latency 313.539 ms 2024-02-17T13:03:04.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4957 0.15 MB/sec execute 66 sec latency 303.398 ms 2024-02-17T13:03:05.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 4983 0.14 MB/sec execute 67 sec latency 318.595 ms 2024-02-17T13:03:06.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5012 0.14 MB/sec execute 68 sec latency 300.586 ms 2024-02-17T13:03:07.031 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5031 0.14 MB/sec execute 69 sec latency 286.544 ms 2024-02-17T13:03:08.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5053 0.14 MB/sec execute 70 sec latency 326.650 ms 2024-02-17T13:03:09.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5078 0.14 MB/sec execute 71 sec latency 314.560 ms 2024-02-17T13:03:10.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5096 0.14 MB/sec execute 72 sec latency 300.157 ms 2024-02-17T13:03:11.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5121 0.13 MB/sec execute 73 sec latency 304.289 ms 2024-02-17T13:03:12.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5153 0.13 MB/sec execute 74 sec latency 95.615 ms 2024-02-17T13:03:13.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5175 0.13 MB/sec execute 75 sec latency 300.002 ms 2024-02-17T13:03:14.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5194 0.13 MB/sec execute 76 sec latency 326.869 ms 2024-02-17T13:03:15.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5211 0.13 MB/sec execute 77 sec latency 328.443 ms 2024-02-17T13:03:16.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5251 0.13 MB/sec execute 78 sec latency 355.358 ms 2024-02-17T13:03:17.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5272 0.13 MB/sec execute 79 sec latency 369.389 ms 2024-02-17T13:03:18.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5336 0.12 MB/sec execute 80 sec latency 293.174 ms 2024-02-17T13:03:19.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5371 0.12 MB/sec execute 81 sec latency 287.779 ms 2024-02-17T13:03:20.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5390 0.12 MB/sec execute 82 sec latency 401.276 ms 2024-02-17T13:03:21.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5406 0.12 MB/sec execute 83 sec latency 304.330 ms 2024-02-17T13:03:22.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5427 0.12 MB/sec execute 84 sec latency 307.397 ms 2024-02-17T13:03:23.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5453 0.12 MB/sec execute 85 sec latency 358.360 ms 2024-02-17T13:03:24.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5476 0.12 MB/sec execute 86 sec latency 297.769 ms 2024-02-17T13:03:25.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5526 0.12 MB/sec execute 87 sec latency 300.969 ms 2024-02-17T13:03:26.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5554 0.12 MB/sec execute 88 sec latency 298.953 ms 2024-02-17T13:03:27.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5597 0.12 MB/sec execute 89 sec latency 305.888 ms 2024-02-17T13:03:28.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5615 0.11 MB/sec execute 90 sec latency 301.689 ms 2024-02-17T13:03:29.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5625 0.11 MB/sec execute 91 sec latency 307.585 ms 2024-02-17T13:03:30.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5651 0.11 MB/sec execute 92 sec latency 393.309 ms 2024-02-17T13:03:31.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5695 0.11 MB/sec execute 93 sec latency 343.553 ms 2024-02-17T13:03:31.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:03:31.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:03:32.032 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5708 0.11 MB/sec execute 94 sec latency 333.494 ms 2024-02-17T13:03:33.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5738 0.11 MB/sec execute 95 sec latency 346.095 ms 2024-02-17T13:03:34.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5760 0.11 MB/sec execute 96 sec latency 312.212 ms 2024-02-17T13:03:35.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5819 0.11 MB/sec execute 97 sec latency 297.940 ms 2024-02-17T13:03:36.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5861 0.12 MB/sec execute 98 sec latency 295.860 ms 2024-02-17T13:03:37.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5867 0.12 MB/sec execute 99 sec latency 380.720 ms 2024-02-17T13:03:38.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5894 0.12 MB/sec execute 100 sec latency 449.663 ms 2024-02-17T13:03:39.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5907 0.11 MB/sec execute 101 sec latency 304.955 ms 2024-02-17T13:03:40.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5924 0.11 MB/sec execute 102 sec latency 300.943 ms 2024-02-17T13:03:41.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5928 0.11 MB/sec execute 103 sec latency 310.458 ms 2024-02-17T13:03:42.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5951 0.11 MB/sec execute 104 sec latency 331.229 ms 2024-02-17T13:03:43.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5967 0.11 MB/sec execute 105 sec latency 337.267 ms 2024-02-17T13:03:44.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 5991 0.11 MB/sec execute 106 sec latency 316.024 ms 2024-02-17T13:03:45.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6000 0.11 MB/sec execute 107 sec latency 420.691 ms 2024-02-17T13:03:46.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6027 0.11 MB/sec execute 108 sec latency 153.408 ms 2024-02-17T13:03:47.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6052 0.11 MB/sec execute 109 sec latency 337.689 ms 2024-02-17T13:03:48.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6064 0.11 MB/sec execute 110 sec latency 311.776 ms 2024-02-17T13:03:49.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6116 0.11 MB/sec execute 111 sec latency 308.178 ms 2024-02-17T13:03:50.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6135 0.11 MB/sec execute 112 sec latency 304.805 ms 2024-02-17T13:03:51.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6152 0.11 MB/sec execute 113 sec latency 310.887 ms 2024-02-17T13:03:52.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6166 0.11 MB/sec execute 114 sec latency 294.045 ms 2024-02-17T13:03:53.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6176 0.11 MB/sec execute 115 sec latency 338.440 ms 2024-02-17T13:03:54.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6275 0.13 MB/sec execute 116 sec latency 320.650 ms 2024-02-17T13:03:55.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6316 0.13 MB/sec execute 117 sec latency 324.344 ms 2024-02-17T13:03:56.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6335 0.13 MB/sec execute 118 sec latency 367.629 ms 2024-02-17T13:03:57.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6433 0.13 MB/sec execute 119 sec latency 295.819 ms 2024-02-17T13:03:58.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6472 0.14 MB/sec execute 120 sec latency 157.197 ms 2024-02-17T13:03:59.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6493 0.14 MB/sec execute 121 sec latency 200.285 ms 2024-02-17T13:04:00.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6529 0.14 MB/sec execute 122 sec latency 298.252 ms 2024-02-17T13:04:01.033 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6545 0.14 MB/sec execute 123 sec latency 310.876 ms 2024-02-17T13:04:01.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:04:01.790 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:04:02.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6567 0.14 MB/sec execute 124 sec latency 307.503 ms 2024-02-17T13:04:03.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6586 0.14 MB/sec execute 125 sec latency 281.057 ms 2024-02-17T13:04:04.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6742 0.14 MB/sec execute 126 sec latency 326.532 ms 2024-02-17T13:04:05.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6764 0.14 MB/sec execute 127 sec latency 382.449 ms 2024-02-17T13:04:06.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6822 0.15 MB/sec execute 128 sec latency 289.163 ms 2024-02-17T13:04:07.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6836 0.15 MB/sec execute 129 sec latency 311.434 ms 2024-02-17T13:04:08.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6840 0.15 MB/sec execute 130 sec latency 305.160 ms 2024-02-17T13:04:09.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6845 0.15 MB/sec execute 131 sec latency 370.686 ms 2024-02-17T13:04:10.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6848 0.14 MB/sec execute 132 sec latency 434.383 ms 2024-02-17T13:04:11.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6853 0.14 MB/sec execute 133 sec latency 365.459 ms 2024-02-17T13:04:12.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6861 0.14 MB/sec execute 134 sec latency 391.937 ms 2024-02-17T13:04:13.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6864 0.14 MB/sec execute 135 sec latency 359.218 ms 2024-02-17T13:04:14.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6867 0.14 MB/sec execute 136 sec latency 330.234 ms 2024-02-17T13:04:15.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6871 0.14 MB/sec execute 137 sec latency 373.224 ms 2024-02-17T13:04:16.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6875 0.14 MB/sec execute 138 sec latency 299.743 ms 2024-02-17T13:04:17.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6879 0.14 MB/sec execute 139 sec latency 299.890 ms 2024-02-17T13:04:18.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6882 0.14 MB/sec execute 140 sec latency 293.928 ms 2024-02-17T13:04:19.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6888 0.14 MB/sec execute 141 sec latency 300.564 ms 2024-02-17T13:04:20.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6891 0.13 MB/sec execute 142 sec latency 423.066 ms 2024-02-17T13:04:21.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6907 0.13 MB/sec execute 143 sec latency 302.106 ms 2024-02-17T13:04:22.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6929 0.13 MB/sec execute 144 sec latency 142.144 ms 2024-02-17T13:04:23.034 INFO:tasks.workunit.client.0.smithi136.stdout: 1 6948 0.13 MB/sec execute 145 sec latency 304.593 ms 2024-02-17T13:04:24.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7047 0.15 MB/sec execute 146 sec latency 310.587 ms 2024-02-17T13:04:25.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7082 0.15 MB/sec execute 147 sec latency 205.450 ms 2024-02-17T13:04:26.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7108 0.15 MB/sec execute 148 sec latency 292.986 ms 2024-02-17T13:04:27.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7123 0.15 MB/sec execute 149 sec latency 344.235 ms 2024-02-17T13:04:28.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7173 0.15 MB/sec execute 150 sec latency 326.107 ms 2024-02-17T13:04:29.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7188 0.15 MB/sec execute 151 sec latency 246.701 ms 2024-02-17T13:04:30.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7218 0.15 MB/sec execute 152 sec latency 320.717 ms 2024-02-17T13:04:31.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7231 0.15 MB/sec execute 153 sec latency 420.429 ms 2024-02-17T13:04:31.927 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:04:31.929 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:04:32.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7252 0.15 MB/sec execute 154 sec latency 319.950 ms 2024-02-17T13:04:33.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7302 0.15 MB/sec execute 155 sec latency 277.057 ms 2024-02-17T13:04:34.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7323 0.15 MB/sec execute 156 sec latency 296.608 ms 2024-02-17T13:04:35.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7335 0.15 MB/sec execute 157 sec latency 202.599 ms 2024-02-17T13:04:36.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7345 0.15 MB/sec execute 158 sec latency 213.486 ms 2024-02-17T13:04:37.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7364 0.15 MB/sec execute 159 sec latency 173.068 ms 2024-02-17T13:04:38.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7380 0.15 MB/sec execute 160 sec latency 198.320 ms 2024-02-17T13:04:39.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7396 0.15 MB/sec execute 161 sec latency 154.094 ms 2024-02-17T13:04:40.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7411 0.14 MB/sec execute 162 sec latency 148.734 ms 2024-02-17T13:04:41.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7420 0.14 MB/sec execute 163 sec latency 307.450 ms 2024-02-17T13:04:42.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7440 0.14 MB/sec execute 164 sec latency 352.083 ms 2024-02-17T13:04:43.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7458 0.14 MB/sec execute 165 sec latency 313.513 ms 2024-02-17T13:04:44.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7476 0.14 MB/sec execute 166 sec latency 296.163 ms 2024-02-17T13:04:45.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7487 0.14 MB/sec execute 167 sec latency 205.682 ms 2024-02-17T13:04:46.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7502 0.14 MB/sec execute 168 sec latency 201.403 ms 2024-02-17T13:04:47.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7519 0.14 MB/sec execute 169 sec latency 149.052 ms 2024-02-17T13:04:48.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7535 0.14 MB/sec execute 170 sec latency 156.196 ms 2024-02-17T13:04:49.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7550 0.14 MB/sec execute 171 sec latency 160.602 ms 2024-02-17T13:04:50.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7567 0.14 MB/sec execute 172 sec latency 168.191 ms 2024-02-17T13:04:51.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7578 0.14 MB/sec execute 173 sec latency 311.740 ms 2024-02-17T13:04:52.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7591 0.14 MB/sec execute 174 sec latency 310.833 ms 2024-02-17T13:04:53.035 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7607 0.14 MB/sec execute 175 sec latency 320.090 ms 2024-02-17T13:04:54.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7626 0.14 MB/sec execute 176 sec latency 300.114 ms 2024-02-17T13:04:55.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7654 0.13 MB/sec execute 177 sec latency 280.803 ms 2024-02-17T13:04:56.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7675 0.13 MB/sec execute 178 sec latency 259.554 ms 2024-02-17T13:04:57.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7695 0.13 MB/sec execute 179 sec latency 348.356 ms 2024-02-17T13:04:58.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7715 0.13 MB/sec execute 180 sec latency 408.993 ms 2024-02-17T13:04:59.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7723 0.13 MB/sec execute 181 sec latency 347.636 ms 2024-02-17T13:05:00.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7758 0.13 MB/sec execute 182 sec latency 435.142 ms 2024-02-17T13:05:01.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7767 0.13 MB/sec execute 183 sec latency 332.979 ms 2024-02-17T13:05:02.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:05:02.008 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:05:02.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7796 0.13 MB/sec execute 184 sec latency 339.172 ms 2024-02-17T13:05:03.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7825 0.13 MB/sec execute 185 sec latency 305.831 ms 2024-02-17T13:05:04.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7859 0.13 MB/sec execute 186 sec latency 300.111 ms 2024-02-17T13:05:05.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7893 0.13 MB/sec execute 187 sec latency 293.819 ms 2024-02-17T13:05:06.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7926 0.13 MB/sec execute 188 sec latency 332.335 ms 2024-02-17T13:05:07.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7957 0.13 MB/sec execute 189 sec latency 324.829 ms 2024-02-17T13:05:08.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7974 0.13 MB/sec execute 190 sec latency 361.061 ms 2024-02-17T13:05:09.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7992 0.13 MB/sec execute 191 sec latency 407.493 ms 2024-02-17T13:05:10.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8016 0.13 MB/sec execute 192 sec latency 298.602 ms 2024-02-17T13:05:11.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8041 0.13 MB/sec execute 193 sec latency 298.334 ms 2024-02-17T13:05:12.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8048 0.13 MB/sec execute 194 sec latency 297.915 ms 2024-02-17T13:05:13.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8081 0.13 MB/sec execute 195 sec latency 310.932 ms 2024-02-17T13:05:14.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8111 0.13 MB/sec execute 196 sec latency 299.230 ms 2024-02-17T13:05:15.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8148 0.13 MB/sec execute 197 sec latency 316.760 ms 2024-02-17T13:05:16.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8158 0.13 MB/sec execute 198 sec latency 335.351 ms 2024-02-17T13:05:17.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8194 0.13 MB/sec execute 199 sec latency 301.655 ms 2024-02-17T13:05:18.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8210 0.13 MB/sec execute 200 sec latency 316.789 ms 2024-02-17T13:05:19.036 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8243 0.13 MB/sec execute 201 sec latency 322.542 ms 2024-02-17T13:05:20.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8271 0.13 MB/sec execute 202 sec latency 279.255 ms 2024-02-17T13:05:21.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8280 0.13 MB/sec execute 203 sec latency 325.869 ms 2024-02-17T13:05:22.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8312 0.13 MB/sec execute 204 sec latency 137.482 ms 2024-02-17T13:05:23.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8339 0.13 MB/sec execute 205 sec latency 302.958 ms 2024-02-17T13:05:24.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8362 0.13 MB/sec execute 206 sec latency 306.854 ms 2024-02-17T13:05:25.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8388 0.13 MB/sec execute 207 sec latency 329.649 ms 2024-02-17T13:05:26.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8427 0.13 MB/sec execute 208 sec latency 353.146 ms 2024-02-17T13:05:27.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8490 0.14 MB/sec execute 209 sec latency 307.577 ms 2024-02-17T13:05:28.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8506 0.14 MB/sec execute 210 sec latency 322.935 ms 2024-02-17T13:05:29.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8528 0.14 MB/sec execute 211 sec latency 300.608 ms 2024-02-17T13:05:30.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8557 0.14 MB/sec execute 212 sec latency 197.312 ms 2024-02-17T13:05:31.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8587 0.14 MB/sec execute 213 sec latency 324.688 ms 2024-02-17T13:05:32.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8599 0.13 MB/sec execute 214 sec latency 298.257 ms 2024-02-17T13:05:32.151 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:05:32.154 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:05:33.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8633 0.13 MB/sec execute 215 sec latency 305.293 ms 2024-02-17T13:05:34.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8661 0.13 MB/sec execute 216 sec latency 299.488 ms 2024-02-17T13:05:35.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8684 0.13 MB/sec execute 217 sec latency 309.024 ms 2024-02-17T13:05:36.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8711 0.13 MB/sec execute 218 sec latency 307.165 ms 2024-02-17T13:05:37.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8724 0.13 MB/sec execute 219 sec latency 294.657 ms 2024-02-17T13:05:38.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8751 0.13 MB/sec execute 220 sec latency 328.204 ms 2024-02-17T13:05:39.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8783 0.13 MB/sec execute 221 sec latency 338.908 ms 2024-02-17T13:05:40.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8807 0.13 MB/sec execute 222 sec latency 331.332 ms 2024-02-17T13:05:41.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8841 0.13 MB/sec execute 223 sec latency 323.083 ms 2024-02-17T13:05:42.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8891 0.13 MB/sec execute 224 sec latency 294.660 ms 2024-02-17T13:05:43.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8928 0.13 MB/sec execute 225 sec latency 335.788 ms 2024-02-17T13:05:44.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8942 0.13 MB/sec execute 226 sec latency 308.530 ms 2024-02-17T13:05:45.037 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8967 0.13 MB/sec execute 227 sec latency 312.743 ms 2024-02-17T13:05:46.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 8978 0.13 MB/sec execute 228 sec latency 284.974 ms 2024-02-17T13:05:47.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9012 0.13 MB/sec execute 229 sec latency 343.926 ms 2024-02-17T13:05:48.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9029 0.13 MB/sec execute 230 sec latency 334.752 ms 2024-02-17T13:05:49.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9084 0.13 MB/sec execute 231 sec latency 282.993 ms 2024-02-17T13:05:50.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9115 0.13 MB/sec execute 232 sec latency 298.987 ms 2024-02-17T13:05:51.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9149 0.13 MB/sec execute 233 sec latency 303.077 ms 2024-02-17T13:05:52.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9165 0.13 MB/sec execute 234 sec latency 306.508 ms 2024-02-17T13:05:53.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9187 0.13 MB/sec execute 235 sec latency 325.846 ms 2024-02-17T13:05:54.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9202 0.12 MB/sec execute 236 sec latency 319.737 ms 2024-02-17T13:05:55.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9246 0.12 MB/sec execute 237 sec latency 338.470 ms 2024-02-17T13:05:56.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9279 0.12 MB/sec execute 238 sec latency 357.675 ms 2024-02-17T13:05:57.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9288 0.12 MB/sec execute 239 sec latency 343.033 ms 2024-02-17T13:05:58.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9326 0.12 MB/sec execute 240 sec latency 309.129 ms 2024-02-17T13:05:59.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9397 0.13 MB/sec execute 241 sec latency 291.588 ms 2024-02-17T13:06:00.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9410 0.13 MB/sec execute 242 sec latency 436.277 ms 2024-02-17T13:06:01.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9428 0.13 MB/sec execute 243 sec latency 322.525 ms 2024-02-17T13:06:02.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9441 0.13 MB/sec execute 244 sec latency 299.402 ms 2024-02-17T13:06:02.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:06:02.211 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:06:03.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9465 0.13 MB/sec execute 245 sec latency 307.431 ms 2024-02-17T13:06:04.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9468 0.12 MB/sec execute 246 sec latency 543.278 ms 2024-02-17T13:06:05.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9475 0.12 MB/sec execute 247 sec latency 582.902 ms 2024-02-17T13:06:06.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9500 0.12 MB/sec execute 248 sec latency 336.276 ms 2024-02-17T13:06:07.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9516 0.12 MB/sec execute 249 sec latency 309.553 ms 2024-02-17T13:06:08.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9536 0.12 MB/sec execute 250 sec latency 318.823 ms 2024-02-17T13:06:09.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9555 0.12 MB/sec execute 251 sec latency 293.659 ms 2024-02-17T13:06:10.038 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9587 0.13 MB/sec execute 252 sec latency 294.587 ms 2024-02-17T13:06:11.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9600 0.12 MB/sec execute 253 sec latency 311.468 ms 2024-02-17T13:06:12.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9651 0.12 MB/sec execute 254 sec latency 314.200 ms 2024-02-17T13:06:13.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9662 0.12 MB/sec execute 255 sec latency 300.015 ms 2024-02-17T13:06:14.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9683 0.12 MB/sec execute 256 sec latency 317.234 ms 2024-02-17T13:06:15.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9702 0.12 MB/sec execute 257 sec latency 318.410 ms 2024-02-17T13:06:15.257 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:09:10.130 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.315 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:09:10.188 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.346 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:09:10.150 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.356 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:09:10.160 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.412 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:09:10.215 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.428 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:09:10.232 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.701 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:09:10.574 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.801 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:09:10.605 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:15.822 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:09:10.626 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:06:16.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9717 0.12 MB/sec execute 258 sec latency 325.063 ms 2024-02-17T13:06:17.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9723 0.12 MB/sec execute 259 sec latency 317.034 ms 2024-02-17T13:06:18.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9846 0.13 MB/sec execute 260 sec latency 303.404 ms 2024-02-17T13:06:19.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9862 0.13 MB/sec execute 261 sec latency 337.740 ms 2024-02-17T13:06:20.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9881 0.13 MB/sec execute 262 sec latency 301.996 ms 2024-02-17T13:06:21.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 9980 0.13 MB/sec execute 263 sec latency 294.745 ms 2024-02-17T13:06:22.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10025 0.14 MB/sec execute 264 sec latency 183.062 ms 2024-02-17T13:06:23.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10065 0.14 MB/sec execute 265 sec latency 300.963 ms 2024-02-17T13:06:24.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10074 0.14 MB/sec execute 266 sec latency 402.256 ms 2024-02-17T13:06:25.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10093 0.14 MB/sec execute 267 sec latency 261.948 ms 2024-02-17T13:06:26.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10122 0.14 MB/sec execute 268 sec latency 293.818 ms 2024-02-17T13:06:27.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10268 0.14 MB/sec execute 269 sec latency 360.053 ms 2024-02-17T13:06:28.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10289 0.14 MB/sec execute 270 sec latency 296.928 ms 2024-02-17T13:06:29.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10365 0.14 MB/sec execute 271 sec latency 205.240 ms 2024-02-17T13:06:30.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10379 0.14 MB/sec execute 272 sec latency 413.161 ms 2024-02-17T13:06:31.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10382 0.14 MB/sec execute 273 sec latency 309.889 ms 2024-02-17T13:06:32.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10386 0.14 MB/sec execute 274 sec latency 305.672 ms 2024-02-17T13:06:32.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:06:32.358 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:06:33.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10391 0.14 MB/sec execute 275 sec latency 355.537 ms 2024-02-17T13:06:34.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10394 0.14 MB/sec execute 276 sec latency 381.496 ms 2024-02-17T13:06:35.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10402 0.14 MB/sec execute 277 sec latency 370.238 ms 2024-02-17T13:06:36.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10407 0.14 MB/sec execute 278 sec latency 335.905 ms 2024-02-17T13:06:37.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10410 0.14 MB/sec execute 279 sec latency 330.063 ms 2024-02-17T13:06:38.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10413 0.14 MB/sec execute 280 sec latency 316.417 ms 2024-02-17T13:06:39.039 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10417 0.14 MB/sec execute 281 sec latency 326.932 ms 2024-02-17T13:06:40.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10421 0.14 MB/sec execute 282 sec latency 439.924 ms 2024-02-17T13:06:41.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10424 0.13 MB/sec execute 283 sec latency 292.940 ms 2024-02-17T13:06:42.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10429 0.13 MB/sec execute 284 sec latency 305.181 ms 2024-02-17T13:06:43.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10433 0.13 MB/sec execute 285 sec latency 316.530 ms 2024-02-17T13:06:44.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10436 0.13 MB/sec execute 286 sec latency 314.145 ms 2024-02-17T13:06:45.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10460 0.13 MB/sec execute 287 sec latency 290.014 ms 2024-02-17T13:06:46.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10489 0.13 MB/sec execute 288 sec latency 141.730 ms 2024-02-17T13:06:47.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10496 0.13 MB/sec execute 289 sec latency 326.232 ms 2024-02-17T13:06:48.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10613 0.14 MB/sec execute 290 sec latency 299.717 ms 2024-02-17T13:06:49.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10639 0.14 MB/sec execute 291 sec latency 306.125 ms 2024-02-17T13:06:50.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10656 0.14 MB/sec execute 292 sec latency 282.852 ms 2024-02-17T13:06:51.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10680 0.14 MB/sec execute 293 sec latency 291.136 ms 2024-02-17T13:06:52.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10726 0.14 MB/sec execute 294 sec latency 303.328 ms 2024-02-17T13:06:53.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10754 0.14 MB/sec execute 295 sec latency 320.155 ms 2024-02-17T13:06:54.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10767 0.14 MB/sec execute 296 sec latency 322.341 ms 2024-02-17T13:06:55.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10786 0.14 MB/sec execute 297 sec latency 352.913 ms 2024-02-17T13:06:56.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10814 0.14 MB/sec execute 298 sec latency 129.552 ms 2024-02-17T13:06:57.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10858 0.14 MB/sec execute 299 sec latency 282.371 ms 2024-02-17T13:06:58.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10875 0.14 MB/sec execute 300 sec latency 272.742 ms 2024-02-17T13:06:59.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10886 0.14 MB/sec execute 301 sec latency 194.570 ms 2024-02-17T13:07:00.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10898 0.14 MB/sec execute 302 sec latency 209.491 ms 2024-02-17T13:07:01.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10914 0.14 MB/sec execute 303 sec latency 157.274 ms 2024-02-17T13:07:02.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10930 0.14 MB/sec execute 304 sec latency 169.217 ms 2024-02-17T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:07:02.473 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:07:03.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10946 0.14 MB/sec execute 305 sec latency 189.453 ms 2024-02-17T13:07:04.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10960 0.14 MB/sec execute 306 sec latency 216.620 ms 2024-02-17T13:07:05.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10973 0.14 MB/sec execute 307 sec latency 422.545 ms 2024-02-17T13:07:06.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 10988 0.14 MB/sec execute 308 sec latency 315.525 ms 2024-02-17T13:07:07.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11010 0.14 MB/sec execute 309 sec latency 302.734 ms 2024-02-17T13:07:08.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11026 0.14 MB/sec execute 310 sec latency 196.085 ms 2024-02-17T13:07:09.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11037 0.14 MB/sec execute 311 sec latency 195.514 ms 2024-02-17T13:07:10.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11052 0.14 MB/sec execute 312 sec latency 166.780 ms 2024-02-17T13:07:11.040 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11069 0.14 MB/sec execute 313 sec latency 164.652 ms 2024-02-17T13:07:12.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11085 0.14 MB/sec execute 314 sec latency 157.581 ms 2024-02-17T13:07:13.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11104 0.14 MB/sec execute 315 sec latency 175.162 ms 2024-02-17T13:07:14.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11117 0.14 MB/sec execute 316 sec latency 236.032 ms 2024-02-17T13:07:15.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11125 0.14 MB/sec execute 317 sec latency 450.328 ms 2024-02-17T13:07:16.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11137 0.13 MB/sec execute 318 sec latency 313.609 ms 2024-02-17T13:07:17.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11158 0.13 MB/sec execute 319 sec latency 316.908 ms 2024-02-17T13:07:18.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11183 0.13 MB/sec execute 320 sec latency 289.086 ms 2024-02-17T13:07:19.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11204 0.13 MB/sec execute 321 sec latency 252.697 ms 2024-02-17T13:07:20.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11229 0.13 MB/sec execute 322 sec latency 205.705 ms 2024-02-17T13:07:21.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11247 0.13 MB/sec execute 323 sec latency 404.218 ms 2024-02-17T13:07:22.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11262 0.13 MB/sec execute 324 sec latency 282.014 ms 2024-02-17T13:07:23.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11275 0.13 MB/sec execute 325 sec latency 364.413 ms 2024-02-17T13:07:24.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11306 0.13 MB/sec execute 326 sec latency 344.270 ms 2024-02-17T13:07:25.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11324 0.13 MB/sec execute 327 sec latency 480.038 ms 2024-02-17T13:07:26.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11355 0.13 MB/sec execute 328 sec latency 301.765 ms 2024-02-17T13:07:27.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11393 0.13 MB/sec execute 329 sec latency 231.309 ms 2024-02-17T13:07:28.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11429 0.13 MB/sec execute 330 sec latency 297.997 ms 2024-02-17T13:07:29.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11464 0.13 MB/sec execute 331 sec latency 212.398 ms 2024-02-17T13:07:30.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11477 0.13 MB/sec execute 332 sec latency 339.695 ms 2024-02-17T13:07:31.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11513 0.13 MB/sec execute 333 sec latency 328.215 ms 2024-02-17T13:07:32.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11523 0.13 MB/sec execute 334 sec latency 317.466 ms 2024-02-17T13:07:32.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:07:32.601 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:07:33.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11561 0.13 MB/sec execute 335 sec latency 299.263 ms 2024-02-17T13:07:34.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11587 0.13 MB/sec execute 336 sec latency 302.484 ms 2024-02-17T13:07:35.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11590 0.13 MB/sec execute 337 sec latency 321.337 ms 2024-02-17T13:07:36.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11617 0.13 MB/sec execute 338 sec latency 301.532 ms 2024-02-17T13:07:37.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11652 0.13 MB/sec execute 339 sec latency 241.232 ms 2024-02-17T13:07:38.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11687 0.13 MB/sec execute 340 sec latency 365.740 ms 2024-02-17T13:07:39.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11704 0.13 MB/sec execute 341 sec latency 333.612 ms 2024-02-17T13:07:40.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11717 0.13 MB/sec execute 342 sec latency 319.000 ms 2024-02-17T13:07:41.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11752 0.13 MB/sec execute 343 sec latency 288.244 ms 2024-02-17T13:07:42.041 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11774 0.13 MB/sec execute 344 sec latency 300.005 ms 2024-02-17T13:07:43.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11814 0.13 MB/sec execute 345 sec latency 179.481 ms 2024-02-17T13:07:44.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11825 0.13 MB/sec execute 346 sec latency 315.235 ms 2024-02-17T13:07:45.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11836 0.13 MB/sec execute 347 sec latency 315.673 ms 2024-02-17T13:07:46.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11870 0.13 MB/sec execute 348 sec latency 302.951 ms 2024-02-17T13:07:47.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11902 0.13 MB/sec execute 349 sec latency 219.304 ms 2024-02-17T13:07:48.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11934 0.13 MB/sec execute 350 sec latency 333.878 ms 2024-02-17T13:07:49.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 11940 0.13 MB/sec execute 351 sec latency 353.095 ms 2024-02-17T13:07:50.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12033 0.14 MB/sec execute 352 sec latency 326.662 ms 2024-02-17T13:07:51.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12041 0.14 MB/sec execute 353 sec latency 304.737 ms 2024-02-17T13:07:52.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12061 0.14 MB/sec execute 354 sec latency 322.822 ms 2024-02-17T13:07:53.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12097 0.14 MB/sec execute 355 sec latency 327.069 ms 2024-02-17T13:07:54.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12120 0.13 MB/sec execute 356 sec latency 304.697 ms 2024-02-17T13:07:55.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12142 0.13 MB/sec execute 357 sec latency 359.062 ms 2024-02-17T13:07:56.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12157 0.13 MB/sec execute 358 sec latency 311.109 ms 2024-02-17T13:07:57.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12183 0.13 MB/sec execute 359 sec latency 277.291 ms 2024-02-17T13:07:58.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12210 0.13 MB/sec execute 360 sec latency 290.247 ms 2024-02-17T13:07:59.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12242 0.13 MB/sec execute 361 sec latency 294.184 ms 2024-02-17T13:08:00.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12262 0.13 MB/sec execute 362 sec latency 303.027 ms 2024-02-17T13:08:01.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12280 0.13 MB/sec execute 363 sec latency 302.418 ms 2024-02-17T13:08:02.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12299 0.13 MB/sec execute 364 sec latency 306.518 ms 2024-02-17T13:08:02.679 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:08:02.685 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:08:03.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12344 0.13 MB/sec execute 365 sec latency 323.514 ms 2024-02-17T13:08:04.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12362 0.13 MB/sec execute 366 sec latency 294.150 ms 2024-02-17T13:08:05.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12425 0.13 MB/sec execute 367 sec latency 288.034 ms 2024-02-17T13:08:06.042 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12461 0.13 MB/sec execute 368 sec latency 322.504 ms 2024-02-17T13:08:07.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12478 0.13 MB/sec execute 369 sec latency 359.655 ms 2024-02-17T13:08:08.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12497 0.13 MB/sec execute 370 sec latency 301.904 ms 2024-02-17T13:08:09.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12518 0.13 MB/sec execute 371 sec latency 303.037 ms 2024-02-17T13:08:10.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12542 0.13 MB/sec execute 372 sec latency 327.115 ms 2024-02-17T13:08:11.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12567 0.13 MB/sec execute 373 sec latency 343.110 ms 2024-02-17T13:08:12.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12608 0.13 MB/sec execute 374 sec latency 308.009 ms 2024-02-17T13:08:13.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12638 0.13 MB/sec execute 375 sec latency 296.358 ms 2024-02-17T13:08:14.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12688 0.13 MB/sec execute 376 sec latency 304.105 ms 2024-02-17T13:08:15.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12706 0.13 MB/sec execute 377 sec latency 466.681 ms 2024-02-17T13:08:16.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12716 0.13 MB/sec execute 378 sec latency 305.378 ms 2024-02-17T13:08:17.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12736 0.13 MB/sec execute 379 sec latency 348.167 ms 2024-02-17T13:08:18.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12751 0.13 MB/sec execute 380 sec latency 331.931 ms 2024-02-17T13:08:19.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12796 0.13 MB/sec execute 381 sec latency 349.866 ms 2024-02-17T13:08:20.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12829 0.13 MB/sec execute 382 sec latency 377.852 ms 2024-02-17T13:08:21.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12837 0.13 MB/sec execute 383 sec latency 304.291 ms 2024-02-17T13:08:22.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12875 0.13 MB/sec execute 384 sec latency 320.396 ms 2024-02-17T13:08:23.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12949 0.13 MB/sec execute 385 sec latency 303.171 ms 2024-02-17T13:08:24.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12960 0.13 MB/sec execute 386 sec latency 427.681 ms 2024-02-17T13:08:25.043 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12978 0.13 MB/sec execute 387 sec latency 533.978 ms 2024-02-17T13:08:26.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 12991 0.13 MB/sec execute 388 sec latency 295.065 ms 2024-02-17T13:08:27.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13015 0.13 MB/sec execute 389 sec latency 349.468 ms 2024-02-17T13:08:28.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13020 0.13 MB/sec execute 390 sec latency 572.156 ms 2024-02-17T13:08:29.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13030 0.13 MB/sec execute 391 sec latency 328.877 ms 2024-02-17T13:08:30.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13053 0.13 MB/sec execute 392 sec latency 321.940 ms 2024-02-17T13:08:31.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13077 0.13 MB/sec execute 393 sec latency 328.971 ms 2024-02-17T13:08:32.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13088 0.13 MB/sec execute 394 sec latency 308.377 ms 2024-02-17T13:08:32.752 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:08:32.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:08:33.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13107 0.13 MB/sec execute 395 sec latency 152.761 ms 2024-02-17T13:08:34.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13143 0.13 MB/sec execute 396 sec latency 322.109 ms 2024-02-17T13:08:35.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13150 0.13 MB/sec execute 397 sec latency 374.043 ms 2024-02-17T13:08:36.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13203 0.13 MB/sec execute 398 sec latency 326.433 ms 2024-02-17T13:08:37.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13214 0.13 MB/sec execute 399 sec latency 308.464 ms 2024-02-17T13:08:38.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13233 0.13 MB/sec execute 400 sec latency 332.297 ms 2024-02-17T13:08:39.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13252 0.13 MB/sec execute 401 sec latency 306.434 ms 2024-02-17T13:08:40.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13267 0.13 MB/sec execute 402 sec latency 307.449 ms 2024-02-17T13:08:40.372 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:11:35.245 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.378 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:11:35.251 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.389 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:11:35.192 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.389 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:11:35.192 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.391 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:11:35.195 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.392 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:11:35.195 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.471 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:11:35.274 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.474 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:11:35.277 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:40.479 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:11:35.350 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:08:41.044 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13273 0.13 MB/sec execute 403 sec latency 363.321 ms 2024-02-17T13:08:42.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13397 0.13 MB/sec execute 404 sec latency 343.809 ms 2024-02-17T13:08:43.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13415 0.13 MB/sec execute 405 sec latency 339.050 ms 2024-02-17T13:08:44.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13476 0.13 MB/sec execute 406 sec latency 299.332 ms 2024-02-17T13:08:45.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13546 0.13 MB/sec execute 407 sec latency 308.201 ms 2024-02-17T13:08:46.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13581 0.14 MB/sec execute 408 sec latency 162.271 ms 2024-02-17T13:08:47.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13616 0.14 MB/sec execute 409 sec latency 304.073 ms 2024-02-17T13:08:48.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13627 0.14 MB/sec execute 410 sec latency 393.446 ms 2024-02-17T13:08:49.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13646 0.13 MB/sec execute 411 sec latency 291.295 ms 2024-02-17T13:08:50.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13674 0.13 MB/sec execute 412 sec latency 222.017 ms 2024-02-17T13:08:51.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13820 0.14 MB/sec execute 413 sec latency 388.893 ms 2024-02-17T13:08:52.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13840 0.14 MB/sec execute 414 sec latency 316.260 ms 2024-02-17T13:08:53.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13915 0.14 MB/sec execute 415 sec latency 210.507 ms 2024-02-17T13:08:54.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13929 0.14 MB/sec execute 416 sec latency 309.734 ms 2024-02-17T13:08:55.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13932 0.14 MB/sec execute 417 sec latency 410.206 ms 2024-02-17T13:08:56.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13936 0.14 MB/sec execute 418 sec latency 336.628 ms 2024-02-17T13:08:57.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13941 0.14 MB/sec execute 419 sec latency 392.288 ms 2024-02-17T13:08:58.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13944 0.14 MB/sec execute 420 sec latency 320.341 ms 2024-02-17T13:08:59.045 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13952 0.14 MB/sec execute 421 sec latency 362.431 ms 2024-02-17T13:09:00.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13957 0.14 MB/sec execute 422 sec latency 308.270 ms 2024-02-17T13:09:01.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13960 0.14 MB/sec execute 423 sec latency 304.137 ms 2024-02-17T13:09:02.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13965 0.14 MB/sec execute 424 sec latency 312.519 ms 2024-02-17T13:09:02.890 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:09:02.893 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:09:03.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13968 0.13 MB/sec execute 425 sec latency 309.860 ms 2024-02-17T13:09:04.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13972 0.13 MB/sec execute 426 sec latency 309.650 ms 2024-02-17T13:09:05.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13975 0.13 MB/sec execute 427 sec latency 401.841 ms 2024-02-17T13:09:06.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13981 0.13 MB/sec execute 428 sec latency 304.120 ms 2024-02-17T13:09:07.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13984 0.13 MB/sec execute 429 sec latency 328.671 ms 2024-02-17T13:09:08.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 13992 0.13 MB/sec execute 430 sec latency 307.765 ms 2024-02-17T13:09:09.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14021 0.13 MB/sec execute 431 sec latency 135.703 ms 2024-02-17T13:09:10.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14042 0.13 MB/sec execute 432 sec latency 312.313 ms 2024-02-17T13:09:11.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14141 0.14 MB/sec execute 433 sec latency 302.417 ms 2024-02-17T13:09:12.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14177 0.14 MB/sec execute 434 sec latency 120.399 ms 2024-02-17T13:09:13.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14203 0.14 MB/sec execute 435 sec latency 303.187 ms 2024-02-17T13:09:14.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14218 0.14 MB/sec execute 436 sec latency 305.285 ms 2024-02-17T13:09:15.046 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14234 0.14 MB/sec execute 437 sec latency 454.873 ms 2024-02-17T13:09:16.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14283 0.14 MB/sec execute 438 sec latency 143.876 ms 2024-02-17T13:09:17.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14307 0.14 MB/sec execute 439 sec latency 318.798 ms 2024-02-17T13:09:18.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14325 0.14 MB/sec execute 440 sec latency 321.574 ms 2024-02-17T13:09:19.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14342 0.14 MB/sec execute 441 sec latency 298.413 ms 2024-02-17T13:09:20.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14397 0.14 MB/sec execute 442 sec latency 132.552 ms 2024-02-17T13:09:21.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14412 0.14 MB/sec execute 443 sec latency 292.014 ms 2024-02-17T13:09:22.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14429 0.14 MB/sec execute 444 sec latency 250.202 ms 2024-02-17T13:09:23.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14438 0.14 MB/sec execute 445 sec latency 257.232 ms 2024-02-17T13:09:24.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14453 0.14 MB/sec execute 446 sec latency 212.334 ms 2024-02-17T13:09:25.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14468 0.14 MB/sec execute 447 sec latency 184.216 ms 2024-02-17T13:09:26.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14483 0.14 MB/sec execute 448 sec latency 286.355 ms 2024-02-17T13:09:27.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14502 0.14 MB/sec execute 449 sec latency 289.770 ms 2024-02-17T13:09:28.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14515 0.14 MB/sec execute 450 sec latency 308.986 ms 2024-02-17T13:09:29.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14535 0.14 MB/sec execute 451 sec latency 296.449 ms 2024-02-17T13:09:30.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14553 0.14 MB/sec execute 452 sec latency 299.849 ms 2024-02-17T13:09:31.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14566 0.14 MB/sec execute 453 sec latency 287.902 ms 2024-02-17T13:09:32.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14578 0.14 MB/sec execute 454 sec latency 173.919 ms 2024-02-17T13:09:33.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:09:33.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:09:33.047 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14591 0.14 MB/sec execute 455 sec latency 186.139 ms 2024-02-17T13:09:34.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14608 0.14 MB/sec execute 456 sec latency 146.588 ms 2024-02-17T13:09:35.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14623 0.14 MB/sec execute 457 sec latency 162.605 ms 2024-02-17T13:09:36.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14641 0.14 MB/sec execute 458 sec latency 160.782 ms 2024-02-17T13:09:37.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14657 0.14 MB/sec execute 459 sec latency 179.623 ms 2024-02-17T13:09:38.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14670 0.13 MB/sec execute 460 sec latency 330.643 ms 2024-02-17T13:09:39.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14678 0.13 MB/sec execute 461 sec latency 324.202 ms 2024-02-17T13:09:40.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14697 0.13 MB/sec execute 462 sec latency 281.570 ms 2024-02-17T13:09:41.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14710 0.13 MB/sec execute 463 sec latency 291.171 ms 2024-02-17T13:09:42.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14736 0.13 MB/sec execute 464 sec latency 304.215 ms 2024-02-17T13:09:43.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14757 0.13 MB/sec execute 465 sec latency 213.434 ms 2024-02-17T13:09:44.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14789 0.13 MB/sec execute 466 sec latency 90.340 ms 2024-02-17T13:09:45.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14798 0.13 MB/sec execute 467 sec latency 399.607 ms 2024-02-17T13:09:46.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14812 0.13 MB/sec execute 468 sec latency 325.782 ms 2024-02-17T13:09:47.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14852 0.13 MB/sec execute 469 sec latency 345.893 ms 2024-02-17T13:09:48.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14861 0.13 MB/sec execute 470 sec latency 323.049 ms 2024-02-17T13:09:49.048 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14888 0.13 MB/sec execute 471 sec latency 350.470 ms 2024-02-17T13:09:50.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14917 0.13 MB/sec execute 472 sec latency 319.296 ms 2024-02-17T13:09:51.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14951 0.13 MB/sec execute 473 sec latency 261.306 ms 2024-02-17T13:09:52.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 14985 0.13 MB/sec execute 474 sec latency 314.981 ms 2024-02-17T13:09:53.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15019 0.13 MB/sec execute 475 sec latency 292.460 ms 2024-02-17T13:09:54.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15029 0.13 MB/sec execute 476 sec latency 321.976 ms 2024-02-17T13:09:55.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15060 0.13 MB/sec execute 477 sec latency 448.996 ms 2024-02-17T13:09:56.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15082 0.13 MB/sec execute 478 sec latency 530.122 ms 2024-02-17T13:09:57.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15109 0.13 MB/sec execute 479 sec latency 309.331 ms 2024-02-17T13:09:58.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15134 0.13 MB/sec execute 480 sec latency 309.424 ms 2024-02-17T13:09:59.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15141 0.13 MB/sec execute 481 sec latency 324.954 ms 2024-02-17T13:10:00.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15174 0.13 MB/sec execute 482 sec latency 317.116 ms 2024-02-17T13:10:01.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15199 0.13 MB/sec execute 483 sec latency 260.156 ms 2024-02-17T13:10:02.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15238 0.13 MB/sec execute 484 sec latency 320.744 ms 2024-02-17T13:10:03.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15252 0.13 MB/sec execute 485 sec latency 315.198 ms 2024-02-17T13:10:03.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:10:03.179 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:10:04.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15268 0.13 MB/sec execute 486 sec latency 311.336 ms 2024-02-17T13:10:05.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15303 0.13 MB/sec execute 487 sec latency 468.338 ms 2024-02-17T13:10:06.049 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15321 0.13 MB/sec execute 488 sec latency 297.783 ms 2024-02-17T13:10:07.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15360 0.13 MB/sec execute 489 sec latency 191.695 ms 2024-02-17T13:10:08.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15372 0.13 MB/sec execute 490 sec latency 292.475 ms 2024-02-17T13:10:09.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15383 0.13 MB/sec execute 491 sec latency 314.202 ms 2024-02-17T13:10:10.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15417 0.13 MB/sec execute 492 sec latency 356.016 ms 2024-02-17T13:10:11.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15451 0.13 MB/sec execute 493 sec latency 273.916 ms 2024-02-17T13:10:12.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15482 0.13 MB/sec execute 494 sec latency 306.616 ms 2024-02-17T13:10:13.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15498 0.13 MB/sec execute 495 sec latency 352.082 ms 2024-02-17T13:10:14.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15583 0.14 MB/sec execute 496 sec latency 297.560 ms 2024-02-17T13:10:15.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15598 0.13 MB/sec execute 497 sec latency 385.754 ms 2024-02-17T13:10:16.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15620 0.13 MB/sec execute 498 sec latency 319.961 ms 2024-02-17T13:10:17.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15650 0.13 MB/sec execute 499 sec latency 212.988 ms 2024-02-17T13:10:18.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15668 0.13 MB/sec execute 500 sec latency 387.022 ms 2024-02-17T13:10:19.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15692 0.13 MB/sec execute 501 sec latency 334.119 ms 2024-02-17T13:10:20.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15725 0.13 MB/sec execute 502 sec latency 286.408 ms 2024-02-17T13:10:21.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15753 0.13 MB/sec execute 503 sec latency 307.334 ms 2024-02-17T13:10:22.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15771 0.13 MB/sec execute 504 sec latency 312.726 ms 2024-02-17T13:10:23.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15798 0.13 MB/sec execute 505 sec latency 281.686 ms 2024-02-17T13:10:24.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15815 0.13 MB/sec execute 506 sec latency 287.232 ms 2024-02-17T13:10:25.050 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15842 0.13 MB/sec execute 507 sec latency 324.174 ms 2024-02-17T13:10:26.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15863 0.13 MB/sec execute 508 sec latency 316.770 ms 2024-02-17T13:10:27.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15899 0.13 MB/sec execute 509 sec latency 304.981 ms 2024-02-17T13:10:28.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15932 0.13 MB/sec execute 510 sec latency 300.169 ms 2024-02-17T13:10:29.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 15980 0.13 MB/sec execute 511 sec latency 280.835 ms 2024-02-17T13:10:30.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16021 0.13 MB/sec execute 512 sec latency 308.083 ms 2024-02-17T13:10:31.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16035 0.13 MB/sec execute 513 sec latency 316.060 ms 2024-02-17T13:10:32.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16059 0.13 MB/sec execute 514 sec latency 288.738 ms 2024-02-17T13:10:33.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16070 0.13 MB/sec execute 515 sec latency 302.200 ms 2024-02-17T13:10:33.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:10:33.343 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:10:34.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16104 0.13 MB/sec execute 516 sec latency 360.485 ms 2024-02-17T13:10:35.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16119 0.13 MB/sec execute 517 sec latency 431.579 ms 2024-02-17T13:10:36.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16174 0.13 MB/sec execute 518 sec latency 294.538 ms 2024-02-17T13:10:37.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16199 0.13 MB/sec execute 519 sec latency 325.951 ms 2024-02-17T13:10:38.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16241 0.13 MB/sec execute 520 sec latency 301.177 ms 2024-02-17T13:10:39.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16255 0.13 MB/sec execute 521 sec latency 298.767 ms 2024-02-17T13:10:40.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16279 0.13 MB/sec execute 522 sec latency 313.858 ms 2024-02-17T13:10:41.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16294 0.13 MB/sec execute 523 sec latency 311.583 ms 2024-02-17T13:10:42.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16338 0.13 MB/sec execute 524 sec latency 365.254 ms 2024-02-17T13:10:43.051 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16371 0.13 MB/sec execute 525 sec latency 370.042 ms 2024-02-17T13:10:44.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16380 0.13 MB/sec execute 526 sec latency 333.455 ms 2024-02-17T13:10:45.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16415 0.13 MB/sec execute 527 sec latency 319.403 ms 2024-02-17T13:10:46.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16481 0.13 MB/sec execute 528 sec latency 325.486 ms 2024-02-17T13:10:47.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16502 0.13 MB/sec execute 529 sec latency 304.722 ms 2024-02-17T13:10:48.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16517 0.13 MB/sec execute 530 sec latency 464.173 ms 2024-02-17T13:10:49.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16531 0.13 MB/sec execute 531 sec latency 351.678 ms 2024-02-17T13:10:50.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16554 0.13 MB/sec execute 532 sec latency 297.294 ms 2024-02-17T13:10:51.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16562 0.13 MB/sec execute 533 sec latency 304.791 ms 2024-02-17T13:10:52.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16567 0.13 MB/sec execute 534 sec latency 425.609 ms 2024-02-17T13:10:53.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16591 0.13 MB/sec execute 535 sec latency 317.278 ms 2024-02-17T13:10:54.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16612 0.13 MB/sec execute 536 sec latency 309.434 ms 2024-02-17T13:10:55.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16628 0.13 MB/sec execute 537 sec latency 459.151 ms 2024-02-17T13:10:56.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16645 0.13 MB/sec execute 538 sec latency 290.496 ms 2024-02-17T13:10:57.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16675 0.13 MB/sec execute 539 sec latency 323.415 ms 2024-02-17T13:10:58.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16691 0.13 MB/sec execute 540 sec latency 295.906 ms 2024-02-17T13:10:59.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16744 0.13 MB/sec execute 541 sec latency 307.494 ms 2024-02-17T13:11:00.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16755 0.13 MB/sec execute 542 sec latency 303.578 ms 2024-02-17T13:11:01.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16776 0.13 MB/sec execute 543 sec latency 325.873 ms 2024-02-17T13:11:02.052 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16795 0.13 MB/sec execute 544 sec latency 315.330 ms 2024-02-17T13:11:03.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16810 0.13 MB/sec execute 545 sec latency 281.335 ms 2024-02-17T13:11:03.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:11:03.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:11:04.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16816 0.13 MB/sec execute 546 sec latency 313.822 ms 2024-02-17T13:11:05.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16939 0.13 MB/sec execute 547 sec latency 440.522 ms 2024-02-17T13:11:06.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16954 0.13 MB/sec execute 548 sec latency 318.716 ms 2024-02-17T13:11:07.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 16973 0.13 MB/sec execute 549 sec latency 277.191 ms 2024-02-17T13:11:08.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17073 0.13 MB/sec execute 550 sec latency 300.073 ms 2024-02-17T13:11:09.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17118 0.14 MB/sec execute 551 sec latency 165.546 ms 2024-02-17T13:11:10.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17158 0.14 MB/sec execute 552 sec latency 297.963 ms 2024-02-17T13:11:11.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17168 0.13 MB/sec execute 553 sec latency 314.077 ms 2024-02-17T13:11:12.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17186 0.13 MB/sec execute 554 sec latency 269.020 ms 2024-02-17T13:11:13.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17215 0.13 MB/sec execute 555 sec latency 306.120 ms 2024-02-17T13:11:14.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17361 0.14 MB/sec execute 556 sec latency 344.949 ms 2024-02-17T13:11:15.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17380 0.14 MB/sec execute 557 sec latency 410.936 ms 2024-02-17T13:11:16.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17438 0.14 MB/sec execute 558 sec latency 466.478 ms 2024-02-17T13:11:17.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17472 0.14 MB/sec execute 559 sec latency 296.357 ms 2024-02-17T13:11:18.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17475 0.14 MB/sec execute 560 sec latency 316.340 ms 2024-02-17T13:11:19.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17479 0.14 MB/sec execute 561 sec latency 351.248 ms 2024-02-17T13:11:20.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17484 0.14 MB/sec execute 562 sec latency 329.914 ms 2024-02-17T13:11:21.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17487 0.14 MB/sec execute 563 sec latency 360.632 ms 2024-02-17T13:11:22.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17495 0.14 MB/sec execute 564 sec latency 433.535 ms 2024-02-17T13:11:23.053 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17500 0.14 MB/sec execute 565 sec latency 336.525 ms 2024-02-17T13:11:24.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17503 0.13 MB/sec execute 566 sec latency 318.614 ms 2024-02-17T13:11:25.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17506 0.13 MB/sec execute 567 sec latency 463.518 ms 2024-02-17T13:11:26.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17510 0.13 MB/sec execute 568 sec latency 303.260 ms 2024-02-17T13:11:27.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17514 0.13 MB/sec execute 569 sec latency 309.617 ms 2024-02-17T13:11:28.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17518 0.13 MB/sec execute 570 sec latency 300.607 ms 2024-02-17T13:11:29.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17523 0.13 MB/sec execute 571 sec latency 303.144 ms 2024-02-17T13:11:30.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17526 0.13 MB/sec execute 572 sec latency 296.204 ms 2024-02-17T13:11:31.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17531 0.13 MB/sec execute 573 sec latency 296.285 ms 2024-02-17T13:11:32.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17557 0.13 MB/sec execute 574 sec latency 127.627 ms 2024-02-17T13:11:33.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17583 0.13 MB/sec execute 575 sec latency 197.422 ms 2024-02-17T13:11:33.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:11:33.714 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:11:34.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17589 0.13 MB/sec execute 576 sec latency 317.014 ms 2024-02-17T13:11:35.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17714 0.14 MB/sec execute 577 sec latency 290.768 ms 2024-02-17T13:11:36.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17739 0.14 MB/sec execute 578 sec latency 282.813 ms 2024-02-17T13:11:37.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17757 0.14 MB/sec execute 579 sec latency 298.756 ms 2024-02-17T13:11:38.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17773 0.14 MB/sec execute 580 sec latency 311.364 ms 2024-02-17T13:11:39.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17825 0.14 MB/sec execute 581 sec latency 299.370 ms 2024-02-17T13:11:40.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17850 0.14 MB/sec execute 582 sec latency 308.243 ms 2024-02-17T13:11:41.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17869 0.14 MB/sec execute 583 sec latency 301.223 ms 2024-02-17T13:11:42.054 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17888 0.14 MB/sec execute 584 sec latency 314.053 ms 2024-02-17T13:11:43.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17941 0.14 MB/sec execute 585 sec latency 234.787 ms 2024-02-17T13:11:44.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17962 0.14 MB/sec execute 586 sec latency 294.991 ms 2024-02-17T13:11:45.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17973 0.14 MB/sec execute 587 sec latency 236.136 ms 2024-02-17T13:11:46.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 17984 0.14 MB/sec execute 588 sec latency 228.048 ms 2024-02-17T13:11:47.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18002 0.14 MB/sec execute 589 sec latency 178.992 ms 2024-02-17T13:11:48.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18019 0.14 MB/sec execute 590 sec latency 172.785 ms 2024-02-17T13:11:49.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18035 0.14 MB/sec execute 591 sec latency 153.312 ms 2024-02-17T13:11:50.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18051 0.14 MB/sec execute 592 sec latency 172.103 ms 2024-02-17T13:11:51.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18061 0.14 MB/sec execute 593 sec latency 314.843 ms 2024-02-17T13:11:52.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18081 0.14 MB/sec execute 594 sec latency 291.854 ms 2024-02-17T13:11:53.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18098 0.14 MB/sec execute 595 sec latency 301.605 ms 2024-02-17T13:11:54.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18115 0.14 MB/sec execute 596 sec latency 180.380 ms 2024-02-17T13:11:55.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18127 0.14 MB/sec execute 597 sec latency 195.362 ms 2024-02-17T13:11:56.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18142 0.14 MB/sec execute 598 sec latency 181.382 ms 2024-02-17T13:11:57.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 18158 0.14 MB/sec execute 599 sec latency 152.293 ms 2024-02-17T13:11:58.055 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 600 sec 2024-02-17T13:11:59.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 601 sec 2024-02-17T13:12:00.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 602 sec 2024-02-17T13:12:01.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 603 sec 2024-02-17T13:12:02.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 604 sec 2024-02-17T13:12:03.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 605 sec 2024-02-17T13:12:03.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:12:03.771 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:12:04.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 606 sec 2024-02-17T13:12:05.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 607 sec 2024-02-17T13:12:06.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 608 sec 2024-02-17T13:12:07.056 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 609 sec 2024-02-17T13:12:07.109 INFO:tasks.workunit.client.0.smithi136.stdout: 0 cleanup 609 sec 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Operation Count AvgLat MaxLat 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: ---------------------------------------- 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: NTCreateX 2604 64.770 331.225 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Close 1887 1.172 9.660 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Rename 108 183.547 369.380 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Unlink 536 70.118 183.283 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Qpathinfo 2334 34.823 425.601 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Qfileinfo 395 0.958 1.576 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Qfsinfo 434 6.231 85.082 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Sfileinfo 200 11.635 15.025 2024-02-17T13:12:07.110 INFO:tasks.workunit.client.0.smithi136.stdout: Find 877 309.451 582.897 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout: WriteX 1252 4.026 110.075 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout: ReadX 3999 0.025 2.972 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout: LockX 8 15.307 16.731 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout: UnlockX 8 13.893 15.214 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout: Flush 172 47.864 136.996 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stdout:Throughput 0.135393 MB/sec 1 clients 1 procs max_latency=582.902 ms 2024-02-17T13:12:07.111 INFO:tasks.workunit.client.0.smithi136.stderr:+ dbench 10 2024-02-17T13:12:07.112 INFO:tasks.workunit.client.0.smithi136.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-02-17T13:12:07.112 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-02-17T13:12:07.112 INFO:tasks.workunit.client.0.smithi136.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-02-17T13:12:07.112 INFO:tasks.workunit.client.0.smithi136.stdout:8 of 10 processes prepared for launch 0 sec 2024-02-17T13:12:07.211 INFO:tasks.workunit.client.0.smithi136.stdout:10 of 10 processes prepared for launch 0 sec 2024-02-17T13:12:07.212 INFO:tasks.workunit.client.0.smithi136.stdout:releasing clients 2024-02-17T13:12:08.212 INFO:tasks.workunit.client.0.smithi136.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.862 ms 2024-02-17T13:12:09.212 INFO:tasks.workunit.client.0.smithi136.stdout: 1 7 0.52 MB/sec warmup 2 sec latency 1999.933 ms 2024-02-17T13:12:10.212 INFO:tasks.workunit.client.0.smithi136.stdout: 4 16 1.75 MB/sec warmup 3 sec latency 2449.511 ms 2024-02-17T13:12:11.212 INFO:tasks.workunit.client.0.smithi136.stdout: 4 28 2.47 MB/sec warmup 4 sec latency 725.565 ms 2024-02-17T13:12:12.212 INFO:tasks.workunit.client.0.smithi136.stdout: 4 35 2.60 MB/sec warmup 5 sec latency 825.176 ms 2024-02-17T13:12:13.212 INFO:tasks.workunit.client.0.smithi136.stdout: 9 52 3.60 MB/sec warmup 6 sec latency 772.522 ms 2024-02-17T13:12:14.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 68 4.24 MB/sec warmup 7 sec latency 787.036 ms 2024-02-17T13:12:15.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 82 4.59 MB/sec warmup 8 sec latency 745.874 ms 2024-02-17T13:12:16.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 95 4.78 MB/sec warmup 9 sec latency 948.687 ms 2024-02-17T13:12:17.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 109 4.98 MB/sec warmup 10 sec latency 1064.421 ms 2024-02-17T13:12:18.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 120 4.98 MB/sec warmup 11 sec latency 1202.462 ms 2024-02-17T13:12:19.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 124 4.67 MB/sec warmup 12 sec latency 1074.478 ms 2024-02-17T13:12:20.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 131 4.47 MB/sec warmup 13 sec latency 1126.880 ms 2024-02-17T13:12:21.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 138 4.32 MB/sec warmup 14 sec latency 1550.933 ms 2024-02-17T13:12:22.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 143 4.12 MB/sec warmup 15 sec latency 1258.708 ms 2024-02-17T13:12:23.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 148 3.96 MB/sec warmup 16 sec latency 1555.076 ms 2024-02-17T13:12:24.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 154 3.81 MB/sec warmup 17 sec latency 1126.307 ms 2024-02-17T13:12:25.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 157 3.66 MB/sec warmup 18 sec latency 1544.569 ms 2024-02-17T13:12:26.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 163 3.57 MB/sec warmup 19 sec latency 1884.116 ms 2024-02-17T13:12:27.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 166 3.44 MB/sec warmup 20 sec latency 2042.386 ms 2024-02-17T13:12:28.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 171 3.35 MB/sec warmup 21 sec latency 1476.583 ms 2024-02-17T13:12:29.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 177 3.27 MB/sec warmup 22 sec latency 1385.401 ms 2024-02-17T13:12:30.212 INFO:tasks.workunit.client.0.smithi136.stdout: 10 182 3.20 MB/sec warmup 23 sec latency 1439.715 ms 2024-02-17T13:12:31.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 188 3.15 MB/sec warmup 24 sec latency 1614.393 ms 2024-02-17T13:12:32.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 195 3.10 MB/sec warmup 25 sec latency 2070.212 ms 2024-02-17T13:12:33.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 199 3.04 MB/sec warmup 26 sec latency 1260.714 ms 2024-02-17T13:12:33.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:12:33.901 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:12:34.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 206 2.99 MB/sec warmup 27 sec latency 1216.487 ms 2024-02-17T13:12:35.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 212 2.97 MB/sec warmup 28 sec latency 1285.990 ms 2024-02-17T13:12:36.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 216 2.90 MB/sec warmup 29 sec latency 1804.964 ms 2024-02-17T13:12:37.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 220 2.84 MB/sec warmup 30 sec latency 1830.067 ms 2024-02-17T13:12:38.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 226 2.82 MB/sec warmup 31 sec latency 1279.896 ms 2024-02-17T13:12:39.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 234 2.81 MB/sec warmup 32 sec latency 1616.622 ms 2024-02-17T13:12:40.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 237 2.76 MB/sec warmup 33 sec latency 1523.583 ms 2024-02-17T13:12:41.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 243 2.73 MB/sec warmup 34 sec latency 1853.053 ms 2024-02-17T13:12:42.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 250 2.72 MB/sec warmup 35 sec latency 1537.466 ms 2024-02-17T13:12:43.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 253 2.67 MB/sec warmup 36 sec latency 1505.286 ms 2024-02-17T13:12:44.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 261 2.67 MB/sec warmup 37 sec latency 1994.449 ms 2024-02-17T13:12:45.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 264 2.63 MB/sec warmup 38 sec latency 1674.442 ms 2024-02-17T13:12:46.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 269 2.60 MB/sec warmup 39 sec latency 2398.275 ms 2024-02-17T13:12:47.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 272 2.55 MB/sec warmup 40 sec latency 2412.935 ms 2024-02-17T13:12:48.213 INFO:tasks.workunit.client.0.smithi136.stdout: 10 278 2.53 MB/sec warmup 41 sec latency 2524.523 ms 2024-02-17T13:12:48.390 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:15:43.258 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.442 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:15:43.240 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.443 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:15:43.242 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.445 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:15:43.314 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.497 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:15:43.296 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.498 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:15:43.297 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.533 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:15:43.332 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.537 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:15:43.405 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:48.588 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:15:43.387 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:12:49.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 282 2.50 MB/sec warmup 42 sec latency 1842.102 ms 2024-02-17T13:12:50.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 289 2.50 MB/sec warmup 43 sec latency 1800.560 ms 2024-02-17T13:12:51.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 291 2.45 MB/sec warmup 44 sec latency 1654.530 ms 2024-02-17T13:12:52.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 298 2.45 MB/sec warmup 45 sec latency 1998.654 ms 2024-02-17T13:12:53.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 302 2.42 MB/sec warmup 46 sec latency 1755.380 ms 2024-02-17T13:12:54.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 308 2.41 MB/sec warmup 47 sec latency 1717.843 ms 2024-02-17T13:12:55.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 311 2.38 MB/sec warmup 48 sec latency 1731.828 ms 2024-02-17T13:12:56.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 319 2.38 MB/sec warmup 49 sec latency 1371.714 ms 2024-02-17T13:12:57.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 322 2.35 MB/sec warmup 50 sec latency 1820.164 ms 2024-02-17T13:12:58.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 326 2.33 MB/sec warmup 51 sec latency 2080.293 ms 2024-02-17T13:12:59.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 333 2.32 MB/sec warmup 52 sec latency 1572.782 ms 2024-02-17T13:13:00.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 337 2.30 MB/sec warmup 53 sec latency 1454.431 ms 2024-02-17T13:13:01.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 340 2.28 MB/sec warmup 54 sec latency 1781.218 ms 2024-02-17T13:13:02.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 348 2.28 MB/sec warmup 55 sec latency 1564.487 ms 2024-02-17T13:13:03.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 354 2.27 MB/sec warmup 56 sec latency 1454.223 ms 2024-02-17T13:13:04.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:13:04.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:13:04.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 358 2.26 MB/sec warmup 57 sec latency 1348.209 ms 2024-02-17T13:13:05.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 363 2.24 MB/sec warmup 58 sec latency 1627.942 ms 2024-02-17T13:13:06.214 INFO:tasks.workunit.client.0.smithi136.stdout: 10 368 2.23 MB/sec warmup 59 sec latency 1672.866 ms 2024-02-17T13:13:07.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 371 2.21 MB/sec warmup 60 sec latency 2207.202 ms 2024-02-17T13:13:08.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 377 2.20 MB/sec warmup 61 sec latency 2154.034 ms 2024-02-17T13:13:09.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 382 2.20 MB/sec warmup 62 sec latency 1693.826 ms 2024-02-17T13:13:10.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 388 2.19 MB/sec warmup 63 sec latency 1783.272 ms 2024-02-17T13:13:11.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 392 2.18 MB/sec warmup 64 sec latency 1478.505 ms 2024-02-17T13:13:12.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 398 2.17 MB/sec warmup 65 sec latency 2044.223 ms 2024-02-17T13:13:13.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 401 2.15 MB/sec warmup 66 sec latency 1821.768 ms 2024-02-17T13:13:14.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 409 2.16 MB/sec warmup 67 sec latency 1379.164 ms 2024-02-17T13:13:15.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 414 2.16 MB/sec warmup 68 sec latency 1665.183 ms 2024-02-17T13:13:16.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 417 2.14 MB/sec warmup 69 sec latency 1779.828 ms 2024-02-17T13:13:17.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 421 2.13 MB/sec warmup 70 sec latency 2285.330 ms 2024-02-17T13:13:18.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 427 2.12 MB/sec warmup 71 sec latency 2591.576 ms 2024-02-17T13:13:19.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 429 2.10 MB/sec warmup 72 sec latency 2195.788 ms 2024-02-17T13:13:20.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 436 2.10 MB/sec warmup 73 sec latency 1707.001 ms 2024-02-17T13:13:21.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 439 2.09 MB/sec warmup 74 sec latency 1915.970 ms 2024-02-17T13:13:22.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 445 2.09 MB/sec warmup 75 sec latency 2432.022 ms 2024-02-17T13:13:23.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 449 2.08 MB/sec warmup 76 sec latency 2050.889 ms 2024-02-17T13:13:24.215 INFO:tasks.workunit.client.0.smithi136.stdout: 10 454 2.07 MB/sec warmup 77 sec latency 1709.842 ms 2024-02-17T13:13:25.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 460 2.07 MB/sec warmup 78 sec latency 1817.686 ms 2024-02-17T13:13:26.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 463 2.06 MB/sec warmup 79 sec latency 1876.995 ms 2024-02-17T13:13:27.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 467 2.04 MB/sec warmup 80 sec latency 2218.385 ms 2024-02-17T13:13:28.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 474 2.05 MB/sec warmup 81 sec latency 2340.176 ms 2024-02-17T13:13:29.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 476 2.03 MB/sec warmup 82 sec latency 1828.643 ms 2024-02-17T13:13:30.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 485 2.05 MB/sec warmup 83 sec latency 2004.343 ms 2024-02-17T13:13:31.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 493 2.05 MB/sec warmup 84 sec latency 1858.024 ms 2024-02-17T13:13:32.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 497 2.04 MB/sec warmup 85 sec latency 2226.791 ms 2024-02-17T13:13:33.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 502 2.04 MB/sec warmup 86 sec latency 2266.177 ms 2024-02-17T13:13:34.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:13:34.096 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:13:34.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 504 2.02 MB/sec warmup 87 sec latency 3266.205 ms 2024-02-17T13:13:35.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 510 2.02 MB/sec warmup 88 sec latency 4266.231 ms 2024-02-17T13:13:36.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 512 2.00 MB/sec warmup 89 sec latency 5092.623 ms 2024-02-17T13:13:37.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 516 2.00 MB/sec warmup 90 sec latency 2327.166 ms 2024-02-17T13:13:38.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 522 2.00 MB/sec warmup 91 sec latency 2428.515 ms 2024-02-17T13:13:39.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 536 2.02 MB/sec warmup 92 sec latency 1754.150 ms 2024-02-17T13:13:40.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 547 2.04 MB/sec warmup 93 sec latency 2754.179 ms 2024-02-17T13:13:41.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 559 2.06 MB/sec warmup 94 sec latency 3754.210 ms 2024-02-17T13:13:42.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 566 2.07 MB/sec warmup 95 sec latency 3989.044 ms 2024-02-17T13:13:43.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 578 2.09 MB/sec warmup 96 sec latency 2828.400 ms 2024-02-17T13:13:44.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 592 2.10 MB/sec warmup 97 sec latency 2627.987 ms 2024-02-17T13:13:45.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 601 2.11 MB/sec warmup 98 sec latency 2986.408 ms 2024-02-17T13:13:46.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 604 2.10 MB/sec warmup 99 sec latency 3298.301 ms 2024-02-17T13:13:47.216 INFO:tasks.workunit.client.0.smithi136.stdout: 10 611 2.10 MB/sec warmup 100 sec latency 3988.597 ms 2024-02-17T13:13:48.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 613 2.08 MB/sec warmup 101 sec latency 3405.197 ms 2024-02-17T13:13:49.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 614 2.06 MB/sec warmup 102 sec latency 3708.281 ms 2024-02-17T13:13:50.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 624 2.04 MB/sec warmup 103 sec latency 2636.888 ms 2024-02-17T13:13:51.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 628 2.02 MB/sec warmup 104 sec latency 2899.969 ms 2024-02-17T13:13:52.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 629 2.00 MB/sec warmup 105 sec latency 2967.280 ms 2024-02-17T13:13:53.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 636 1.98 MB/sec warmup 106 sec latency 2822.110 ms 2024-02-17T13:13:54.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 642 1.97 MB/sec warmup 107 sec latency 2445.936 ms 2024-02-17T13:13:55.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 645 1.95 MB/sec warmup 108 sec latency 2550.559 ms 2024-02-17T13:13:56.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 647 1.93 MB/sec warmup 109 sec latency 2926.333 ms 2024-02-17T13:13:57.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 650 1.92 MB/sec warmup 110 sec latency 2997.372 ms 2024-02-17T13:13:58.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 651 1.90 MB/sec warmup 111 sec latency 3147.220 ms 2024-02-17T13:13:59.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 653 1.88 MB/sec warmup 112 sec latency 3169.925 ms 2024-02-17T13:14:00.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 654 1.87 MB/sec warmup 113 sec latency 2640.614 ms 2024-02-17T13:14:01.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 659 1.85 MB/sec warmup 114 sec latency 2957.763 ms 2024-02-17T13:14:02.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 664 1.84 MB/sec warmup 115 sec latency 3243.544 ms 2024-02-17T13:14:03.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 667 1.82 MB/sec warmup 116 sec latency 3214.622 ms 2024-02-17T13:14:04.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:14:04.164 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:14:04.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 672 1.81 MB/sec warmup 117 sec latency 3056.673 ms 2024-02-17T13:14:05.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 676 1.79 MB/sec warmup 118 sec latency 2707.543 ms 2024-02-17T13:14:06.217 INFO:tasks.workunit.client.0.smithi136.stdout: 10 679 1.78 MB/sec warmup 119 sec latency 2996.485 ms 2024-02-17T13:14:08.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 687 0.05 MB/sec execute 1 sec latency 3050.390 ms 2024-02-17T13:14:09.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 694 0.06 MB/sec execute 2 sec latency 2925.332 ms 2024-02-17T13:14:10.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 697 0.04 MB/sec execute 3 sec latency 2513.199 ms 2024-02-17T13:14:11.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 702 0.04 MB/sec execute 4 sec latency 3060.069 ms 2024-02-17T13:14:12.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 703 0.03 MB/sec execute 5 sec latency 3393.798 ms 2024-02-17T13:14:13.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 708 0.06 MB/sec execute 6 sec latency 4122.330 ms 2024-02-17T13:14:14.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 713 0.08 MB/sec execute 7 sec latency 4637.313 ms 2024-02-17T13:14:15.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 719 0.08 MB/sec execute 8 sec latency 3633.240 ms 2024-02-17T13:14:16.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 727 0.10 MB/sec execute 9 sec latency 3810.928 ms 2024-02-17T13:14:17.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 729 0.09 MB/sec execute 10 sec latency 3214.547 ms 2024-02-17T13:14:18.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 733 0.08 MB/sec execute 11 sec latency 4181.453 ms 2024-02-17T13:14:19.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 739 0.10 MB/sec execute 12 sec latency 3963.632 ms 2024-02-17T13:14:20.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 744 0.10 MB/sec execute 13 sec latency 4351.259 ms 2024-02-17T13:14:21.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 746 0.09 MB/sec execute 14 sec latency 3924.144 ms 2024-02-17T13:14:22.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 748 0.09 MB/sec execute 15 sec latency 4197.355 ms 2024-02-17T13:14:23.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 751 0.09 MB/sec execute 16 sec latency 3819.378 ms 2024-02-17T13:14:24.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 759 0.09 MB/sec execute 17 sec latency 3430.215 ms 2024-02-17T13:14:25.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 764 0.09 MB/sec execute 18 sec latency 2707.316 ms 2024-02-17T13:14:26.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 769 0.09 MB/sec execute 19 sec latency 3390.072 ms 2024-02-17T13:14:27.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 773 0.09 MB/sec execute 20 sec latency 3217.143 ms 2024-02-17T13:14:28.218 INFO:tasks.workunit.client.0.smithi136.stdout: 10 777 0.09 MB/sec execute 21 sec latency 3928.699 ms 2024-02-17T13:14:29.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 784 0.10 MB/sec execute 22 sec latency 3300.868 ms 2024-02-17T13:14:30.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 790 0.11 MB/sec execute 23 sec latency 3868.670 ms 2024-02-17T13:14:31.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 796 0.10 MB/sec execute 24 sec latency 3200.557 ms 2024-02-17T13:14:32.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 800 0.11 MB/sec execute 25 sec latency 4200.592 ms 2024-02-17T13:14:33.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 805 0.11 MB/sec execute 26 sec latency 4425.303 ms 2024-02-17T13:14:34.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 808 0.10 MB/sec execute 27 sec latency 4227.480 ms 2024-02-17T13:14:34.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:14:34.341 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:14:35.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 811 0.10 MB/sec execute 28 sec latency 3481.447 ms 2024-02-17T13:14:36.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 813 0.10 MB/sec execute 29 sec latency 3402.631 ms 2024-02-17T13:14:36.733 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:17:31.600 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.741 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:17:31.608 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.777 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:17:31.644 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.789 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:17:31.587 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.794 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:17:31.591 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.796 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:17:31.594 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.799 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:17:31.597 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.850 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:17:31.647 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:36.855 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:17:31.652 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:14:37.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 814 0.10 MB/sec execute 30 sec latency 2909.910 ms 2024-02-17T13:14:38.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 815 0.09 MB/sec execute 31 sec latency 2698.256 ms 2024-02-17T13:14:39.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 819 0.09 MB/sec execute 32 sec latency 2446.384 ms 2024-02-17T13:14:40.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 821 0.09 MB/sec execute 33 sec latency 2614.799 ms 2024-02-17T13:14:41.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 822 0.09 MB/sec execute 34 sec latency 2615.139 ms 2024-02-17T13:14:42.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 824 0.09 MB/sec execute 35 sec latency 2707.500 ms 2024-02-17T13:14:43.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 828 0.09 MB/sec execute 36 sec latency 2667.188 ms 2024-02-17T13:14:44.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 837 0.09 MB/sec execute 37 sec latency 2645.050 ms 2024-02-17T13:14:45.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 844 0.09 MB/sec execute 38 sec latency 2465.045 ms 2024-02-17T13:14:46.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 848 0.09 MB/sec execute 39 sec latency 2686.574 ms 2024-02-17T13:14:47.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 854 0.10 MB/sec execute 40 sec latency 2824.021 ms 2024-02-17T13:14:48.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 854 0.09 MB/sec execute 41 sec latency 2723.240 ms 2024-02-17T13:14:49.219 INFO:tasks.workunit.client.0.smithi136.stdout: 10 857 0.09 MB/sec execute 42 sec latency 2693.542 ms 2024-02-17T13:14:50.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 860 0.09 MB/sec execute 43 sec latency 2648.116 ms 2024-02-17T13:14:51.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 861 0.09 MB/sec execute 44 sec latency 2761.598 ms 2024-02-17T13:14:52.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 861 0.09 MB/sec execute 45 sec latency 3325.577 ms 2024-02-17T13:14:53.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 864 0.09 MB/sec execute 46 sec latency 3315.521 ms 2024-02-17T13:14:54.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 868 0.09 MB/sec execute 47 sec latency 3599.186 ms 2024-02-17T13:14:55.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 871 0.09 MB/sec execute 48 sec latency 3478.428 ms 2024-02-17T13:14:56.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 876 0.09 MB/sec execute 49 sec latency 3166.992 ms 2024-02-17T13:14:57.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 880 0.09 MB/sec execute 50 sec latency 3377.178 ms 2024-02-17T13:14:58.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 884 0.09 MB/sec execute 51 sec latency 3015.528 ms 2024-02-17T13:14:59.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 889 0.09 MB/sec execute 52 sec latency 2753.996 ms 2024-02-17T13:15:00.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 895 0.09 MB/sec execute 53 sec latency 2938.597 ms 2024-02-17T13:15:01.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 897 0.09 MB/sec execute 54 sec latency 3089.085 ms 2024-02-17T13:15:02.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 900 0.09 MB/sec execute 55 sec latency 3266.186 ms 2024-02-17T13:15:03.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 906 0.09 MB/sec execute 56 sec latency 3723.441 ms 2024-02-17T13:15:04.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 910 0.09 MB/sec execute 57 sec latency 3825.500 ms 2024-02-17T13:15:04.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:15:04.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:15:05.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 914 0.09 MB/sec execute 58 sec latency 3837.389 ms 2024-02-17T13:15:06.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 919 0.09 MB/sec execute 59 sec latency 2453.088 ms 2024-02-17T13:15:07.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 921 0.09 MB/sec execute 60 sec latency 3453.136 ms 2024-02-17T13:15:08.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 924 0.10 MB/sec execute 61 sec latency 4242.481 ms 2024-02-17T13:15:09.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 927 0.09 MB/sec execute 62 sec latency 3781.624 ms 2024-02-17T13:15:10.220 INFO:tasks.workunit.client.0.smithi136.stdout: 10 928 0.09 MB/sec execute 63 sec latency 3261.214 ms 2024-02-17T13:15:11.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 928 0.09 MB/sec execute 64 sec latency 2717.440 ms 2024-02-17T13:15:12.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 929 0.09 MB/sec execute 65 sec latency 2780.269 ms 2024-02-17T13:15:13.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 929 0.09 MB/sec execute 66 sec latency 3020.849 ms 2024-02-17T13:15:14.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 930 0.09 MB/sec execute 67 sec latency 2040.310 ms 2024-02-17T13:15:15.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 931 0.09 MB/sec execute 68 sec latency 2198.184 ms 2024-02-17T13:15:16.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 932 0.08 MB/sec execute 69 sec latency 2236.317 ms 2024-02-17T13:15:17.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 935 0.08 MB/sec execute 70 sec latency 2485.158 ms 2024-02-17T13:15:18.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 938 0.08 MB/sec execute 71 sec latency 2611.028 ms 2024-02-17T13:15:19.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 940 0.08 MB/sec execute 72 sec latency 2820.705 ms 2024-02-17T13:15:20.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 943 0.08 MB/sec execute 73 sec latency 2705.440 ms 2024-02-17T13:15:21.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 945 0.08 MB/sec execute 74 sec latency 2677.589 ms 2024-02-17T13:15:22.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 951 0.08 MB/sec execute 75 sec latency 2580.949 ms 2024-02-17T13:15:23.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 954 0.08 MB/sec execute 76 sec latency 2759.965 ms 2024-02-17T13:15:24.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 960 0.09 MB/sec execute 77 sec latency 3046.508 ms 2024-02-17T13:15:25.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 969 0.10 MB/sec execute 78 sec latency 3017.527 ms 2024-02-17T13:15:26.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 977 0.10 MB/sec execute 79 sec latency 2448.227 ms 2024-02-17T13:15:27.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 979 0.09 MB/sec execute 80 sec latency 2885.944 ms 2024-02-17T13:15:28.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 982 0.09 MB/sec execute 81 sec latency 3763.256 ms 2024-02-17T13:15:29.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 988 0.10 MB/sec execute 82 sec latency 2521.065 ms 2024-02-17T13:15:30.221 INFO:tasks.workunit.client.0.smithi136.stdout: 10 992 0.10 MB/sec execute 83 sec latency 3521.094 ms 2024-02-17T13:15:31.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 996 0.10 MB/sec execute 84 sec latency 3882.462 ms 2024-02-17T13:15:32.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1000 0.10 MB/sec execute 85 sec latency 2973.032 ms 2024-02-17T13:15:33.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1007 0.13 MB/sec execute 86 sec latency 3598.068 ms 2024-02-17T13:15:34.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1010 0.13 MB/sec execute 87 sec latency 3355.428 ms 2024-02-17T13:15:34.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:15:34.594 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:15:35.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1018 0.15 MB/sec execute 88 sec latency 3372.981 ms 2024-02-17T13:15:36.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1027 0.18 MB/sec execute 89 sec latency 2835.566 ms 2024-02-17T13:15:37.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1030 0.19 MB/sec execute 90 sec latency 2642.910 ms 2024-02-17T13:15:38.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1031 0.19 MB/sec execute 91 sec latency 2352.148 ms 2024-02-17T13:15:39.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1034 0.18 MB/sec execute 92 sec latency 2494.938 ms 2024-02-17T13:15:40.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1037 0.18 MB/sec execute 93 sec latency 2538.838 ms 2024-02-17T13:15:41.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1039 0.18 MB/sec execute 94 sec latency 2537.081 ms 2024-02-17T13:15:42.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1040 0.18 MB/sec execute 95 sec latency 3372.785 ms 2024-02-17T13:15:43.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1044 0.18 MB/sec execute 96 sec latency 3371.292 ms 2024-02-17T13:15:44.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1046 0.18 MB/sec execute 97 sec latency 3253.824 ms 2024-02-17T13:15:45.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1048 0.17 MB/sec execute 98 sec latency 2620.663 ms 2024-02-17T13:15:46.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1048 0.17 MB/sec execute 99 sec latency 2548.629 ms 2024-02-17T13:15:47.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1051 0.17 MB/sec execute 100 sec latency 2652.916 ms 2024-02-17T13:15:48.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1051 0.17 MB/sec execute 101 sec latency 2678.169 ms 2024-02-17T13:15:49.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1053 0.17 MB/sec execute 102 sec latency 2712.499 ms 2024-02-17T13:15:50.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1055 0.17 MB/sec execute 103 sec latency 2762.156 ms 2024-02-17T13:15:51.222 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1057 0.16 MB/sec execute 104 sec latency 3101.073 ms 2024-02-17T13:15:52.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1060 0.16 MB/sec execute 105 sec latency 3493.676 ms 2024-02-17T13:15:53.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1066 0.16 MB/sec execute 106 sec latency 3618.078 ms 2024-02-17T13:15:54.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1071 0.16 MB/sec execute 107 sec latency 3321.827 ms 2024-02-17T13:15:55.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1076 0.16 MB/sec execute 108 sec latency 3481.700 ms 2024-02-17T13:15:56.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1078 0.16 MB/sec execute 109 sec latency 2973.842 ms 2024-02-17T13:15:57.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1083 0.16 MB/sec execute 110 sec latency 3825.239 ms 2024-02-17T13:15:58.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1088 0.16 MB/sec execute 111 sec latency 4104.234 ms 2024-02-17T13:15:59.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1093 0.16 MB/sec execute 112 sec latency 4137.360 ms 2024-02-17T13:16:00.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1094 0.15 MB/sec execute 113 sec latency 4611.276 ms 2024-02-17T13:16:01.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1095 0.15 MB/sec execute 114 sec latency 4717.591 ms 2024-02-17T13:16:02.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1097 0.15 MB/sec execute 115 sec latency 3899.022 ms 2024-02-17T13:16:03.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1102 0.15 MB/sec execute 116 sec latency 3937.098 ms 2024-02-17T13:16:04.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1108 0.15 MB/sec execute 117 sec latency 3436.160 ms 2024-02-17T13:16:04.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:16:04.666 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:16:05.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1110 0.15 MB/sec execute 118 sec latency 3666.771 ms 2024-02-17T13:16:06.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1112 0.15 MB/sec execute 119 sec latency 2991.599 ms 2024-02-17T13:16:07.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1116 0.15 MB/sec execute 120 sec latency 2764.917 ms 2024-02-17T13:16:08.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1122 0.15 MB/sec execute 121 sec latency 2593.725 ms 2024-02-17T13:16:09.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1126 0.15 MB/sec execute 122 sec latency 2699.063 ms 2024-02-17T13:16:10.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1130 0.15 MB/sec execute 123 sec latency 2665.254 ms 2024-02-17T13:16:11.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1136 0.14 MB/sec execute 124 sec latency 2520.495 ms 2024-02-17T13:16:12.223 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1141 0.14 MB/sec execute 125 sec latency 1250.640 ms 2024-02-17T13:16:13.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1146 0.14 MB/sec execute 126 sec latency 2250.666 ms 2024-02-17T13:16:14.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1151 0.14 MB/sec execute 127 sec latency 3250.701 ms 2024-02-17T13:16:15.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1154 0.14 MB/sec execute 128 sec latency 3635.161 ms 2024-02-17T13:16:16.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1157 0.14 MB/sec execute 129 sec latency 3235.157 ms 2024-02-17T13:16:17.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1160 0.14 MB/sec execute 130 sec latency 3316.760 ms 2024-02-17T13:16:18.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1162 0.14 MB/sec execute 131 sec latency 3202.592 ms 2024-02-17T13:16:19.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1163 0.14 MB/sec execute 132 sec latency 3244.084 ms 2024-02-17T13:16:20.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1166 0.14 MB/sec execute 133 sec latency 3287.516 ms 2024-02-17T13:16:21.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1168 0.14 MB/sec execute 134 sec latency 3014.062 ms 2024-02-17T13:16:22.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1171 0.14 MB/sec execute 135 sec latency 2942.347 ms 2024-02-17T13:16:23.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1172 0.13 MB/sec execute 136 sec latency 3149.340 ms 2024-02-17T13:16:24.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1172 0.13 MB/sec execute 137 sec latency 3172.858 ms 2024-02-17T13:16:25.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1173 0.13 MB/sec execute 138 sec latency 3072.327 ms 2024-02-17T13:16:26.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1174 0.13 MB/sec execute 139 sec latency 2782.549 ms 2024-02-17T13:16:27.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1175 0.13 MB/sec execute 140 sec latency 3160.654 ms 2024-02-17T13:16:28.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1178 0.13 MB/sec execute 141 sec latency 3327.152 ms 2024-02-17T13:16:29.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1181 0.13 MB/sec execute 142 sec latency 2945.383 ms 2024-02-17T13:16:30.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1184 0.13 MB/sec execute 143 sec latency 3370.601 ms 2024-02-17T13:16:31.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1186 0.13 MB/sec execute 144 sec latency 2953.056 ms 2024-02-17T13:16:32.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1191 0.13 MB/sec execute 145 sec latency 1911.108 ms 2024-02-17T13:16:33.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1195 0.13 MB/sec execute 146 sec latency 2911.140 ms 2024-02-17T13:16:34.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1199 0.13 MB/sec execute 147 sec latency 3533.454 ms 2024-02-17T13:16:34.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:16:34.797 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:16:35.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1203 0.13 MB/sec execute 148 sec latency 3492.894 ms 2024-02-17T13:16:36.224 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1211 0.13 MB/sec execute 149 sec latency 3315.180 ms 2024-02-17T13:16:37.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1213 0.12 MB/sec execute 150 sec latency 3103.147 ms 2024-02-17T13:16:38.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1216 0.12 MB/sec execute 151 sec latency 3966.656 ms 2024-02-17T13:16:39.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1220 0.12 MB/sec execute 152 sec latency 3981.835 ms 2024-02-17T13:16:40.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1225 0.12 MB/sec execute 153 sec latency 3630.192 ms 2024-02-17T13:16:41.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1230 0.12 MB/sec execute 154 sec latency 1357.470 ms 2024-02-17T13:16:42.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1234 0.12 MB/sec execute 155 sec latency 2357.496 ms 2024-02-17T13:16:43.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1240 0.12 MB/sec execute 156 sec latency 3357.524 ms 2024-02-17T13:16:44.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1243 0.12 MB/sec execute 157 sec latency 3851.044 ms 2024-02-17T13:16:45.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1247 0.12 MB/sec execute 158 sec latency 3109.272 ms 2024-02-17T13:16:46.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1251 0.12 MB/sec execute 159 sec latency 3027.073 ms 2024-02-17T13:16:47.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1255 0.12 MB/sec execute 160 sec latency 3506.618 ms 2024-02-17T13:16:48.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1258 0.12 MB/sec execute 161 sec latency 3838.649 ms 2024-02-17T13:16:49.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1261 0.12 MB/sec execute 162 sec latency 3855.807 ms 2024-02-17T13:16:50.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1264 0.12 MB/sec execute 163 sec latency 3704.214 ms 2024-02-17T13:16:51.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1268 0.12 MB/sec execute 164 sec latency 3473.920 ms 2024-02-17T13:16:52.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1280 0.13 MB/sec execute 165 sec latency 3940.397 ms 2024-02-17T13:16:53.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1283 0.13 MB/sec execute 166 sec latency 3804.905 ms 2024-02-17T13:16:54.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1287 0.13 MB/sec execute 167 sec latency 4345.533 ms 2024-02-17T13:16:55.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1289 0.13 MB/sec execute 168 sec latency 4270.325 ms 2024-02-17T13:16:56.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1289 0.13 MB/sec execute 169 sec latency 3393.717 ms 2024-02-17T13:16:56.514 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:19:51.380 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.518 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:19:51.314 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.521 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:19:51.317 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.534 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:19:51.400 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.572 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:19:51.368 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.578 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:19:51.374 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.588 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:19:51.384 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.606 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:19:51.472 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:56.655 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:19:51.451 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:16:57.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1289 0.13 MB/sec execute 170 sec latency 2717.009 ms 2024-02-17T13:16:58.225 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1290 0.13 MB/sec execute 171 sec latency 3310.767 ms 2024-02-17T13:16:59.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1291 0.13 MB/sec execute 172 sec latency 3308.250 ms 2024-02-17T13:17:00.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1291 0.13 MB/sec execute 173 sec latency 3217.492 ms 2024-02-17T13:17:01.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1302 0.15 MB/sec execute 174 sec latency 2545.998 ms 2024-02-17T13:17:02.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1311 0.16 MB/sec execute 175 sec latency 2737.335 ms 2024-02-17T13:17:03.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1321 0.18 MB/sec execute 176 sec latency 2859.398 ms 2024-02-17T13:17:04.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1341 0.21 MB/sec execute 177 sec latency 2732.529 ms 2024-02-17T13:17:04.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:17:04.909 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:17:05.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1359 0.24 MB/sec execute 178 sec latency 2433.520 ms 2024-02-17T13:17:06.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1362 0.24 MB/sec execute 179 sec latency 2646.025 ms 2024-02-17T13:17:07.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1379 0.27 MB/sec execute 180 sec latency 2699.064 ms 2024-02-17T13:17:08.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1379 0.27 MB/sec execute 181 sec latency 2433.442 ms 2024-02-17T13:17:09.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1380 0.26 MB/sec execute 182 sec latency 2491.570 ms 2024-02-17T13:17:10.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1382 0.26 MB/sec execute 183 sec latency 2480.816 ms 2024-02-17T13:17:11.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1384 0.26 MB/sec execute 184 sec latency 2209.994 ms 2024-02-17T13:17:12.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1385 0.26 MB/sec execute 185 sec latency 2515.802 ms 2024-02-17T13:17:13.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1387 0.26 MB/sec execute 186 sec latency 2793.863 ms 2024-02-17T13:17:14.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1390 0.26 MB/sec execute 187 sec latency 2531.424 ms 2024-02-17T13:17:15.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1393 0.26 MB/sec execute 188 sec latency 2301.046 ms 2024-02-17T13:17:16.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1396 0.25 MB/sec execute 189 sec latency 2450.132 ms 2024-02-17T13:17:17.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1399 0.25 MB/sec execute 190 sec latency 2598.425 ms 2024-02-17T13:17:18.226 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1401 0.25 MB/sec execute 191 sec latency 2514.718 ms 2024-02-17T13:17:19.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1405 0.25 MB/sec execute 192 sec latency 2586.596 ms 2024-02-17T13:17:20.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1410 0.25 MB/sec execute 193 sec latency 2371.953 ms 2024-02-17T13:17:21.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1416 0.25 MB/sec execute 194 sec latency 2360.144 ms 2024-02-17T13:17:22.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1417 0.25 MB/sec execute 195 sec latency 2726.026 ms 2024-02-17T13:17:23.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1419 0.25 MB/sec execute 196 sec latency 3196.920 ms 2024-02-17T13:17:24.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1423 0.24 MB/sec execute 197 sec latency 2946.089 ms 2024-02-17T13:17:25.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1430 0.24 MB/sec execute 198 sec latency 2677.722 ms 2024-02-17T13:17:26.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1437 0.24 MB/sec execute 199 sec latency 2126.392 ms 2024-02-17T13:17:27.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1439 0.24 MB/sec execute 200 sec latency 3126.446 ms 2024-02-17T13:17:28.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1444 0.24 MB/sec execute 201 sec latency 3825.000 ms 2024-02-17T13:17:29.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1445 0.24 MB/sec execute 202 sec latency 3844.338 ms 2024-02-17T13:17:30.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1448 0.24 MB/sec execute 203 sec latency 3243.399 ms 2024-02-17T13:17:31.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1449 0.24 MB/sec execute 204 sec latency 3294.130 ms 2024-02-17T13:17:32.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1454 0.24 MB/sec execute 205 sec latency 3541.596 ms 2024-02-17T13:17:33.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1456 0.23 MB/sec execute 206 sec latency 3553.769 ms 2024-02-17T13:17:34.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1457 0.23 MB/sec execute 207 sec latency 4553.838 ms 2024-02-17T13:17:35.052 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:17:35.055 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:17:35.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1461 0.23 MB/sec execute 208 sec latency 4832.157 ms 2024-02-17T13:17:36.227 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1463 0.23 MB/sec execute 209 sec latency 1655.376 ms 2024-02-17T13:17:37.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1465 0.23 MB/sec execute 210 sec latency 2168.841 ms 2024-02-17T13:17:38.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1468 0.23 MB/sec execute 211 sec latency 2564.758 ms 2024-02-17T13:17:39.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1474 0.23 MB/sec execute 212 sec latency 3066.572 ms 2024-02-17T13:17:40.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1479 0.23 MB/sec execute 213 sec latency 2879.494 ms 2024-02-17T13:17:41.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1482 0.23 MB/sec execute 214 sec latency 2310.202 ms 2024-02-17T13:17:42.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1485 0.23 MB/sec execute 215 sec latency 2318.733 ms 2024-02-17T13:17:43.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1488 0.22 MB/sec execute 216 sec latency 2601.559 ms 2024-02-17T13:17:44.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1491 0.22 MB/sec execute 217 sec latency 2454.456 ms 2024-02-17T13:17:45.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1492 0.22 MB/sec execute 218 sec latency 2570.286 ms 2024-02-17T13:17:46.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1496 0.22 MB/sec execute 219 sec latency 2712.464 ms 2024-02-17T13:17:47.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1496 0.22 MB/sec execute 220 sec latency 3132.386 ms 2024-02-17T13:17:48.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1500 0.22 MB/sec execute 221 sec latency 3281.237 ms 2024-02-17T13:17:49.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1504 0.22 MB/sec execute 222 sec latency 2778.787 ms 2024-02-17T13:17:50.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1508 0.22 MB/sec execute 223 sec latency 2780.596 ms 2024-02-17T13:17:51.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1513 0.22 MB/sec execute 224 sec latency 2178.125 ms 2024-02-17T13:17:52.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1518 0.22 MB/sec execute 225 sec latency 2837.802 ms 2024-02-17T13:17:53.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1522 0.22 MB/sec execute 226 sec latency 1843.590 ms 2024-02-17T13:17:54.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1526 0.22 MB/sec execute 227 sec latency 2843.616 ms 2024-02-17T13:17:55.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1529 0.22 MB/sec execute 228 sec latency 3252.562 ms 2024-02-17T13:17:56.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1532 0.21 MB/sec execute 229 sec latency 3047.831 ms 2024-02-17T13:17:57.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1533 0.21 MB/sec execute 230 sec latency 3147.937 ms 2024-02-17T13:17:58.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1534 0.21 MB/sec execute 231 sec latency 3394.765 ms 2024-02-17T13:17:59.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1537 0.21 MB/sec execute 232 sec latency 3175.549 ms 2024-02-17T13:18:00.228 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1539 0.21 MB/sec execute 233 sec latency 3438.214 ms 2024-02-17T13:18:01.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1546 0.21 MB/sec execute 234 sec latency 3083.513 ms 2024-02-17T13:18:02.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1551 0.21 MB/sec execute 235 sec latency 3049.339 ms 2024-02-17T13:18:03.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1554 0.21 MB/sec execute 236 sec latency 3240.885 ms 2024-02-17T13:18:04.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1556 0.21 MB/sec execute 237 sec latency 3307.174 ms 2024-02-17T13:18:05.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:18:05.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:18:05.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1559 0.21 MB/sec execute 238 sec latency 3396.461 ms 2024-02-17T13:18:06.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1566 0.21 MB/sec execute 239 sec latency 2813.505 ms 2024-02-17T13:18:07.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1569 0.21 MB/sec execute 240 sec latency 2823.760 ms 2024-02-17T13:18:08.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1572 0.20 MB/sec execute 241 sec latency 3823.796 ms 2024-02-17T13:18:09.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1576 0.20 MB/sec execute 242 sec latency 4290.710 ms 2024-02-17T13:18:10.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1580 0.20 MB/sec execute 243 sec latency 2688.592 ms 2024-02-17T13:18:11.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1582 0.20 MB/sec execute 244 sec latency 3688.620 ms 2024-02-17T13:18:12.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1585 0.20 MB/sec execute 245 sec latency 4135.789 ms 2024-02-17T13:18:13.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1589 0.20 MB/sec execute 246 sec latency 2569.143 ms 2024-02-17T13:18:14.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1592 0.20 MB/sec execute 247 sec latency 2745.068 ms 2024-02-17T13:18:15.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1597 0.20 MB/sec execute 248 sec latency 2841.701 ms 2024-02-17T13:18:16.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1604 0.20 MB/sec execute 249 sec latency 2707.840 ms 2024-02-17T13:18:17.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1606 0.20 MB/sec execute 250 sec latency 1902.866 ms 2024-02-17T13:18:18.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1607 0.20 MB/sec execute 251 sec latency 2419.278 ms 2024-02-17T13:18:19.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1609 0.20 MB/sec execute 252 sec latency 2809.359 ms 2024-02-17T13:18:20.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1613 0.20 MB/sec execute 253 sec latency 2615.667 ms 2024-02-17T13:18:21.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1614 0.20 MB/sec execute 254 sec latency 2124.845 ms 2024-02-17T13:18:22.229 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1616 0.20 MB/sec execute 255 sec latency 2125.588 ms 2024-02-17T13:18:23.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1620 0.19 MB/sec execute 256 sec latency 2729.589 ms 2024-02-17T13:18:24.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1624 0.19 MB/sec execute 257 sec latency 2235.340 ms 2024-02-17T13:18:25.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1627 0.19 MB/sec execute 258 sec latency 2202.529 ms 2024-02-17T13:18:26.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1631 0.19 MB/sec execute 259 sec latency 2612.364 ms 2024-02-17T13:18:27.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1635 0.19 MB/sec execute 260 sec latency 2345.969 ms 2024-02-17T13:18:28.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1642 0.19 MB/sec execute 261 sec latency 2482.737 ms 2024-02-17T13:18:29.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1643 0.19 MB/sec execute 262 sec latency 2672.206 ms 2024-02-17T13:18:30.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1643 0.19 MB/sec execute 263 sec latency 3056.760 ms 2024-02-17T13:18:31.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1649 0.19 MB/sec execute 264 sec latency 3124.832 ms 2024-02-17T13:18:32.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1652 0.19 MB/sec execute 265 sec latency 2814.090 ms 2024-02-17T13:18:33.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1656 0.19 MB/sec execute 266 sec latency 3424.853 ms 2024-02-17T13:18:34.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1659 0.19 MB/sec execute 267 sec latency 3796.845 ms 2024-02-17T13:18:35.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1663 0.19 MB/sec execute 268 sec latency 4162.355 ms 2024-02-17T13:18:35.285 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:18:35.288 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:18:36.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1669 0.19 MB/sec execute 269 sec latency 4401.154 ms 2024-02-17T13:18:37.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1676 0.19 MB/sec execute 270 sec latency 1170.621 ms 2024-02-17T13:18:38.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1679 0.19 MB/sec execute 271 sec latency 1658.071 ms 2024-02-17T13:18:39.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1682 0.18 MB/sec execute 272 sec latency 2658.103 ms 2024-02-17T13:18:40.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1690 0.18 MB/sec execute 273 sec latency 3658.154 ms 2024-02-17T13:18:41.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1691 0.18 MB/sec execute 274 sec latency 4658.208 ms 2024-02-17T13:18:42.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1695 0.18 MB/sec execute 275 sec latency 5185.889 ms 2024-02-17T13:18:43.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1696 0.18 MB/sec execute 276 sec latency 4214.887 ms 2024-02-17T13:18:44.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1698 0.18 MB/sec execute 277 sec latency 5214.917 ms 2024-02-17T13:18:45.230 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1702 0.18 MB/sec execute 278 sec latency 5758.566 ms 2024-02-17T13:18:46.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1705 0.18 MB/sec execute 279 sec latency 4224.897 ms 2024-02-17T13:18:47.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1708 0.18 MB/sec execute 280 sec latency 4602.196 ms 2024-02-17T13:18:48.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1710 0.18 MB/sec execute 281 sec latency 4629.035 ms 2024-02-17T13:18:49.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1712 0.18 MB/sec execute 282 sec latency 4051.295 ms 2024-02-17T13:18:50.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1716 0.18 MB/sec execute 283 sec latency 4769.666 ms 2024-02-17T13:18:51.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1721 0.18 MB/sec execute 284 sec latency 4788.839 ms 2024-02-17T13:18:52.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1724 0.18 MB/sec execute 285 sec latency 2121.458 ms 2024-02-17T13:18:53.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1726 0.18 MB/sec execute 286 sec latency 3121.493 ms 2024-02-17T13:18:54.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1729 0.18 MB/sec execute 287 sec latency 3901.612 ms 2024-02-17T13:18:55.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1740 0.18 MB/sec execute 288 sec latency 4409.746 ms 2024-02-17T13:18:56.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1745 0.18 MB/sec execute 289 sec latency 4146.111 ms 2024-02-17T13:18:57.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1749 0.18 MB/sec execute 290 sec latency 3483.415 ms 2024-02-17T13:18:58.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1754 0.17 MB/sec execute 291 sec latency 2708.414 ms 2024-02-17T13:18:59.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1758 0.17 MB/sec execute 292 sec latency 3577.133 ms 2024-02-17T13:19:00.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1766 0.17 MB/sec execute 293 sec latency 3651.257 ms 2024-02-17T13:19:01.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1767 0.17 MB/sec execute 294 sec latency 4627.727 ms 2024-02-17T13:19:02.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1770 0.17 MB/sec execute 295 sec latency 5330.882 ms 2024-02-17T13:19:03.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1773 0.17 MB/sec execute 296 sec latency 4774.977 ms 2024-02-17T13:19:04.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1779 0.17 MB/sec execute 297 sec latency 4297.023 ms 2024-02-17T13:19:05.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1782 0.17 MB/sec execute 298 sec latency 5156.889 ms 2024-02-17T13:19:05.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:19:05.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:19:06.231 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1783 0.17 MB/sec execute 299 sec latency 4419.533 ms 2024-02-17T13:19:07.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1790 0.17 MB/sec execute 300 sec latency 4964.283 ms 2024-02-17T13:19:08.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1794 0.17 MB/sec execute 301 sec latency 4137.072 ms 2024-02-17T13:19:09.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1798 0.17 MB/sec execute 302 sec latency 3805.968 ms 2024-02-17T13:19:10.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1802 0.17 MB/sec execute 303 sec latency 2441.109 ms 2024-02-17T13:19:11.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1804 0.17 MB/sec execute 304 sec latency 2468.053 ms 2024-02-17T13:19:12.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1808 0.17 MB/sec execute 305 sec latency 2641.504 ms 2024-02-17T13:19:13.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1812 0.17 MB/sec execute 306 sec latency 3119.510 ms 2024-02-17T13:19:14.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1815 0.17 MB/sec execute 307 sec latency 3518.514 ms 2024-02-17T13:19:15.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1817 0.17 MB/sec execute 308 sec latency 2755.763 ms 2024-02-17T13:19:16.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1819 0.17 MB/sec execute 309 sec latency 2784.145 ms 2024-02-17T13:19:17.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1825 0.17 MB/sec execute 310 sec latency 2654.402 ms 2024-02-17T13:19:18.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1827 0.17 MB/sec execute 311 sec latency 2799.295 ms 2024-02-17T13:19:19.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1829 0.17 MB/sec execute 312 sec latency 2828.710 ms 2024-02-17T13:19:20.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1831 0.16 MB/sec execute 313 sec latency 2608.266 ms 2024-02-17T13:19:21.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1834 0.16 MB/sec execute 314 sec latency 2468.321 ms 2024-02-17T13:19:22.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1838 0.16 MB/sec execute 315 sec latency 2370.429 ms 2024-02-17T13:19:23.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1839 0.16 MB/sec execute 316 sec latency 2479.524 ms 2024-02-17T13:19:24.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1842 0.16 MB/sec execute 317 sec latency 2534.222 ms 2024-02-17T13:19:25.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1846 0.16 MB/sec execute 318 sec latency 2827.178 ms 2024-02-17T13:19:26.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1851 0.16 MB/sec execute 319 sec latency 2364.761 ms 2024-02-17T13:19:27.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1855 0.16 MB/sec execute 320 sec latency 2147.055 ms 2024-02-17T13:19:28.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1857 0.16 MB/sec execute 321 sec latency 2576.741 ms 2024-02-17T13:19:29.232 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1860 0.16 MB/sec execute 322 sec latency 2611.345 ms 2024-02-17T13:19:30.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1864 0.16 MB/sec execute 323 sec latency 2207.109 ms 2024-02-17T13:19:31.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1865 0.16 MB/sec execute 324 sec latency 2305.585 ms 2024-02-17T13:19:32.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1867 0.16 MB/sec execute 325 sec latency 2502.379 ms 2024-02-17T13:19:33.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1871 0.16 MB/sec execute 326 sec latency 2307.165 ms 2024-02-17T13:19:34.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1873 0.16 MB/sec execute 327 sec latency 2367.548 ms 2024-02-17T13:19:35.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1874 0.16 MB/sec execute 328 sec latency 2420.736 ms 2024-02-17T13:19:35.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:19:35.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:19:36.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1879 0.16 MB/sec execute 329 sec latency 2459.429 ms 2024-02-17T13:19:37.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1885 0.16 MB/sec execute 330 sec latency 2520.296 ms 2024-02-17T13:19:38.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1890 0.16 MB/sec execute 331 sec latency 2608.411 ms 2024-02-17T13:19:39.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1897 0.16 MB/sec execute 332 sec latency 2681.608 ms 2024-02-17T13:19:40.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1902 0.16 MB/sec execute 333 sec latency 2737.314 ms 2024-02-17T13:19:41.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1907 0.16 MB/sec execute 334 sec latency 2921.047 ms 2024-02-17T13:19:42.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1910 0.16 MB/sec execute 335 sec latency 2660.552 ms 2024-02-17T13:19:43.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1911 0.16 MB/sec execute 336 sec latency 2637.958 ms 2024-02-17T13:19:44.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1915 0.16 MB/sec execute 337 sec latency 3029.381 ms 2024-02-17T13:19:45.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1917 0.16 MB/sec execute 338 sec latency 2991.912 ms 2024-02-17T13:19:46.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1918 0.16 MB/sec execute 339 sec latency 2834.683 ms 2024-02-17T13:19:47.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1924 0.15 MB/sec execute 340 sec latency 2945.597 ms 2024-02-17T13:19:48.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1927 0.15 MB/sec execute 341 sec latency 3588.274 ms 2024-02-17T13:19:49.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1930 0.15 MB/sec execute 342 sec latency 3045.092 ms 2024-02-17T13:19:50.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1935 0.15 MB/sec execute 343 sec latency 2986.233 ms 2024-02-17T13:19:51.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1939 0.15 MB/sec execute 344 sec latency 2831.428 ms 2024-02-17T13:19:52.233 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1946 0.15 MB/sec execute 345 sec latency 3043.322 ms 2024-02-17T13:19:53.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1957 0.15 MB/sec execute 346 sec latency 3928.285 ms 2024-02-17T13:19:54.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1963 0.15 MB/sec execute 347 sec latency 3027.023 ms 2024-02-17T13:19:55.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1966 0.15 MB/sec execute 348 sec latency 4027.072 ms 2024-02-17T13:19:56.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1967 0.15 MB/sec execute 349 sec latency 4924.996 ms 2024-02-17T13:19:57.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1976 0.15 MB/sec execute 350 sec latency 4810.016 ms 2024-02-17T13:19:58.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1981 0.15 MB/sec execute 351 sec latency 3872.409 ms 2024-02-17T13:19:59.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1981 0.15 MB/sec execute 352 sec latency 4041.118 ms 2024-02-17T13:20:00.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1986 0.15 MB/sec execute 353 sec latency 4606.075 ms 2024-02-17T13:20:01.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1989 0.15 MB/sec execute 354 sec latency 2867.723 ms 2024-02-17T13:20:02.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1992 0.15 MB/sec execute 355 sec latency 3867.776 ms 2024-02-17T13:20:03.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1993 0.15 MB/sec execute 356 sec latency 4867.802 ms 2024-02-17T13:20:04.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1996 0.15 MB/sec execute 357 sec latency 5867.852 ms 2024-02-17T13:20:05.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 1998 0.15 MB/sec execute 358 sec latency 6342.284 ms 2024-02-17T13:20:05.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:20:05.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:20:06.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2002 0.15 MB/sec execute 359 sec latency 5650.619 ms 2024-02-17T13:20:07.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2006 0.15 MB/sec execute 360 sec latency 4505.322 ms 2024-02-17T13:20:08.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2008 0.15 MB/sec execute 361 sec latency 3213.130 ms 2024-02-17T13:20:09.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2012 0.15 MB/sec execute 362 sec latency 2668.570 ms 2024-02-17T13:20:10.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2016 0.15 MB/sec execute 363 sec latency 2988.815 ms 2024-02-17T13:20:11.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2020 0.15 MB/sec execute 364 sec latency 3375.949 ms 2024-02-17T13:20:12.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2023 0.15 MB/sec execute 365 sec latency 3637.273 ms 2024-02-17T13:20:13.234 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2027 0.15 MB/sec execute 366 sec latency 4306.704 ms 2024-02-17T13:20:14.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2031 0.15 MB/sec execute 367 sec latency 3757.992 ms 2024-02-17T13:20:15.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2035 0.15 MB/sec execute 368 sec latency 4283.074 ms 2024-02-17T13:20:16.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2038 0.15 MB/sec execute 369 sec latency 2356.408 ms 2024-02-17T13:20:17.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2040 0.15 MB/sec execute 370 sec latency 2958.544 ms 2024-02-17T13:20:18.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2043 0.15 MB/sec execute 371 sec latency 2644.115 ms 2024-02-17T13:20:19.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2047 0.15 MB/sec execute 372 sec latency 2813.526 ms 2024-02-17T13:20:20.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2051 0.15 MB/sec execute 373 sec latency 2515.735 ms 2024-02-17T13:20:21.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2052 0.15 MB/sec execute 374 sec latency 2435.480 ms 2024-02-17T13:20:22.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2054 0.14 MB/sec execute 375 sec latency 2457.561 ms 2024-02-17T13:20:23.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2056 0.14 MB/sec execute 376 sec latency 2423.977 ms 2024-02-17T13:20:24.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2056 0.14 MB/sec execute 377 sec latency 2828.175 ms 2024-02-17T13:20:25.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2059 0.14 MB/sec execute 378 sec latency 2902.893 ms 2024-02-17T13:20:26.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2060 0.14 MB/sec execute 379 sec latency 3185.115 ms 2024-02-17T13:20:27.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2062 0.14 MB/sec execute 380 sec latency 3252.147 ms 2024-02-17T13:20:28.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2063 0.14 MB/sec execute 381 sec latency 2713.636 ms 2024-02-17T13:20:29.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2064 0.14 MB/sec execute 382 sec latency 2736.068 ms 2024-02-17T13:20:30.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2067 0.14 MB/sec execute 383 sec latency 2871.475 ms 2024-02-17T13:20:31.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2069 0.14 MB/sec execute 384 sec latency 2755.616 ms 2024-02-17T13:20:32.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2078 0.14 MB/sec execute 385 sec latency 2572.255 ms 2024-02-17T13:20:33.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2084 0.14 MB/sec execute 386 sec latency 2361.507 ms 2024-02-17T13:20:34.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2086 0.14 MB/sec execute 387 sec latency 2496.475 ms 2024-02-17T13:20:35.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2087 0.14 MB/sec execute 388 sec latency 2824.500 ms 2024-02-17T13:20:35.773 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:20:35.776 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:20:36.235 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2089 0.14 MB/sec execute 389 sec latency 3036.424 ms 2024-02-17T13:20:37.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2090 0.14 MB/sec execute 390 sec latency 2505.594 ms 2024-02-17T13:20:38.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2094 0.14 MB/sec execute 391 sec latency 2800.078 ms 2024-02-17T13:20:39.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2098 0.14 MB/sec execute 392 sec latency 3260.867 ms 2024-02-17T13:20:40.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2102 0.14 MB/sec execute 393 sec latency 3335.826 ms 2024-02-17T13:20:41.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2104 0.14 MB/sec execute 394 sec latency 1877.815 ms 2024-02-17T13:20:42.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2106 0.14 MB/sec execute 395 sec latency 2525.591 ms 2024-02-17T13:20:43.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2108 0.14 MB/sec execute 396 sec latency 2802.324 ms 2024-02-17T13:20:44.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2112 0.14 MB/sec execute 397 sec latency 2707.134 ms 2024-02-17T13:20:45.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2114 0.14 MB/sec execute 398 sec latency 3143.533 ms 2024-02-17T13:20:46.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2119 0.14 MB/sec execute 399 sec latency 3386.371 ms 2024-02-17T13:20:47.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2124 0.14 MB/sec execute 400 sec latency 3504.350 ms 2024-02-17T13:20:48.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2137 0.14 MB/sec execute 401 sec latency 2298.149 ms 2024-02-17T13:20:49.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2146 0.14 MB/sec execute 402 sec latency 1146.181 ms 2024-02-17T13:20:50.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2148 0.14 MB/sec execute 403 sec latency 2146.230 ms 2024-02-17T13:20:51.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2148 0.14 MB/sec execute 404 sec latency 3146.280 ms 2024-02-17T13:20:52.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2149 0.14 MB/sec execute 405 sec latency 3994.033 ms 2024-02-17T13:20:53.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2151 0.14 MB/sec execute 406 sec latency 3715.889 ms 2024-02-17T13:20:54.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2152 0.14 MB/sec execute 407 sec latency 3451.731 ms 2024-02-17T13:20:55.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2154 0.14 MB/sec execute 408 sec latency 4451.782 ms 2024-02-17T13:20:56.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2156 0.13 MB/sec execute 409 sec latency 5010.878 ms 2024-02-17T13:20:57.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2158 0.13 MB/sec execute 410 sec latency 3984.801 ms 2024-02-17T13:20:58.236 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2159 0.13 MB/sec execute 411 sec latency 4984.828 ms 2024-02-17T13:20:59.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2161 0.13 MB/sec execute 412 sec latency 5984.878 ms 2024-02-17T13:21:00.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2165 0.13 MB/sec execute 413 sec latency 6159.490 ms 2024-02-17T13:21:01.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2169 0.13 MB/sec execute 414 sec latency 3010.132 ms 2024-02-17T13:21:02.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2174 0.13 MB/sec execute 415 sec latency 2887.010 ms 2024-02-17T13:21:03.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2180 0.13 MB/sec execute 416 sec latency 2508.948 ms 2024-02-17T13:21:04.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2184 0.13 MB/sec execute 417 sec latency 3509.000 ms 2024-02-17T13:21:05.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2186 0.14 MB/sec execute 418 sec latency 3909.501 ms 2024-02-17T13:21:05.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:21:05.915 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:21:06.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2189 0.14 MB/sec execute 419 sec latency 2835.761 ms 2024-02-17T13:21:07.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2191 0.13 MB/sec execute 420 sec latency 2552.518 ms 2024-02-17T13:21:08.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2192 0.13 MB/sec execute 421 sec latency 1698.704 ms 2024-02-17T13:21:09.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2194 0.13 MB/sec execute 422 sec latency 2698.733 ms 2024-02-17T13:21:10.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2198 0.13 MB/sec execute 423 sec latency 2766.162 ms 2024-02-17T13:21:11.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2201 0.13 MB/sec execute 424 sec latency 2171.642 ms 2024-02-17T13:21:12.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2208 0.13 MB/sec execute 425 sec latency 1388.202 ms 2024-02-17T13:21:13.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2212 0.13 MB/sec execute 426 sec latency 2280.167 ms 2024-02-17T13:21:14.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2213 0.14 MB/sec execute 427 sec latency 2318.304 ms 2024-02-17T13:21:15.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2216 0.13 MB/sec execute 428 sec latency 3043.200 ms 2024-02-17T13:21:16.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2226 0.13 MB/sec execute 429 sec latency 3089.575 ms 2024-02-17T13:21:17.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2233 0.13 MB/sec execute 430 sec latency 1331.560 ms 2024-02-17T13:21:18.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2235 0.13 MB/sec execute 431 sec latency 2331.587 ms 2024-02-17T13:21:19.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2246 0.14 MB/sec execute 432 sec latency 2753.308 ms 2024-02-17T13:21:20.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2253 0.14 MB/sec execute 433 sec latency 1525.789 ms 2024-02-17T13:21:21.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2253 0.14 MB/sec execute 434 sec latency 2452.912 ms 2024-02-17T13:21:22.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2263 0.14 MB/sec execute 435 sec latency 2396.979 ms 2024-02-17T13:21:23.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2270 0.14 MB/sec execute 436 sec latency 3100.125 ms 2024-02-17T13:21:24.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2272 0.14 MB/sec execute 437 sec latency 4100.156 ms 2024-02-17T13:21:25.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2282 0.14 MB/sec execute 438 sec latency 4711.857 ms 2024-02-17T13:21:26.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2294 0.15 MB/sec execute 439 sec latency 4648.236 ms 2024-02-17T13:21:27.237 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2300 0.15 MB/sec execute 440 sec latency 5022.298 ms 2024-02-17T13:21:28.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2300 0.15 MB/sec execute 441 sec latency 2952.350 ms 2024-02-17T13:21:29.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2300 0.15 MB/sec execute 442 sec latency 3952.401 ms 2024-02-17T13:21:30.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2301 0.15 MB/sec execute 443 sec latency 4499.057 ms 2024-02-17T13:21:31.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2302 0.15 MB/sec execute 444 sec latency 4702.802 ms 2024-02-17T13:21:32.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2305 0.15 MB/sec execute 445 sec latency 5096.945 ms 2024-02-17T13:21:32.845 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:24:27.709 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:32.850 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:24:27.714 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:32.905 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:24:27.699 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:32.906 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:24:27.699 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:32.906 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:24:27.700 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:32.909 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:24:27.703 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:32.956 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:24:27.820 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:33.025 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:24:27.818 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:33.027 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:24:27.821 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:21:33.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2307 0.15 MB/sec execute 446 sec latency 3909.312 ms 2024-02-17T13:21:34.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2310 0.15 MB/sec execute 447 sec latency 2929.365 ms 2024-02-17T13:21:35.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2311 0.15 MB/sec execute 448 sec latency 2886.173 ms 2024-02-17T13:21:36.089 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:21:36.092 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:21:36.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2315 0.15 MB/sec execute 449 sec latency 2526.255 ms 2024-02-17T13:21:37.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2316 0.15 MB/sec execute 450 sec latency 2300.405 ms 2024-02-17T13:21:38.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2317 0.15 MB/sec execute 451 sec latency 2298.244 ms 2024-02-17T13:21:39.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2318 0.15 MB/sec execute 452 sec latency 2892.424 ms 2024-02-17T13:21:40.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2318 0.15 MB/sec execute 453 sec latency 2786.806 ms 2024-02-17T13:21:41.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2320 0.15 MB/sec execute 454 sec latency 2746.593 ms 2024-02-17T13:21:42.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2328 0.15 MB/sec execute 455 sec latency 2478.037 ms 2024-02-17T13:21:43.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2330 0.15 MB/sec execute 456 sec latency 2842.759 ms 2024-02-17T13:21:44.238 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2330 0.15 MB/sec execute 457 sec latency 3000.023 ms 2024-02-17T13:21:45.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2333 0.15 MB/sec execute 458 sec latency 3146.750 ms 2024-02-17T13:21:46.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2335 0.14 MB/sec execute 459 sec latency 2672.907 ms 2024-02-17T13:21:47.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2337 0.14 MB/sec execute 460 sec latency 2559.244 ms 2024-02-17T13:21:48.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2340 0.14 MB/sec execute 461 sec latency 2639.392 ms 2024-02-17T13:21:49.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2341 0.14 MB/sec execute 462 sec latency 3276.885 ms 2024-02-17T13:21:50.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2346 0.14 MB/sec execute 463 sec latency 3192.115 ms 2024-02-17T13:21:51.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2348 0.14 MB/sec execute 464 sec latency 3447.041 ms 2024-02-17T13:21:52.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2349 0.14 MB/sec execute 465 sec latency 3033.165 ms 2024-02-17T13:21:53.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2350 0.14 MB/sec execute 466 sec latency 3160.696 ms 2024-02-17T13:21:54.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2351 0.14 MB/sec execute 467 sec latency 3092.568 ms 2024-02-17T13:21:55.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2352 0.14 MB/sec execute 468 sec latency 3440.562 ms 2024-02-17T13:21:56.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2354 0.14 MB/sec execute 469 sec latency 3342.674 ms 2024-02-17T13:21:57.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2360 0.14 MB/sec execute 470 sec latency 3500.529 ms 2024-02-17T13:21:58.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2365 0.14 MB/sec execute 471 sec latency 2668.800 ms 2024-02-17T13:21:59.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2366 0.14 MB/sec execute 472 sec latency 2647.849 ms 2024-02-17T13:22:00.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2367 0.14 MB/sec execute 473 sec latency 2834.488 ms 2024-02-17T13:22:01.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2369 0.14 MB/sec execute 474 sec latency 2859.722 ms 2024-02-17T13:22:02.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2371 0.14 MB/sec execute 475 sec latency 2542.887 ms 2024-02-17T13:22:03.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2372 0.14 MB/sec execute 476 sec latency 2958.265 ms 2024-02-17T13:22:04.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2373 0.14 MB/sec execute 477 sec latency 3047.370 ms 2024-02-17T13:22:05.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2375 0.14 MB/sec execute 478 sec latency 3168.910 ms 2024-02-17T13:22:06.153 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:22:06.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:22:06.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2375 0.14 MB/sec execute 479 sec latency 2299.981 ms 2024-02-17T13:22:07.239 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2379 0.14 MB/sec execute 480 sec latency 2372.809 ms 2024-02-17T13:22:08.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2381 0.14 MB/sec execute 481 sec latency 1495.251 ms 2024-02-17T13:22:09.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2382 0.14 MB/sec execute 482 sec latency 2495.286 ms 2024-02-17T13:22:10.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2383 0.14 MB/sec execute 483 sec latency 3081.782 ms 2024-02-17T13:22:11.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2386 0.14 MB/sec execute 484 sec latency 2949.471 ms 2024-02-17T13:22:12.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2389 0.14 MB/sec execute 485 sec latency 2989.676 ms 2024-02-17T13:22:13.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2392 0.14 MB/sec execute 486 sec latency 2724.679 ms 2024-02-17T13:22:14.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2397 0.14 MB/sec execute 487 sec latency 3085.053 ms 2024-02-17T13:22:15.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2401 0.14 MB/sec execute 488 sec latency 3399.726 ms 2024-02-17T13:22:16.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2405 0.14 MB/sec execute 489 sec latency 3120.029 ms 2024-02-17T13:22:17.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2405 0.14 MB/sec execute 490 sec latency 4120.079 ms 2024-02-17T13:22:18.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2408 0.14 MB/sec execute 491 sec latency 4198.938 ms 2024-02-17T13:22:19.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2409 0.14 MB/sec execute 492 sec latency 3370.934 ms 2024-02-17T13:22:20.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2412 0.14 MB/sec execute 493 sec latency 3380.824 ms 2024-02-17T13:22:21.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2416 0.14 MB/sec execute 494 sec latency 2891.864 ms 2024-02-17T13:22:22.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2419 0.14 MB/sec execute 495 sec latency 2565.860 ms 2024-02-17T13:22:23.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2421 0.14 MB/sec execute 496 sec latency 3213.934 ms 2024-02-17T13:22:24.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2423 0.14 MB/sec execute 497 sec latency 3153.120 ms 2024-02-17T13:22:25.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2426 0.14 MB/sec execute 498 sec latency 3703.140 ms 2024-02-17T13:22:26.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2428 0.14 MB/sec execute 499 sec latency 3025.007 ms 2024-02-17T13:22:27.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2430 0.14 MB/sec execute 500 sec latency 3317.040 ms 2024-02-17T13:22:28.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2435 0.14 MB/sec execute 501 sec latency 2948.398 ms 2024-02-17T13:22:29.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2440 0.14 MB/sec execute 502 sec latency 2717.382 ms 2024-02-17T13:22:30.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2441 0.14 MB/sec execute 503 sec latency 3686.282 ms 2024-02-17T13:22:31.240 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2448 0.14 MB/sec execute 504 sec latency 3121.673 ms 2024-02-17T13:22:32.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2448 0.14 MB/sec execute 505 sec latency 2344.000 ms 2024-02-17T13:22:33.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2451 0.14 MB/sec execute 506 sec latency 2919.821 ms 2024-02-17T13:22:34.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2453 0.14 MB/sec execute 507 sec latency 2904.229 ms 2024-02-17T13:22:35.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2454 0.14 MB/sec execute 508 sec latency 1906.305 ms 2024-02-17T13:22:36.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2457 0.14 MB/sec execute 509 sec latency 2906.363 ms 2024-02-17T13:22:36.379 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:22:36.382 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:22:37.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2460 0.14 MB/sec execute 510 sec latency 3232.774 ms 2024-02-17T13:22:38.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2463 0.14 MB/sec execute 511 sec latency 2618.292 ms 2024-02-17T13:22:39.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2464 0.14 MB/sec execute 512 sec latency 2379.413 ms 2024-02-17T13:22:40.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2467 0.14 MB/sec execute 513 sec latency 3314.804 ms 2024-02-17T13:22:41.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2473 0.14 MB/sec execute 514 sec latency 3698.420 ms 2024-02-17T13:22:42.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2475 0.14 MB/sec execute 515 sec latency 2891.393 ms 2024-02-17T13:22:43.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2478 0.14 MB/sec execute 516 sec latency 2979.264 ms 2024-02-17T13:22:44.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2480 0.14 MB/sec execute 517 sec latency 3482.974 ms 2024-02-17T13:22:45.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2488 0.14 MB/sec execute 518 sec latency 3573.972 ms 2024-02-17T13:22:46.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2490 0.14 MB/sec execute 519 sec latency 3658.756 ms 2024-02-17T13:22:47.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2491 0.14 MB/sec execute 520 sec latency 2910.112 ms 2024-02-17T13:22:48.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2496 0.14 MB/sec execute 521 sec latency 2945.469 ms 2024-02-17T13:22:49.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2499 0.14 MB/sec execute 522 sec latency 2970.070 ms 2024-02-17T13:22:50.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2506 0.14 MB/sec execute 523 sec latency 2972.921 ms 2024-02-17T13:22:51.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2507 0.14 MB/sec execute 524 sec latency 2916.800 ms 2024-02-17T13:22:52.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2509 0.14 MB/sec execute 525 sec latency 3307.389 ms 2024-02-17T13:22:53.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2512 0.14 MB/sec execute 526 sec latency 3136.201 ms 2024-02-17T13:22:54.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2513 0.14 MB/sec execute 527 sec latency 2776.874 ms 2024-02-17T13:22:55.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2523 0.14 MB/sec execute 528 sec latency 3002.729 ms 2024-02-17T13:22:56.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2524 0.14 MB/sec execute 529 sec latency 2806.294 ms 2024-02-17T13:22:57.241 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2526 0.14 MB/sec execute 530 sec latency 2594.722 ms 2024-02-17T13:22:58.100 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:25:52.963 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.103 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:25:52.967 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.142 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:25:53.006 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.156 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:25:52.950 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.159 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:25:52.953 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.160 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:25:52.954 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.162 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:25:52.956 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.194 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:25:52.987 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.195 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:25:52.989 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:22:58.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2533 0.14 MB/sec execute 531 sec latency 2251.883 ms 2024-02-17T13:22:59.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2535 0.14 MB/sec execute 532 sec latency 2190.880 ms 2024-02-17T13:23:00.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2538 0.14 MB/sec execute 533 sec latency 2749.283 ms 2024-02-17T13:23:01.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2543 0.14 MB/sec execute 534 sec latency 2701.391 ms 2024-02-17T13:23:02.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2548 0.14 MB/sec execute 535 sec latency 2877.780 ms 2024-02-17T13:23:03.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2561 0.14 MB/sec execute 536 sec latency 2846.117 ms 2024-02-17T13:23:04.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2562 0.14 MB/sec execute 537 sec latency 2362.342 ms 2024-02-17T13:23:05.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2565 0.14 MB/sec execute 538 sec latency 2799.107 ms 2024-02-17T13:23:06.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2568 0.14 MB/sec execute 539 sec latency 2824.081 ms 2024-02-17T13:23:06.450 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:23:06.453 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:23:07.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2569 0.14 MB/sec execute 540 sec latency 2589.621 ms 2024-02-17T13:23:08.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2572 0.14 MB/sec execute 541 sec latency 2969.470 ms 2024-02-17T13:23:09.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2575 0.14 MB/sec execute 542 sec latency 2828.973 ms 2024-02-17T13:23:10.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2576 0.14 MB/sec execute 543 sec latency 3671.802 ms 2024-02-17T13:23:11.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2577 0.14 MB/sec execute 544 sec latency 2978.672 ms 2024-02-17T13:23:12.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2588 0.15 MB/sec execute 545 sec latency 2270.326 ms 2024-02-17T13:23:13.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2589 0.15 MB/sec execute 546 sec latency 3003.044 ms 2024-02-17T13:23:14.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2596 0.15 MB/sec execute 547 sec latency 2389.307 ms 2024-02-17T13:23:15.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2597 0.15 MB/sec execute 548 sec latency 3389.361 ms 2024-02-17T13:23:16.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2603 0.15 MB/sec execute 549 sec latency 3403.105 ms 2024-02-17T13:23:17.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2604 0.15 MB/sec execute 550 sec latency 3582.993 ms 2024-02-17T13:23:18.242 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2605 0.15 MB/sec execute 551 sec latency 2376.933 ms 2024-02-17T13:23:19.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2607 0.15 MB/sec execute 552 sec latency 2988.380 ms 2024-02-17T13:23:20.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2608 0.15 MB/sec execute 553 sec latency 3076.342 ms 2024-02-17T13:23:21.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2611 0.15 MB/sec execute 554 sec latency 2541.362 ms 2024-02-17T13:23:22.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2613 0.15 MB/sec execute 555 sec latency 3210.223 ms 2024-02-17T13:23:23.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2615 0.15 MB/sec execute 556 sec latency 3023.340 ms 2024-02-17T13:23:24.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2619 0.15 MB/sec execute 557 sec latency 3017.073 ms 2024-02-17T13:23:25.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2620 0.15 MB/sec execute 558 sec latency 3154.361 ms 2024-02-17T13:23:26.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2623 0.15 MB/sec execute 559 sec latency 3409.716 ms 2024-02-17T13:23:27.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2625 0.15 MB/sec execute 560 sec latency 3753.977 ms 2024-02-17T13:23:28.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2635 0.15 MB/sec execute 561 sec latency 2814.066 ms 2024-02-17T13:23:29.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2637 0.15 MB/sec execute 562 sec latency 2999.997 ms 2024-02-17T13:23:30.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2638 0.15 MB/sec execute 563 sec latency 2536.656 ms 2024-02-17T13:23:31.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2643 0.15 MB/sec execute 564 sec latency 2805.043 ms 2024-02-17T13:23:32.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2646 0.15 MB/sec execute 565 sec latency 2933.215 ms 2024-02-17T13:23:33.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2655 0.15 MB/sec execute 566 sec latency 2223.962 ms 2024-02-17T13:23:34.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2659 0.15 MB/sec execute 567 sec latency 2557.867 ms 2024-02-17T13:23:35.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2677 0.16 MB/sec execute 568 sec latency 2590.463 ms 2024-02-17T13:23:36.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2678 0.16 MB/sec execute 569 sec latency 2817.678 ms 2024-02-17T13:23:36.615 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:23:36.618 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:23:37.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2680 0.16 MB/sec execute 570 sec latency 3037.007 ms 2024-02-17T13:23:38.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2690 0.16 MB/sec execute 571 sec latency 2680.641 ms 2024-02-17T13:23:39.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2698 0.17 MB/sec execute 572 sec latency 2654.079 ms 2024-02-17T13:23:40.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2708 0.17 MB/sec execute 573 sec latency 2780.856 ms 2024-02-17T13:23:41.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2714 0.17 MB/sec execute 574 sec latency 2567.298 ms 2024-02-17T13:23:42.243 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2725 0.17 MB/sec execute 575 sec latency 2523.771 ms 2024-02-17T13:23:43.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2734 0.18 MB/sec execute 576 sec latency 2813.615 ms 2024-02-17T13:23:44.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2760 0.19 MB/sec execute 577 sec latency 2801.072 ms 2024-02-17T13:23:45.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2770 0.19 MB/sec execute 578 sec latency 2891.178 ms 2024-02-17T13:23:46.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2774 0.19 MB/sec execute 579 sec latency 3155.280 ms 2024-02-17T13:23:47.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2778 0.19 MB/sec execute 580 sec latency 2793.862 ms 2024-02-17T13:23:48.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2788 0.19 MB/sec execute 581 sec latency 2412.285 ms 2024-02-17T13:23:49.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2790 0.19 MB/sec execute 582 sec latency 2127.455 ms 2024-02-17T13:23:50.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2793 0.19 MB/sec execute 583 sec latency 2974.930 ms 2024-02-17T13:23:51.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2797 0.19 MB/sec execute 584 sec latency 3083.361 ms 2024-02-17T13:23:52.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2801 0.19 MB/sec execute 585 sec latency 2307.330 ms 2024-02-17T13:23:53.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2804 0.19 MB/sec execute 586 sec latency 2715.030 ms 2024-02-17T13:23:54.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2816 0.19 MB/sec execute 587 sec latency 2642.410 ms 2024-02-17T13:23:55.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2824 0.19 MB/sec execute 588 sec latency 3340.445 ms 2024-02-17T13:23:56.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2827 0.19 MB/sec execute 589 sec latency 3264.762 ms 2024-02-17T13:23:57.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2838 0.19 MB/sec execute 590 sec latency 3023.235 ms 2024-02-17T13:23:58.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2841 0.19 MB/sec execute 591 sec latency 2527.514 ms 2024-02-17T13:23:59.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2853 0.19 MB/sec execute 592 sec latency 2126.670 ms 2024-02-17T13:24:00.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2856 0.19 MB/sec execute 593 sec latency 3126.703 ms 2024-02-17T13:24:01.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2860 0.19 MB/sec execute 594 sec latency 3755.954 ms 2024-02-17T13:24:02.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2873 0.19 MB/sec execute 595 sec latency 2870.703 ms 2024-02-17T13:24:03.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2875 0.19 MB/sec execute 596 sec latency 2723.847 ms 2024-02-17T13:24:04.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2881 0.19 MB/sec execute 597 sec latency 2909.204 ms 2024-02-17T13:24:05.244 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2911 0.19 MB/sec execute 598 sec latency 3135.779 ms 2024-02-17T13:24:06.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 2913 0.19 MB/sec execute 599 sec latency 1605.072 ms 2024-02-17T13:24:06.761 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:24:06.764 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:24:07.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 600 sec 2024-02-17T13:24:08.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 601 sec 2024-02-17T13:24:09.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 602 sec 2024-02-17T13:24:10.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 603 sec 2024-02-17T13:24:11.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 604 sec 2024-02-17T13:24:12.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 605 sec 2024-02-17T13:24:13.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 606 sec 2024-02-17T13:24:14.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 607 sec 2024-02-17T13:24:15.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 608 sec 2024-02-17T13:24:16.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 609 sec 2024-02-17T13:24:17.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 610 sec 2024-02-17T13:24:18.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 611 sec 2024-02-17T13:24:19.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 612 sec 2024-02-17T13:24:20.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 613 sec 2024-02-17T13:24:21.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 614 sec 2024-02-17T13:24:22.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 615 sec 2024-02-17T13:24:23.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 616 sec 2024-02-17T13:24:24.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 617 sec 2024-02-17T13:24:25.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 618 sec 2024-02-17T13:24:26.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 619 sec 2024-02-17T13:24:27.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 620 sec 2024-02-17T13:24:28.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 621 sec 2024-02-17T13:24:29.245 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 622 sec 2024-02-17T13:24:30.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 623 sec 2024-02-17T13:24:31.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 624 sec 2024-02-17T13:24:32.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 625 sec 2024-02-17T13:24:33.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 626 sec 2024-02-17T13:24:34.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 627 sec 2024-02-17T13:24:35.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 628 sec 2024-02-17T13:24:36.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 629 sec 2024-02-17T13:24:37.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:24:37.116 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:24:37.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 630 sec 2024-02-17T13:24:38.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 631 sec 2024-02-17T13:24:39.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 632 sec 2024-02-17T13:24:40.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 633 sec 2024-02-17T13:24:41.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 634 sec 2024-02-17T13:24:42.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 635 sec 2024-02-17T13:24:43.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 636 sec 2024-02-17T13:24:44.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 637 sec 2024-02-17T13:24:45.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 638 sec 2024-02-17T13:24:46.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 639 sec 2024-02-17T13:24:47.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 640 sec 2024-02-17T13:24:48.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 641 sec 2024-02-17T13:24:49.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 642 sec 2024-02-17T13:24:50.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 643 sec 2024-02-17T13:24:51.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 644 sec 2024-02-17T13:24:52.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 645 sec 2024-02-17T13:24:53.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 646 sec 2024-02-17T13:24:54.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 647 sec 2024-02-17T13:24:55.246 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 648 sec 2024-02-17T13:24:56.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 649 sec 2024-02-17T13:24:57.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 650 sec 2024-02-17T13:24:58.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 651 sec 2024-02-17T13:24:59.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 652 sec 2024-02-17T13:25:00.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 653 sec 2024-02-17T13:25:01.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 654 sec 2024-02-17T13:25:02.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 655 sec 2024-02-17T13:25:03.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 656 sec 2024-02-17T13:25:04.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 657 sec 2024-02-17T13:25:05.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 658 sec 2024-02-17T13:25:06.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 659 sec 2024-02-17T13:25:07.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:25:07.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:25:07.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 660 sec 2024-02-17T13:25:08.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 661 sec 2024-02-17T13:25:09.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 662 sec 2024-02-17T13:25:10.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 663 sec 2024-02-17T13:25:10.539 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:28:05.402 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.545 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:28:05.408 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.551 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:28:05.344 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.554 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:28:05.347 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.555 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:28:05.348 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.557 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:28:05.350 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.606 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:28:05.469 37426== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.616 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:28:05.409 37511== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:10.617 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:28:05.410 37512== Warning: unimplemented fcntl command: 1036 2024-02-17T13:25:11.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 664 sec 2024-02-17T13:25:12.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 665 sec 2024-02-17T13:25:13.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 666 sec 2024-02-17T13:25:14.247 INFO:tasks.workunit.client.0.smithi136.stdout: 10 cleanup 667 sec 2024-02-17T13:25:15.247 INFO:tasks.workunit.client.0.smithi136.stdout: 9 cleanup 668 sec 2024-02-17T13:25:16.247 INFO:tasks.workunit.client.0.smithi136.stdout: 7 cleanup 669 sec 2024-02-17T13:25:17.247 INFO:tasks.workunit.client.0.smithi136.stdout: 4 cleanup 670 sec 2024-02-17T13:25:18.247 INFO:tasks.workunit.client.0.smithi136.stdout: 4 cleanup 671 sec 2024-02-17T13:25:19.247 INFO:tasks.workunit.client.0.smithi136.stdout: 1 cleanup 672 sec 2024-02-17T13:25:19.461 INFO:tasks.workunit.client.0.smithi136.stdout: 0 cleanup 672 sec 2024-02-17T13:25:19.461 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Operation Count AvgLat MaxLat 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: ---------------------------------------- 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: NTCreateX 3684 318.089 2151.284 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Close 3115 3.371 74.694 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Rename 185 987.887 1644.437 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Unlink 418 337.774 1068.281 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Qpathinfo 3650 211.028 2801.497 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Qfileinfo 753 6.418 61.260 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Qfsinfo 476 19.240 90.235 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Sfileinfo 470 41.363 149.526 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: Find 1221 2944.597 6342.276 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: WriteX 2092 12.920 550.169 2024-02-17T13:25:19.462 INFO:tasks.workunit.client.0.smithi136.stdout: ReadX 5938 0.079 14.056 2024-02-17T13:25:19.463 INFO:tasks.workunit.client.0.smithi136.stdout: LockX 20 160.512 414.356 2024-02-17T13:25:19.463 INFO:tasks.workunit.client.0.smithi136.stdout: UnlockX 20 129.577 237.697 2024-02-17T13:25:19.463 INFO:tasks.workunit.client.0.smithi136.stdout: Flush 301 271.774 723.519 2024-02-17T13:25:19.463 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-02-17T13:25:19.463 INFO:tasks.workunit.client.0.smithi136.stdout:Throughput 0.194535 MB/sec 10 clients 10 procs max_latency=6342.284 ms 2024-02-17T13:25:19.463 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-17T13:25:19.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-17T13:25:37.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:25:37.305 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:25:41.195 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-02-17T13:25:41.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-17T13:25:41.466 DEBUG:teuthology.parallel:result is None 2024-02-17T13:25:41.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-17T13:25:41.698 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-17T13:25:41.698 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-17T13:25:41.708 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-17T13:25:41.708 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T13:25:41.708 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T13:25:41.725 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T13:25:41.726 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T13:25:41.781 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T13:25:41.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.921+0000 7f9dacef4640 1 Processor -- start 2024-02-17T13:25:41.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.921+0000 7f9dacef4640 1 -- start start 2024-02-17T13:25:41.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.922+0000 7f9dacef4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9da806cad0 0x7f9da8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.922+0000 7f9dacef4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.922+0000 7f9dacef4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9da814fca0 0x7f9da8150110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.922+0000 7f9dacef4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da80c5fa0 con 0x7f9da806cad0 2024-02-17T13:25:41.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.922+0000 7f9dacef4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da8156fb0 con 0x7f9da814fca0 2024-02-17T13:25:41.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.922+0000 7f9dacef4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c61d0 con 0x7f9da80c7670 2024-02-17T13:25:41.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.923+0000 7f9da659c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9da806cad0 0x7f9da8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.923+0000 7f9da5d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.923+0000 7f9da6d9d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9da814fca0 0x7f9da8150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.923+0000 7f9da5d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da806ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:51980/0 (socket says 172.21.15.136:51980) 2024-02-17T13:25:41.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.923+0000 7f9da5d9b640 1 -- 172.21.15.136:0/486626962 learned_addr learned my addr 172.21.15.136:0/486626962 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:41.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.926+0000 7f9da659c640 1 -- 172.21.15.136:0/486626962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 msgr2=0x7f9da806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:41.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.926+0000 7f9da659c640 1 --2- 172.21.15.136:0/486626962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da806ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.926+0000 7f9da659c640 1 -- 172.21.15.136:0/486626962 >> v2:172.21.15.160:3300/0 conn(0x7f9da814fca0 msgr2=0x7f9da8150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:41.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.926+0000 7f9da659c640 1 --2- 172.21.15.136:0/486626962 >> v2:172.21.15.160:3300/0 conn(0x7f9da814fca0 0x7f9da8150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.926+0000 7f9da659c640 1 -- 172.21.15.136:0/486626962 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80c6490 con 0x7f9da806cad0 2024-02-17T13:25:41.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.928+0000 7f9da659c640 1 --2- 172.21.15.136:0/486626962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da806cad0 0x7f9da8156a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9da8074640 tx=0x7f9da002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33a4c87e4072078 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:41.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9da559a640 1 -- 172.21.15.136:0/486626962 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0031830 con 0x7f9da806cad0 2024-02-17T13:25:41.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9da559a640 1 -- 172.21.15.136:0/486626962 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da0031990 con 0x7f9da806cad0 2024-02-17T13:25:41.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9da559a640 1 -- 172.21.15.136:0/486626962 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0031d20 con 0x7f9da806cad0 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 -- 172.21.15.136:0/486626962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da806cad0 msgr2=0x7f9da8156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 --2- 172.21.15.136:0/486626962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da806cad0 0x7f9da8156a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9da8074640 tx=0x7f9da002b8d0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 -- 172.21.15.136:0/486626962 shutdown_connections 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 --2- 172.21.15.136:0/486626962 >> v2:172.21.15.160:3300/0 conn(0x7f9da814fca0 0x7f9da8150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 --2- 172.21.15.136:0/486626962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da806ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 --2- 172.21.15.136:0/486626962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da806cad0 0x7f9da8156a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.932+0000 7f9dacef4640 1 -- 172.21.15.136:0/486626962 >> 172.21.15.136:0/486626962 conn(0x7f9da80c7e90 msgr2=0x7f9da80c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.933+0000 7f9dacef4640 1 -- 172.21.15.136:0/486626962 shutdown_connections 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.933+0000 7f9dacef4640 1 -- 172.21.15.136:0/486626962 wait complete. 2024-02-17T13:25:41.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.934+0000 7f9dacef4640 1 Processor -- start 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.934+0000 7f9dacef4640 1 -- start start 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9dacef4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9da806cad0 0x7f9da81eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9dacef4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9dacef4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 0x7f9da80ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9dacef4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c9cd0 con 0x7f9da814fca0 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9dacef4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81ebfd0 con 0x7f9da806cad0 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9dacef4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80cb140 con 0x7f9da80c7670 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9da6d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 0x7f9da80ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9da5d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9da659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9da806cad0 0x7f9da81eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9da6d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 0x7f9da80ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33200/0 (socket says 172.21.15.136:33200) 2024-02-17T13:25:41.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.935+0000 7f9da6d9d640 1 -- 172.21.15.136:0/577764510 learned_addr learned my addr 172.21.15.136:0/577764510 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:41.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.939+0000 7f9da6d9d640 1 -- 172.21.15.136:0/577764510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 msgr2=0x7f9da814cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:41.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.939+0000 7f9da6d9d640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da814cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.939+0000 7f9da6d9d640 1 -- 172.21.15.136:0/577764510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9da806cad0 msgr2=0x7f9da81eba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:41.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.939+0000 7f9da6d9d640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9da806cad0 0x7f9da81eba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:41.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.939+0000 7f9da6d9d640 1 -- 172.21.15.136:0/577764510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0009400 con 0x7f9da814fca0 2024-02-17T13:25:41.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.942+0000 7f9da6d9d640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 0x7f9da80ca590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e7f0 tx=0x7f9d9800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.945+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98009510 con 0x7f9da814fca0 2024-02-17T13:25:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.945+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9800ee40 con 0x7f9da814fca0 2024-02-17T13:25:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.945+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800cb80 con 0x7f9da814fca0 2024-02-17T13:25:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.945+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da80cae60 con 0x7f9da814fca0 2024-02-17T13:25:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.945+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da81ec890 con 0x7f9da814fca0 2024-02-17T13:25:41.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.946+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da80c3200 con 0x7f9da814fca0 2024-02-17T13:25:41.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.965+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9d9800cce0 con 0x7f9da814fca0 2024-02-17T13:25:41.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.966+0000 7f9d96ffd640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9d8806b860 0x7f9d8806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:41.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.966+0000 7f9da659c640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9d8806b860 0x7f9d8806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:41.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:41.966+0000 7f9da659c640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9d8806b860 0x7f9d8806dd20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9da0036000 tx=0x7f9da003c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:42.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.208+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f9d98059110 con 0x7f9da814fca0 2024-02-17T13:25:42.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.208+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d980553b0 con 0x7f9da814fca0 2024-02-17T13:25:42.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.382+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9da80718a0 con 0x7f9da814fca0 2024-02-17T13:25:42.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.423+0000 7f9d96ffd640 1 -- 172.21.15.136:0/577764510 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f9d98021090 con 0x7f9da814fca0 2024-02-17T13:25:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:25:42.425 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9d8806b860 msgr2=0x7f9d8806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9d8806b860 0x7f9d8806dd20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9da0036000 tx=0x7f9da003c040 comp rx=0 tx=0).stop 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 msgr2=0x7f9da80ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 0x7f9da80ca590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e7f0 tx=0x7f9d9800ebf0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 shutdown_connections 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f9d8806b860 0x7f9d8806dd20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da814fca0 0x7f9da80ca590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9da80c7670 0x7f9da814cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 --2- 172.21.15.136:0/577764510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9da806cad0 0x7f9da81eba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 >> 172.21.15.136:0/577764510 conn(0x7f9da80c7e90 msgr2=0x7f9da8148150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 shutdown_connections 2024-02-17T13:25:42.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.426+0000 7f9dacef4640 1 -- 172.21.15.136:0/577764510 wait complete. 2024-02-17T13:25:42.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:57:54.504936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:57:56.035257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T12:58:00.288619+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T13:25:42.440 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T13:25:42.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.547+0000 7ff416b48640 1 Processor -- start 2024-02-17T13:25:42.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.547+0000 7ff416b48640 1 -- start start 2024-02-17T13:25:42.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.548+0000 7ff416b48640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff4100c4e80 0x7ff41006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:42.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.548+0000 7ff416b48640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 0x7ff4100c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:42.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.548+0000 7ff416b48640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410150f30 con 0x7ff410150b50 2024-02-17T13:25:42.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.548+0000 7ff416b48640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100c64d0 con 0x7ff4100c4e80 2024-02-17T13:25:42.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.548+0000 7ff416b48640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100c5f10 con 0x7ff41006aac0 2024-02-17T13:25:42.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.548+0000 7ff4150e5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 0x7ff4100c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:42.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.549+0000 7ff4150e5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 0x7ff4100c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:51990/0 (socket says 172.21.15.136:51990) 2024-02-17T13:25:42.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.549+0000 7ff4150e5640 1 -- 172.21.15.136:0/3206285568 learned_addr learned my addr 172.21.15.136:0/3206285568 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:42.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.551+0000 7ff4150e5640 1 -- 172.21.15.136:0/3206285568 >> v2:172.21.15.136:3300/0 conn(0x7ff4100c4e80 msgr2=0x7ff41006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:42.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.551+0000 7ff4150e5640 1 --2- 172.21.15.136:0/3206285568 >> v2:172.21.15.136:3300/0 conn(0x7ff4100c4e80 0x7ff41006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.551+0000 7ff4150e5640 1 -- 172.21.15.136:0/3206285568 >> v1:172.21.15.136:6789/0 conn(0x7ff410150b50 legacy=0x7ff4100c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:42.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.551+0000 7ff4150e5640 1 -- 172.21.15.136:0/3206285568 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100c61f0 con 0x7ff41006aac0 2024-02-17T13:25:42.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.554+0000 7ff4150e5640 1 --2- 172.21.15.136:0/3206285568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 0x7ff4100c7150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff40800d150 tx=0x7ff40802e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bcdd6b5fe60e96f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:42.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.605+0000 7ff4077fe640 1 -- 172.21.15.136:0/3206285568 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40802ea80 con 0x7ff41006aac0 2024-02-17T13:25:42.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.605+0000 7ff4077fe640 1 -- 172.21.15.136:0/3206285568 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40802ebe0 con 0x7ff41006aac0 2024-02-17T13:25:42.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.605+0000 7ff4077fe640 1 -- 172.21.15.136:0/3206285568 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408009600 con 0x7ff41006aac0 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 -- 172.21.15.136:0/3206285568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 msgr2=0x7ff4100c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 --2- 172.21.15.136:0/3206285568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 0x7ff4100c7150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff40800d150 tx=0x7ff40802e0e0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 -- 172.21.15.136:0/3206285568 shutdown_connections 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 --2- 172.21.15.136:0/3206285568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff41006aac0 0x7ff4100c7150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 --2- 172.21.15.136:0/3206285568 >> v2:172.21.15.136:3300/0 conn(0x7ff4100c4e80 0x7ff41006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 -- 172.21.15.136:0/3206285568 >> 172.21.15.136:0/3206285568 conn(0x7ff4100c7e90 msgr2=0x7ff4100c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 -- 172.21.15.136:0/3206285568 shutdown_connections 2024-02-17T13:25:42.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.606+0000 7ff416b48640 1 -- 172.21.15.136:0/3206285568 wait complete. 2024-02-17T13:25:42.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 Processor -- start 2024-02-17T13:25:42.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 -- start start 2024-02-17T13:25:42.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff41006aac0 0x7ff4101eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:42.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4100c4e80 0x7ff4100c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:42.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff410150b50 0x7ff41014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:42.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101558f0 con 0x7ff41006aac0 2024-02-17T13:25:42.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101eeb40 con 0x7ff410150b50 2024-02-17T13:25:42.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.608+0000 7ff416b48640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41014c040 con 0x7ff4100c4e80 2024-02-17T13:25:42.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.609+0000 7ff4148e4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff41006aac0 0x7ff4101eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:42.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.609+0000 7ff4150e5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff410150b50 0x7ff41014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:42.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.609+0000 7ff4148e4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff41006aac0 0x7ff4101eefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33210/0 (socket says 172.21.15.136:33210) 2024-02-17T13:25:42.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.609+0000 7ff4148e4640 1 -- 172.21.15.136:0/2891085454 learned_addr learned my addr 172.21.15.136:0/2891085454 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:42.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.611+0000 7ff407fff640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4100c4e80 0x7ff4100c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:42.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.613+0000 7ff4150e5640 1 -- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4100c4e80 msgr2=0x7ff4100c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:42.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.613+0000 7ff4150e5640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4100c4e80 0x7ff4100c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.613+0000 7ff4150e5640 1 -- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff41006aac0 msgr2=0x7ff4101eefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:42.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.613+0000 7ff4150e5640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff41006aac0 0x7ff4101eefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:42.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.613+0000 7ff4150e5640 1 -- 172.21.15.136:0/2891085454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40800bd40 con 0x7ff410150b50 2024-02-17T13:25:42.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.616+0000 7ff4150e5640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff410150b50 0x7ff41014f2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff408034000 tx=0x7ff408004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:42.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.620+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40802ea80 con 0x7ff410150b50 2024-02-17T13:25:42.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.620+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff408040660 con 0x7ff410150b50 2024-02-17T13:25:42.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.620+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41014b7c0 con 0x7ff410150b50 2024-02-17T13:25:42.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.620+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408040a50 con 0x7ff410150b50 2024-02-17T13:25:42.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.620+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41014bd60 con 0x7ff410150b50 2024-02-17T13:25:42.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.621+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4101eec80 con 0x7ff410150b50 2024-02-17T13:25:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.640+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff40802ed50 con 0x7ff410150b50 2024-02-17T13:25:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.640+0000 7ff4057fa640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff3fc06b860 0x7ff3fc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:42.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.640+0000 7ff4148e4640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff3fc06b860 0x7ff3fc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:42.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.640+0000 7ff4148e4640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff3fc06b860 0x7ff3fc06dd20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0018b0 tx=0x7ff40c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:42.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.642+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7ff40807e310 con 0x7ff410150b50 2024-02-17T13:25:42.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:42.890+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff408079eb0 con 0x7ff410150b50 2024-02-17T13:25:43.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.060+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff41004efc0 con 0x7ff410150b50 2024-02-17T13:25:43.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.064+0000 7ff4057fa640 1 -- 172.21.15.136:0/2891085454 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff40807d570 con 0x7ff410150b50 2024-02-17T13:25:43.065 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T13:25:43.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff3fc06b860 msgr2=0x7ff3fc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff3fc06b860 0x7ff3fc06dd20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0018b0 tx=0x7ff40c009040 comp rx=0 tx=0).stop 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff410150b50 msgr2=0x7ff41014f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff410150b50 0x7ff41014f2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff408034000 tx=0x7ff408004a40 comp rx=0 tx=0).stop 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 shutdown_connections 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff3fc06b860 0x7ff3fc06dd20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff410150b50 0x7ff41014f2b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4100c4e80 0x7ff4100c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 --2- 172.21.15.136:0/2891085454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff41006aac0 0x7ff4101eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 >> 172.21.15.136:0/2891085454 conn(0x7ff4100c7e90 msgr2=0x7ff41006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 shutdown_connections 2024-02-17T13:25:43.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.067+0000 7ff416b48640 1 -- 172.21.15.136:0/2891085454 wait complete. 2024-02-17T13:25:43.079 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T13:25:43.183 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.183+0000 7fd15a9bc640 1 Processor -- start 2024-02-17T13:25:43.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.183+0000 7fd15a9bc640 1 -- start start 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd15a9bc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd154153d30 0x7fd154159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd15a9bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1540c5e20 0x7fd1540c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd15a9bc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1540c67b0 con 0x7fd154154110 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd15a9bc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd154070e00 con 0x7fd154153d30 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd15a9bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540710e0 con 0x7fd1540c5e20 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd153fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd154153d30 0x7fd154159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd158f59640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1540c5e20 0x7fd1540c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd1537fe640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd154154110 0x7fd15406da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:33738/0 (socket says 172.21.15.136:33738) 2024-02-17T13:25:43.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.184+0000 7fd1537fe640 1 -- 172.21.15.136:0/3376921124 learned_addr learned my addr 172.21.15.136:0/3376921124 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:43.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.187+0000 7fd153fff640 1 -- 172.21.15.136:0/3376921124 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1540c5e20 msgr2=0x7fd1540c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:43.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.187+0000 7fd153fff640 1 --2- 172.21.15.136:0/3376921124 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1540c5e20 0x7fd1540c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.187+0000 7fd153fff640 1 -- 172.21.15.136:0/3376921124 >> v1:172.21.15.160:6789/0 conn(0x7fd154154110 legacy=0x7fd15406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.187+0000 7fd153fff640 1 -- 172.21.15.136:0/3376921124 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540c6a50 con 0x7fd154153d30 2024-02-17T13:25:43.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.187+0000 7fd152ffd640 1 -- 172.21.15.136:0/3376921124 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949188683 0 0) 0x7fd1540c67b0 con 0x7fd154154110 2024-02-17T13:25:43.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.187+0000 7fd158f59640 1 --2- 172.21.15.136:0/3376921124 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1540c5e20 0x7fd1540c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T13:25:43.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.189+0000 7fd153fff640 1 --2- 172.21.15.136:0/3376921124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd154153d30 0x7fd154159b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd1480097a0 tx=0x7fd14802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b1b7797643f697 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:43.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.192+0000 7fd152ffd640 1 -- 172.21.15.136:0/3376921124 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148031830 con 0x7fd154153d30 2024-02-17T13:25:43.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.192+0000 7fd152ffd640 1 -- 172.21.15.136:0/3376921124 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148031990 con 0x7fd154153d30 2024-02-17T13:25:43.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.192+0000 7fd152ffd640 1 -- 172.21.15.136:0/3376921124 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148031d20 con 0x7fd154153d30 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3376921124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd154153d30 msgr2=0x7fd154159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3376921124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd154153d30 0x7fd154159b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd1480097a0 tx=0x7fd14802b8d0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3376921124 shutdown_connections 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3376921124 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1540c5e20 0x7fd1540c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3376921124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd154153d30 0x7fd154159b90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3376921124 >> 172.21.15.136:0/3376921124 conn(0x7fd1540c7e90 msgr2=0x7fd1540c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3376921124 shutdown_connections 2024-02-17T13:25:43.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.193+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3376921124 wait complete. 2024-02-17T13:25:43.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.194+0000 7fd15a9bc640 1 Processor -- start 2024-02-17T13:25:43.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 -- start start 2024-02-17T13:25:43.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1540c5e20 0x7fd154158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd154153d30 0x7fd15414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 0x7fd15414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541efb70 con 0x7fd1540c5e20 2024-02-17T13:25:43.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd154149c20 con 0x7fd154153d30 2024-02-17T13:25:43.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.195+0000 7fd15a9bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541f0060 con 0x7fd15414c970 2024-02-17T13:25:43.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.196+0000 7fd153fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1540c5e20 0x7fd154158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.196+0000 7fd158f59640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 0x7fd15414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.196+0000 7fd1537fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd154153d30 0x7fd15414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.196+0000 7fd158f59640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 0x7fd15414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:52012/0 (socket says 172.21.15.136:52012) 2024-02-17T13:25:43.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.196+0000 7fd158f59640 1 -- 172.21.15.136:0/3517570695 learned_addr learned my addr 172.21.15.136:0/3517570695 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:43.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.199+0000 7fd158f59640 1 -- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd154153d30 msgr2=0x7fd15414ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.199+0000 7fd158f59640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd154153d30 0x7fd15414ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.199+0000 7fd158f59640 1 -- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1540c5e20 msgr2=0x7fd154158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.199+0000 7fd158f59640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1540c5e20 0x7fd154158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.199+0000 7fd158f59640 1 -- 172.21.15.136:0/3517570695 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009a70 con 0x7fd15414c970 2024-02-17T13:25:43.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.202+0000 7fd158f59640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 0x7fd15414b2e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00efc0 tx=0x7fd14c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:43.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.206+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c009d70 con 0x7fd15414c970 2024-02-17T13:25:43.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.206+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00f040 con 0x7fd15414c970 2024-02-17T13:25:43.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.206+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c003990 con 0x7fd15414c970 2024-02-17T13:25:43.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.206+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd148009400 con 0x7fd15414c970 2024-02-17T13:25:43.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.206+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd154149e70 con 0x7fd15414c970 2024-02-17T13:25:43.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.207+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15414aaa0 con 0x7fd15414c970 2024-02-17T13:25:43.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.457+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd14c014480 con 0x7fd15414c970 2024-02-17T13:25:43.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.457+0000 7fd150ff9640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd14006b860 0x7fd14006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.457+0000 7fd153fff640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd14006b860 0x7fd14006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.458+0000 7fd153fff640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd14006b860 0x7fd14006dd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd148036000 tx=0x7fd14803c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:43.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.460+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fd14c059ce0 con 0x7fd15414c970 2024-02-17T13:25:43.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.470+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd14c059ab0 con 0x7fd15414c970 2024-02-17T13:25:43.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.648+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd15415aa90 con 0x7fd15414c970 2024-02-17T13:25:43.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.654+0000 7fd150ff9640 1 -- 172.21.15.136:0/3517570695 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd14c018020 con 0x7fd15414c970 2024-02-17T13:25:43.654 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd14006b860 msgr2=0x7fd14006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd14006b860 0x7fd14006dd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd148036000 tx=0x7fd14803c040 comp rx=0 tx=0).stop 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 msgr2=0x7fd15414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 0x7fd15414b2e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00efc0 tx=0x7fd14c009f90 comp rx=0 tx=0).stop 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 shutdown_connections 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd14006b860 0x7fd14006dd20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd15414c970 0x7fd15414b2e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd154153d30 0x7fd15414ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 --2- 172.21.15.136:0/3517570695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1540c5e20 0x7fd154158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 >> 172.21.15.136:0/3517570695 conn(0x7fd1540c7e90 msgr2=0x7fd1540c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:43.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 shutdown_connections 2024-02-17T13:25:43.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.655+0000 7fd15a9bc640 1 -- 172.21.15.136:0/3517570695 wait complete. 2024-02-17T13:25:43.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T13:25:43.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.771+0000 7fe0e9e98640 1 Processor -- start 2024-02-17T13:25:43.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.771+0000 7fe0e9e98640 1 -- start start 2024-02-17T13:25:43.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.772+0000 7fe0e9e98640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.772+0000 7fe0e9e98640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40c9a10 con 0x7fe0e40c9560 2024-02-17T13:25:43.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.772+0000 7fe0e9e98640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40c8b60 con 0x7fe0e41572b0 2024-02-17T13:25:43.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.772+0000 7fe0e9e98640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4159e40 con 0x7fe0e4157690 2024-02-17T13:25:43.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.773+0000 7fe0e3fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe0e40c9560 0x7fe0e40cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60594/0 (socket says 172.21.15.136:60594) 2024-02-17T13:25:43.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.773+0000 7fe0e3fff640 1 -- 172.21.15.136:0/2168923576 learned_addr learned my addr 172.21.15.136:0/2168923576 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:43.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.773+0000 7fe0e2ffd640 1 --2- 172.21.15.136:0/2168923576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.775+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435821425 0 0) 0x7fe0e40c8b60 con 0x7fe0e41572b0 2024-02-17T13:25:43.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.775+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0cc003520 con 0x7fe0e41572b0 2024-02-17T13:25:43.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.775+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930806325 0 0) 0x7fe0e40c9a10 con 0x7fe0e40c9560 2024-02-17T13:25:43.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.776+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e40c8b60 con 0x7fe0e40c9560 2024-02-17T13:25:43.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.776+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/2168923576 >> v1:172.21.15.160:6789/0 conn(0x7fe0e41572b0 legacy=0x7fe0e406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.776+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/2168923576 >> v1:172.21.15.136:6789/0 conn(0x7fe0e40c9560 legacy=0x7fe0e40cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.776+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/2168923576 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e415a030 con 0x7fe0e4157690 2024-02-17T13:25:43.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.778+0000 7fe0e2ffd640 1 --2- 172.21.15.136:0/2168923576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e40c9020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80097d0 tx=0x7fe0d802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a52f07ded0a1d871 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:43.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.781+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8031890 con 0x7fe0e4157690 2024-02-17T13:25:43.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.781+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80319f0 con 0x7fe0e4157690 2024-02-17T13:25:43.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e27fc640 1 -- 172.21.15.136:0/2168923576 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8031d80 con 0x7fe0e4157690 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 -- 172.21.15.136:0/2168923576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 msgr2=0x7fe0e40c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/2168923576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e40c9020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80097d0 tx=0x7fe0d802b930 comp rx=0 tx=0).stop 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 -- 172.21.15.136:0/2168923576 shutdown_connections 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/2168923576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e40c9020 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 -- 172.21.15.136:0/2168923576 >> 172.21.15.136:0/2168923576 conn(0x7fe0e406bbd0 msgr2=0x7fe0e406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 -- 172.21.15.136:0/2168923576 shutdown_connections 2024-02-17T13:25:43.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.782+0000 7fe0e9e98640 1 -- 172.21.15.136:0/2168923576 wait complete. 2024-02-17T13:25:43.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.783+0000 7fe0e9e98640 1 Processor -- start 2024-02-17T13:25:43.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 -- start start 2024-02-17T13:25:43.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e40c9560 0x7fe0e414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 0x7fe0e41f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e41f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41efb30 con 0x7fe0e41572b0 2024-02-17T13:25:43.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4158aa0 con 0x7fe0e40c9560 2024-02-17T13:25:43.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.784+0000 7fe0e9e98640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40c6430 con 0x7fe0e4157690 2024-02-17T13:25:43.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.785+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 0x7fe0e41f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.785+0000 7fe0e3fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e41f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.785+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 0x7fe0e41f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33236/0 (socket says 172.21.15.136:33236) 2024-02-17T13:25:43.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.785+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/4040295346 learned_addr learned my addr 172.21.15.136:0/4040295346 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:43.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.785+0000 7fe0e37fe640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e40c9560 0x7fe0e414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.788+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 msgr2=0x7fe0e41f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.788+0000 7fe0e2ffd640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e41f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.788+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e40c9560 msgr2=0x7fe0e414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:43.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.788+0000 7fe0e2ffd640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e40c9560 0x7fe0e414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:43.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.788+0000 7fe0e2ffd640 1 -- 172.21.15.136:0/4040295346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009400 con 0x7fe0e41572b0 2024-02-17T13:25:43.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.788+0000 7fe0e3fff640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e41f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T13:25:43.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.791+0000 7fe0e2ffd640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 0x7fe0e41f36f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8034040 tx=0x7fe0d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:43.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.794+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d803abe0 con 0x7fe0e41572b0 2024-02-17T13:25:43.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.794+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d803ad60 con 0x7fe0e41572b0 2024-02-17T13:25:43.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.794+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e40c5840 con 0x7fe0e41572b0 2024-02-17T13:25:43.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.794+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8044640 con 0x7fe0e41572b0 2024-02-17T13:25:43.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.794+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e40c6150 con 0x7fe0e41572b0 2024-02-17T13:25:43.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.796+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e4156b10 con 0x7fe0e41572b0 2024-02-17T13:25:43.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.816+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe0d804d440 con 0x7fe0e41572b0 2024-02-17T13:25:43.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.816+0000 7fe0cbfff640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe0d006b890 0x7fe0d006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:43.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.816+0000 7fe0e37fe640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe0d006b890 0x7fe0d006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:43.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:43.817+0000 7fe0e37fe640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe0d006b890 0x7fe0d006dd50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40017b0 tx=0x7fe0d4009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.057+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fe0d807b330 con 0x7fe0e41572b0 2024-02-17T13:25:44.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.057+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0d80775d0 con 0x7fe0e41572b0 2024-02-17T13:25:44.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.229+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0e4150720 con 0x7fe0e41572b0 2024-02-17T13:25:44.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.234+0000 7fe0cbfff640 1 -- 172.21.15.136:0/4040295346 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0d8035030 con 0x7fe0e41572b0 2024-02-17T13:25:44.235 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-02-17T13:25:44.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe0d006b890 msgr2=0x7fe0d006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe0d006b890 0x7fe0d006dd50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40017b0 tx=0x7fe0d4009040 comp rx=0 tx=0).stop 2024-02-17T13:25:44.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 msgr2=0x7fe0e41f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 0x7fe0e41f36f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8034040 tx=0x7fe0d80046c0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 shutdown_connections 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe0d006b890 0x7fe0d006dd50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0e4157690 0x7fe0e41f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e41572b0 0x7fe0e41f36f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 --2- 172.21.15.136:0/4040295346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e40c9560 0x7fe0e414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.236+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 >> 172.21.15.136:0/4040295346 conn(0x7fe0e406bbd0 msgr2=0x7fe0e41596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.237+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 shutdown_connections 2024-02-17T13:25:44.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.237+0000 7fe0e9e98640 1 -- 172.21.15.136:0/4040295346 wait complete. 2024-02-17T13:25:44.248 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T13:25:44.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.351+0000 7fa097255640 1 Processor -- start 2024-02-17T13:25:44.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.351+0000 7fa097255640 1 -- start start 2024-02-17T13:25:44.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.352+0000 7fa097255640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 0x7fa0900c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.352+0000 7fa097255640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa0900c9750 0x7fa090070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.352+0000 7fa097255640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900c8340 con 0x7fa090151e20 2024-02-17T13:25:44.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.352+0000 7fa097255640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900c9c00 con 0x7fa0900c9750 2024-02-17T13:25:44.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.352+0000 7fa097255640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900ca3a0 con 0x7fa0900c4420 2024-02-17T13:25:44.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.353+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 0x7fa0900c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.353+0000 7fa0957f2640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa0900c9750 0x7fa090070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.353+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 0x7fa0900c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:52032/0 (socket says 172.21.15.136:52032) 2024-02-17T13:25:44.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.353+0000 7fa08ffff640 1 -- 172.21.15.136:0/333010298 learned_addr learned my addr 172.21.15.136:0/333010298 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:44.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.355+0000 7fa08ffff640 1 -- 172.21.15.136:0/333010298 >> v2:172.21.15.160:3300/0 conn(0x7fa0900c9750 msgr2=0x7fa090070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:44.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.355+0000 7fa08ffff640 1 --2- 172.21.15.136:0/333010298 >> v2:172.21.15.160:3300/0 conn(0x7fa0900c9750 0x7fa090070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.355+0000 7fa08ffff640 1 -- 172.21.15.136:0/333010298 >> v1:172.21.15.160:6789/0 conn(0x7fa090151e20 legacy=0x7fa0900c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.355+0000 7fa08ffff640 1 -- 172.21.15.136:0/333010298 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900c94d0 con 0x7fa0900c4420 2024-02-17T13:25:44.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.357+0000 7fa08ffff640 1 --2- 172.21.15.136:0/333010298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 0x7fa0900c8760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009870 tx=0x7fa07c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a1ce203942fc58 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.361+0000 7fa08f7fe640 1 -- 172.21.15.136:0/333010298 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c030840 con 0x7fa0900c4420 2024-02-17T13:25:44.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.361+0000 7fa08f7fe640 1 -- 172.21.15.136:0/333010298 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0309a0 con 0x7fa0900c4420 2024-02-17T13:25:44.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.361+0000 7fa08f7fe640 1 -- 172.21.15.136:0/333010298 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c030d30 con 0x7fa0900c4420 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 -- 172.21.15.136:0/333010298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 msgr2=0x7fa0900c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 --2- 172.21.15.136:0/333010298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 0x7fa0900c8760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009870 tx=0x7fa07c02b980 comp rx=0 tx=0).stop 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 -- 172.21.15.136:0/333010298 shutdown_connections 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 --2- 172.21.15.136:0/333010298 >> v2:172.21.15.160:3300/0 conn(0x7fa0900c9750 0x7fa090070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 --2- 172.21.15.136:0/333010298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0900c4420 0x7fa0900c8760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 -- 172.21.15.136:0/333010298 >> 172.21.15.136:0/333010298 conn(0x7fa09006fe80 msgr2=0x7fa09006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 -- 172.21.15.136:0/333010298 shutdown_connections 2024-02-17T13:25:44.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.362+0000 7fa097255640 1 -- 172.21.15.136:0/333010298 wait complete. 2024-02-17T13:25:44.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.363+0000 7fa097255640 1 Processor -- start 2024-02-17T13:25:44.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.363+0000 7fa097255640 1 -- start start 2024-02-17T13:25:44.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa097255640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0900c4420 0x7fa090144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa097255640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0900c9750 0x7fa090146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa097255640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 0x7fa090143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa097255640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09014f720 con 0x7fa0900c9750 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa097255640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09014deb0 con 0x7fa0900c4420 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa097255640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa090150510 con 0x7fa090151e20 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa094ff1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0900c4420 0x7fa090144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.364+0000 7fa0957f2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 0x7fa090143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.365+0000 7fa0957f2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 0x7fa090143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:52034/0 (socket says 172.21.15.136:52034) 2024-02-17T13:25:44.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.365+0000 7fa0957f2640 1 -- 172.21.15.136:0/3632865534 learned_addr learned my addr 172.21.15.136:0/3632865534 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:44.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.368+0000 7fa0957f2640 1 -- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0900c4420 msgr2=0x7fa090144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.368+0000 7fa0957f2640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0900c4420 0x7fa090144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.368+0000 7fa0957f2640 1 -- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0900c9750 msgr2=0x7fa090146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.368+0000 7fa0957f2640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0900c9750 0x7fa090146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.368+0000 7fa0957f2640 1 -- 172.21.15.136:0/3632865534 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0094d0 con 0x7fa090151e20 2024-02-17T13:25:44.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.370+0000 7fa0957f2640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 0x7fa090143f00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa08800efc0 tx=0x7fa08800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.375+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088014480 con 0x7fa090151e20 2024-02-17T13:25:44.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.375+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08800f040 con 0x7fa090151e20 2024-02-17T13:25:44.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.375+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088014840 con 0x7fa090151e20 2024-02-17T13:25:44.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.375+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0901507f0 con 0x7fa090151e20 2024-02-17T13:25:44.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.375+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa090158060 con 0x7fa090151e20 2024-02-17T13:25:44.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.375+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0900c7b20 con 0x7fa090151e20 2024-02-17T13:25:44.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.393+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa0880149a0 con 0x7fa090151e20 2024-02-17T13:25:44.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.393+0000 7fa08d7fa640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa07406b840 0x7fa07406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.394+0000 7fa094ff1640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa07406b840 0x7fa07406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.394+0000 7fa094ff1640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa07406b840 0x7fa07406dd00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa0840016e0 tx=0x7fa084009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.396+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fa08805a3a0 con 0x7fa090151e20 2024-02-17T13:25:44.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.637+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa088055f40 con 0x7fa090151e20 2024-02-17T13:25:44.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.824+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa090067e00 con 0x7fa090151e20 2024-02-17T13:25:44.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.830+0000 7fa08d7fa640 1 -- 172.21.15.136:0/3632865534 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa088018020 con 0x7fa090151e20 2024-02-17T13:25:44.830 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T13:25:44.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.831+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa07406b840 msgr2=0x7fa07406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.831+0000 7fa097255640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa07406b840 0x7fa07406dd00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa0840016e0 tx=0x7fa084009040 comp rx=0 tx=0).stop 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.831+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 msgr2=0x7fa090143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.831+0000 7fa097255640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 0x7fa090143f00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa08800efc0 tx=0x7fa08800c490 comp rx=0 tx=0).stop 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 shutdown_connections 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fa07406b840 0x7fa07406dd00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa090151e20 0x7fa090143f00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0900c9750 0x7fa090146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 --2- 172.21.15.136:0/3632865534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0900c4420 0x7fa090144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 >> 172.21.15.136:0/3632865534 conn(0x7fa09006fe80 msgr2=0x7fa09006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 shutdown_connections 2024-02-17T13:25:44.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.832+0000 7fa097255640 1 -- 172.21.15.136:0/3632865534 wait complete. 2024-02-17T13:25:44.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T13:25:44.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.945+0000 7f39f5fd0640 1 Processor -- start 2024-02-17T13:25:44.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.945+0000 7f39f5fd0640 1 -- start start 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.946+0000 7f39f5fd0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39f0157450 0x7f39f0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.946+0000 7f39f5fd0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f0157830 con 0x7f39f00c7e30 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.946+0000 7f39f5fd0640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f00caab0 con 0x7f39f006bbd0 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.946+0000 7f39f5fd0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f006cd20 con 0x7f39f0157450 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.947+0000 7f39ef7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39f0157450 0x7f39f0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.947+0000 7f39effff640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f39f006bbd0 0x7f39f0164650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:33760/0 (socket says 172.21.15.136:33760) 2024-02-17T13:25:44.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.947+0000 7f39effff640 1 -- 172.21.15.136:0/1664031285 learned_addr learned my addr 172.21.15.136:0/1664031285 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:44.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.949+0000 7f39ee7fc640 1 -- 172.21.15.136:0/1664031285 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476170300 0 0) 0x7f39f00caab0 con 0x7f39f006bbd0 2024-02-17T13:25:44.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.949+0000 7f39ee7fc640 1 -- 172.21.15.136:0/1664031285 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d8003520 con 0x7f39f006bbd0 2024-02-17T13:25:44.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.951+0000 7f39ef7fe640 1 -- 172.21.15.136:0/1664031285 >> v1:172.21.15.160:6789/0 conn(0x7f39f006bbd0 legacy=0x7f39f0164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.951+0000 7f39ef7fe640 1 -- 172.21.15.136:0/1664031285 >> v1:172.21.15.136:6789/0 conn(0x7f39f00c7e30 legacy=0x7f39f0070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.952+0000 7f39ef7fe640 1 -- 172.21.15.136:0/1664031285 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f006c130 con 0x7f39f0157450 2024-02-17T13:25:44.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.954+0000 7f39ef7fe640 1 --2- 172.21.15.136:0/1664031285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f0157450 0x7f39f0159db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f39e00097a0 tx=0x7f39e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b882e84dd2b9db00 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39ee7fc640 1 -- 172.21.15.136:0/1664031285 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0031830 con 0x7f39f0157450 2024-02-17T13:25:44.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39ee7fc640 1 -- 172.21.15.136:0/1664031285 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0031990 con 0x7f39f0157450 2024-02-17T13:25:44.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39ee7fc640 1 -- 172.21.15.136:0/1664031285 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0031d20 con 0x7f39f0157450 2024-02-17T13:25:44.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1664031285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f0157450 msgr2=0x7f39f0159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1664031285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f0157450 0x7f39f0159db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f39e00097a0 tx=0x7f39e002b8d0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1664031285 shutdown_connections 2024-02-17T13:25:44.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1664031285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f0157450 0x7f39f0159db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1664031285 >> 172.21.15.136:0/1664031285 conn(0x7f39f006fe80 msgr2=0x7f39f006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:44.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1664031285 shutdown_connections 2024-02-17T13:25:44.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.959+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1664031285 wait complete. 2024-02-17T13:25:44.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.961+0000 7f39f5fd0640 1 Processor -- start 2024-02-17T13:25:44.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.961+0000 7f39f5fd0640 1 -- start start 2024-02-17T13:25:44.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39f5fd0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39f006bbd0 0x7f39f015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39f5fd0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 0x7f39f0158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39f5fd0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39f0157450 0x7f39f01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39f5fd0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01f0dc0 con 0x7f39f00c7e30 2024-02-17T13:25:44.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39f5fd0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01586f0 con 0x7f39f006bbd0 2024-02-17T13:25:44.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39f5fd0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01f0240 con 0x7f39f0157450 2024-02-17T13:25:44.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.962+0000 7f39eeffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 0x7f39f0158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.963+0000 7f39ef7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39f006bbd0 0x7f39f015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.963+0000 7f39eeffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 0x7f39f0158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33262/0 (socket says 172.21.15.136:33262) 2024-02-17T13:25:44.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.963+0000 7f39effff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39f0157450 0x7f39f01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.963+0000 7f39eeffd640 1 -- 172.21.15.136:0/1527737548 learned_addr learned my addr 172.21.15.136:0/1527737548 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:44.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.966+0000 7f39eeffd640 1 -- 172.21.15.136:0/1527737548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39f0157450 msgr2=0x7f39f01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.966+0000 7f39eeffd640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39f0157450 0x7f39f01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.966+0000 7f39eeffd640 1 -- 172.21.15.136:0/1527737548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39f006bbd0 msgr2=0x7f39f015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:44.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.966+0000 7f39eeffd640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39f006bbd0 0x7f39f015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:44.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.966+0000 7f39eeffd640 1 -- 172.21.15.136:0/1527737548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0009400 con 0x7f39f00c7e30 2024-02-17T13:25:44.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.968+0000 7f39eeffd640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 0x7f39f0158b80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39e400c480 tx=0x7f39e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.972+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40052d0 con 0x7f39f00c7e30 2024-02-17T13:25:44.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.972+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4005430 con 0x7f39f00c7e30 2024-02-17T13:25:44.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.972+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f01f0520 con 0x7f39f00c7e30 2024-02-17T13:25:44.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.972+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4012870 con 0x7f39f00c7e30 2024-02-17T13:25:44.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.972+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f01f0ae0 con 0x7f39f00c7e30 2024-02-17T13:25:44.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.973+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f0154fa0 con 0x7f39f00c7e30 2024-02-17T13:25:44.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.991+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f39e40129d0 con 0x7f39f00c7e30 2024-02-17T13:25:44.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.992+0000 7f39d7fff640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f39dc06b890 0x7f39dc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:44.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.992+0000 7f39ef7fe640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f39dc06b890 0x7f39dc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:44.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.992+0000 7f39ef7fe640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f39dc06b890 0x7f39dc06dd50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f39e0036000 tx=0x7f39e003c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:44.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:44.995+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f39e4058fd0 con 0x7f39f00c7e30 2024-02-17T13:25:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.280+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39e4055270 con 0x7f39f00c7e30 2024-02-17T13:25:45.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.468+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f39f0067e00 con 0x7f39f00c7e30 2024-02-17T13:25:45.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.472+0000 7f39d7fff640 1 -- 172.21.15.136:0/1527737548 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f39e4058930 con 0x7f39f00c7e30 2024-02-17T13:25:45.473 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f39dc06b890 msgr2=0x7f39dc06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f39dc06b890 0x7f39dc06dd50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f39e0036000 tx=0x7f39e003c040 comp rx=0 tx=0).stop 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 msgr2=0x7f39f0158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 0x7f39f0158b80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39e400c480 tx=0x7f39e400c940 comp rx=0 tx=0).stop 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 shutdown_connections 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f39dc06b890 0x7f39dc06dd50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39f0157450 0x7f39f01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39f00c7e30 0x7f39f0158b80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 --2- 172.21.15.136:0/1527737548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39f006bbd0 0x7f39f015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 >> 172.21.15.136:0/1527737548 conn(0x7f39f006fe80 msgr2=0x7f39f01553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:45.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 shutdown_connections 2024-02-17T13:25:45.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.475+0000 7f39f5fd0640 1 -- 172.21.15.136:0/1527737548 wait complete. 2024-02-17T13:25:45.487 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-02-17T13:25:45.487 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T13:25:45.502 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T13:25:45.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.642+0000 7ff9a3de9640 1 Processor -- start 2024-02-17T13:25:45.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.642+0000 7ff9a3de9640 1 -- start start 2024-02-17T13:25:45.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.642+0000 7ff9a3de9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:45.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.642+0000 7ff9a3de9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0c3fe0 con 0x7ff99c0c7db0 2024-02-17T13:25:45.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.642+0000 7ff9a3de9640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0c3a20 con 0x7ff99c150e70 2024-02-17T13:25:45.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.642+0000 7ff9a3de9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0c3810 con 0x7ff99c0c6c10 2024-02-17T13:25:45.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.643+0000 7ff9a2386640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff99c0c7db0 0x7ff99c161300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60610/0 (socket says 172.21.15.136:60610) 2024-02-17T13:25:45.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.643+0000 7ff9a2386640 1 -- 172.21.15.136:0/56837640 learned_addr learned my addr 172.21.15.136:0/56837640 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:45.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.643+0000 7ff9a1384640 1 --2- 172.21.15.136:0/56837640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485674038 0 0) 0x7ff99c0c3fe0 con 0x7ff99c0c7db0 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988003520 con 0x7ff99c0c7db0 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507213446 0 0) 0x7ff99c0c3a20 con 0x7ff99c150e70 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff99c0c3fe0 con 0x7ff99c150e70 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a1384640 1 -- 172.21.15.136:0/56837640 >> v1:172.21.15.160:6789/0 conn(0x7ff99c150e70 legacy=0x7ff99c0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a1384640 1 -- 172.21.15.136:0/56837640 >> v1:172.21.15.136:6789/0 conn(0x7ff99c0c7db0 legacy=0x7ff99c161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.646+0000 7ff9a1384640 1 -- 172.21.15.136:0/56837640 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0c3d00 con 0x7ff99c0c6c10 2024-02-17T13:25:45.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.648+0000 7ff9a1384640 1 --2- 172.21.15.136:0/56837640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c072c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0c3950 tx=0x7ff98c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6691a5882f80c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:45.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.652+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031890 con 0x7ff99c0c6c10 2024-02-17T13:25:45.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.652+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0319f0 con 0x7ff99c0c6c10 2024-02-17T13:25:45.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.652+0000 7ff9a0b83640 1 -- 172.21.15.136:0/56837640 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031d80 con 0x7ff99c0c6c10 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 -- 172.21.15.136:0/56837640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 msgr2=0x7ff99c072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/56837640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c072c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0c3950 tx=0x7ff98c02b930 comp rx=0 tx=0).stop 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 -- 172.21.15.136:0/56837640 shutdown_connections 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/56837640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c072c60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 -- 172.21.15.136:0/56837640 >> 172.21.15.136:0/56837640 conn(0x7ff99c06bbd0 msgr2=0x7ff99c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 -- 172.21.15.136:0/56837640 shutdown_connections 2024-02-17T13:25:45.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.653+0000 7ff9a3de9640 1 -- 172.21.15.136:0/56837640 wait complete. 2024-02-17T13:25:45.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.654+0000 7ff9a3de9640 1 Processor -- start 2024-02-17T13:25:45.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.654+0000 7ff9a3de9640 1 -- start start 2024-02-17T13:25:45.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.655+0000 7ff9a3de9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:45.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.655+0000 7ff9a3de9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff99c0c7db0 0x7ff99c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:45.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.655+0000 7ff9a3de9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 0x7ff99c0cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:45.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.655+0000 7ff9a3de9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1ed5b0 con 0x7ff99c150e70 2024-02-17T13:25:45.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.655+0000 7ff9a3de9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1ed7a0 con 0x7ff99c0c7db0 2024-02-17T13:25:45.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.655+0000 7ff9a3de9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1eda80 con 0x7ff99c0c6c10 2024-02-17T13:25:45.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.656+0000 7ff9a2386640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 0x7ff99c0cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:45.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.656+0000 7ff9a1b85640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:45.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.656+0000 7ff9a1384640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff99c0c7db0 0x7ff99c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:45.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.656+0000 7ff9a2386640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 0x7ff99c0cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33272/0 (socket says 172.21.15.136:33272) 2024-02-17T13:25:45.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.656+0000 7ff9a2386640 1 -- 172.21.15.136:0/1961280735 learned_addr learned my addr 172.21.15.136:0/1961280735 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:45.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.659+0000 7ff9a2386640 1 -- 172.21.15.136:0/1961280735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 msgr2=0x7ff99c156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.659+0000 7ff9a2386640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.659+0000 7ff9a2386640 1 -- 172.21.15.136:0/1961280735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff99c0c7db0 msgr2=0x7ff99c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:45.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.659+0000 7ff9a2386640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff99c0c7db0 0x7ff99c0cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:45.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.659+0000 7ff9a2386640 1 -- 172.21.15.136:0/1961280735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009400 con 0x7ff99c150e70 2024-02-17T13:25:45.662 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.662+0000 7ff9a2386640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 0x7ff99c0cc860 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff99400cb40 tx=0x7ff99400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:45.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.665+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400aca0 con 0x7ff99c150e70 2024-02-17T13:25:45.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.665+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400ae20 con 0x7ff99c150e70 2024-02-17T13:25:45.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.665+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994012640 con 0x7ff99c150e70 2024-02-17T13:25:45.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.665+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c1edd60 con 0x7ff99c150e70 2024-02-17T13:25:45.666 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.665+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c1ee320 con 0x7ff99c150e70 2024-02-17T13:25:45.667 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.666+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c068110 con 0x7ff99c150e70 2024-02-17T13:25:45.686 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.685+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff994007070 con 0x7ff99c150e70 2024-02-17T13:25:45.686 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.686+0000 7ff9927fc640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff98006b860 0x7ff98006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:45.686 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.686+0000 7ff9a1b85640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff98006b860 0x7ff98006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:45.687 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.686+0000 7ff9a1b85640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff98006b860 0x7ff98006dd20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff998007fd0 tx=0x7ff998009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:45.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.928+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7ff994058e40 con 0x7ff99c150e70 2024-02-17T13:25:45.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:45.928+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9940550e0 con 0x7ff99c150e70 2024-02-17T13:25:46.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.106+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99c1ee510 con 0x7ff99c150e70 2024-02-17T13:25:46.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.147+0000 7ff9927fc640 1 -- 172.21.15.136:0/1961280735 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7ff9940587a0 con 0x7ff99c150e70 2024-02-17T13:25:46.147 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:25:46.147 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff98006b860 msgr2=0x7ff98006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff98006b860 0x7ff98006dd20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff998007fd0 tx=0x7ff998009040 comp rx=0 tx=0).stop 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 msgr2=0x7ff99c0cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 0x7ff99c0cc860 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff99400cb40 tx=0x7ff99400a060 comp rx=0 tx=0).stop 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 shutdown_connections 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff98006b860 0x7ff98006dd20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c150e70 0x7ff99c0cc860 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff99c0c7db0 0x7ff99c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 --2- 172.21.15.136:0/1961280735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99c0c6c10 0x7ff99c156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 >> 172.21.15.136:0/1961280735 conn(0x7ff99c06bbd0 msgr2=0x7ff99c14ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:46.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 shutdown_connections 2024-02-17T13:25:46.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.148+0000 7ff9a3de9640 1 -- 172.21.15.136:0/1961280735 wait complete. 2024-02-17T13:25:46.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:57:42.236617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:57:54.504936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:57:56.035257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T12:58:00.288619+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T13:25:46.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T13:25:46.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.263+0000 7fb278039640 1 Processor -- start 2024-02-17T13:25:46.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.263+0000 7fb278039640 1 -- start start 2024-02-17T13:25:46.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.264+0000 7fb278039640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb270153dc0 0x7fb27006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.264+0000 7fb278039640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb2700cdac0 0x7fb2700cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.264+0000 7fb278039640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27015a710 con 0x7fb2700c7ed0 2024-02-17T13:25:46.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.264+0000 7fb278039640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2700c25f0 con 0x7fb2700cdac0 2024-02-17T13:25:46.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.264+0000 7fb278039640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb270159bd0 con 0x7fb270153dc0 2024-02-17T13:25:46.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.265+0000 7fb2765d6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb2700cdac0 0x7fb2700cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.265+0000 7fb275dd5640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb270153dc0 0x7fb27006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.265+0000 7fb2765d6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb2700cdac0 0x7fb2700cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33284/0 (socket says 172.21.15.136:33284) 2024-02-17T13:25:46.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.265+0000 7fb2765d6640 1 -- 172.21.15.136:0/2855574774 learned_addr learned my addr 172.21.15.136:0/2855574774 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:46.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.267+0000 7fb2765d6640 1 -- 172.21.15.136:0/2855574774 >> v2:172.21.15.160:3300/0 conn(0x7fb270153dc0 msgr2=0x7fb27006fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:46.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.267+0000 7fb2765d6640 1 --2- 172.21.15.136:0/2855574774 >> v2:172.21.15.160:3300/0 conn(0x7fb270153dc0 0x7fb27006fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.267+0000 7fb2765d6640 1 -- 172.21.15.136:0/2855574774 >> v1:172.21.15.160:6789/0 conn(0x7fb2700c7ed0 legacy=0x7fb27015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.267+0000 7fb2765d6640 1 -- 172.21.15.136:0/2855574774 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2700702c0 con 0x7fb2700cdac0 2024-02-17T13:25:46.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.269+0000 7fb2765d6640 1 --2- 172.21.15.136:0/2855574774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700cdac0 0x7fb2700cdf10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb27006eff0 tx=0x7fb26802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57564176626feff0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:46.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb274dd3640 1 -- 172.21.15.136:0/2855574774 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26802f850 con 0x7fb2700cdac0 2024-02-17T13:25:46.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb274dd3640 1 -- 172.21.15.136:0/2855574774 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26802f9b0 con 0x7fb2700cdac0 2024-02-17T13:25:46.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb274dd3640 1 -- 172.21.15.136:0/2855574774 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26802fd40 con 0x7fb2700cdac0 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 -- 172.21.15.136:0/2855574774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700cdac0 msgr2=0x7fb2700cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 --2- 172.21.15.136:0/2855574774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700cdac0 0x7fb2700cdf10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb27006eff0 tx=0x7fb26802ba30 comp rx=0 tx=0).stop 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 -- 172.21.15.136:0/2855574774 shutdown_connections 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 --2- 172.21.15.136:0/2855574774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700cdac0 0x7fb2700cdf10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 --2- 172.21.15.136:0/2855574774 >> v2:172.21.15.160:3300/0 conn(0x7fb270153dc0 0x7fb27006fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 -- 172.21.15.136:0/2855574774 >> 172.21.15.136:0/2855574774 conn(0x7fb270066d00 msgr2=0x7fb270067110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:46.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 -- 172.21.15.136:0/2855574774 shutdown_connections 2024-02-17T13:25:46.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.274+0000 7fb278039640 1 -- 172.21.15.136:0/2855574774 wait complete. 2024-02-17T13:25:46.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 Processor -- start 2024-02-17T13:25:46.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 -- start start 2024-02-17T13:25:46.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 0x7fb2701f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2700cdac0 0x7fb270158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb270153dc0 0x7fb2700b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700b20a0 con 0x7fb2700c7ed0 2024-02-17T13:25:46.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2701f0aa0 con 0x7fb2700cdac0 2024-02-17T13:25:46.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.275+0000 7fb278039640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700b2530 con 0x7fb270153dc0 2024-02-17T13:25:46.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.276+0000 7fb275dd5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 0x7fb2701f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.276+0000 7fb2765d6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb270153dc0 0x7fb2700b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.276+0000 7fb275dd5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 0x7fb2701f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33298/0 (socket says 172.21.15.136:33298) 2024-02-17T13:25:46.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.276+0000 7fb275dd5640 1 -- 172.21.15.136:0/3921733266 learned_addr learned my addr 172.21.15.136:0/3921733266 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:46.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.276+0000 7fb2755d4640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2700cdac0 0x7fb270158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.280+0000 7fb275dd5640 1 -- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb270153dc0 msgr2=0x7fb2700b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.280+0000 7fb275dd5640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb270153dc0 0x7fb2700b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.280+0000 7fb275dd5640 1 -- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2700cdac0 msgr2=0x7fb270158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.280+0000 7fb275dd5640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2700cdac0 0x7fb270158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.280+0000 7fb275dd5640 1 -- 172.21.15.136:0/3921733266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680094d0 con 0x7fb2700c7ed0 2024-02-17T13:25:46.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.283+0000 7fb275dd5640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 0x7fb2701f0560 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009d10 tx=0x7fb26c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:46.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.285+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c009b80 con 0x7fb2700c7ed0 2024-02-17T13:25:46.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.285+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00f040 con 0x7fb2700c7ed0 2024-02-17T13:25:46.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.285+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2700b3190 con 0x7fb2700c7ed0 2024-02-17T13:25:46.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.285+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c014680 con 0x7fb2700c7ed0 2024-02-17T13:25:46.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.285+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2700b1a50 con 0x7fb2700c7ed0 2024-02-17T13:25:46.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.286+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27006cc70 con 0x7fb2700c7ed0 2024-02-17T13:25:46.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.531+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb26c0147e0 con 0x7fb2700c7ed0 2024-02-17T13:25:46.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.531+0000 7fb2667fc640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb25406b860 0x7fb25406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.531+0000 7fb2755d4640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb25406b860 0x7fb25406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.532+0000 7fb2755d4640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb25406b860 0x7fb25406dd20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2700675b0 tx=0x7fb260009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:46.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.545+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fb26c059c10 con 0x7fb2700c7ed0 2024-02-17T13:25:46.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.545+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb26c055eb0 con 0x7fb2700c7ed0 2024-02-17T13:25:46.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.716+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2700b1540 con 0x7fb2700c7ed0 2024-02-17T13:25:46.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.721+0000 7fb2667fc640 1 -- 172.21.15.136:0/3921733266 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb26c059570 con 0x7fb2700c7ed0 2024-02-17T13:25:46.721 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-02-17T13:25:46.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb25406b860 msgr2=0x7fb25406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb25406b860 0x7fb25406dd20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2700675b0 tx=0x7fb260009040 comp rx=0 tx=0).stop 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 msgr2=0x7fb2701f0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 0x7fb2701f0560 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009d10 tx=0x7fb26c00c490 comp rx=0 tx=0).stop 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 shutdown_connections 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fb25406b860 0x7fb25406dd20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb270153dc0 0x7fb2700b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2700cdac0 0x7fb270158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.723+0000 7fb278039640 1 --2- 172.21.15.136:0/3921733266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2700c7ed0 0x7fb2701f0560 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.724+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 >> 172.21.15.136:0/3921733266 conn(0x7fb270066d00 msgr2=0x7fb2700cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.724+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 shutdown_connections 2024-02-17T13:25:46.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.724+0000 7fb278039640 1 -- 172.21.15.136:0/3921733266 wait complete. 2024-02-17T13:25:46.734 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T13:25:46.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.839+0000 7f97a5987640 1 Processor -- start 2024-02-17T13:25:46.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.839+0000 7f97a5987640 1 -- start start 2024-02-17T13:25:46.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.840+0000 7f97a5987640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a01634e0 0x7f97a01658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.840+0000 7f97a5987640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a006b3e0 con 0x7f97a00ca4e0 2024-02-17T13:25:46.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.840+0000 7f97a5987640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00cb470 con 0x7f97a00cbc00 2024-02-17T13:25:46.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.840+0000 7f97a5987640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00cb750 con 0x7f97a01634e0 2024-02-17T13:25:46.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.840+0000 7f979e7fc640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f97a00ca4e0 0x7f97a00cbfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60618/0 (socket says 172.21.15.136:60618) 2024-02-17T13:25:46.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.840+0000 7f979e7fc640 1 -- 172.21.15.136:0/3102622339 learned_addr learned my addr 172.21.15.136:0/3102622339 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:46.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.841+0000 7f979f7fe640 1 --2- 172.21.15.136:0/3102622339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a01634e0 0x7f97a01658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.843+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018796102 0 0) 0x7f97a006b3e0 con 0x7f97a00ca4e0 2024-02-17T13:25:46.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.843+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9788003520 con 0x7f97a00ca4e0 2024-02-17T13:25:46.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.844+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556143427 0 0) 0x7f97a00cb470 con 0x7f97a00cbc00 2024-02-17T13:25:46.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.844+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a006b3e0 con 0x7f97a00cbc00 2024-02-17T13:25:46.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.845+0000 7f979f7fe640 1 -- 172.21.15.136:0/3102622339 >> v1:172.21.15.160:6789/0 conn(0x7f97a00cbc00 legacy=0x7f97a006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.845+0000 7f979f7fe640 1 -- 172.21.15.136:0/3102622339 >> v1:172.21.15.136:6789/0 conn(0x7f97a00ca4e0 legacy=0x7f97a00cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.845+0000 7f979f7fe640 1 -- 172.21.15.136:0/3102622339 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a015d1f0 con 0x7f97a01634e0 2024-02-17T13:25:46.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.847+0000 7f979f7fe640 1 --2- 172.21.15.136:0/3102622339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a01634e0 0x7f97a01658d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f97980097d0 tx=0x7f979802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d5ed40463f01af server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:46.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798031890 con 0x7f97a01634e0 2024-02-17T13:25:46.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97980319f0 con 0x7f97a01634e0 2024-02-17T13:25:46.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f979dffb640 1 -- 172.21.15.136:0/3102622339 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798031d80 con 0x7f97a01634e0 2024-02-17T13:25:46.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f97a5987640 1 -- 172.21.15.136:0/3102622339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a01634e0 msgr2=0x7f97a01658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f97a5987640 1 --2- 172.21.15.136:0/3102622339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a01634e0 0x7f97a01658d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f97980097d0 tx=0x7f979802b930 comp rx=0 tx=0).stop 2024-02-17T13:25:46.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f97a5987640 1 -- 172.21.15.136:0/3102622339 shutdown_connections 2024-02-17T13:25:46.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.852+0000 7f97a5987640 1 --2- 172.21.15.136:0/3102622339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a01634e0 0x7f97a01658d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.853+0000 7f97a5987640 1 -- 172.21.15.136:0/3102622339 >> 172.21.15.136:0/3102622339 conn(0x7f97a00721f0 msgr2=0x7f97a00725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:46.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.853+0000 7f97a5987640 1 -- 172.21.15.136:0/3102622339 shutdown_connections 2024-02-17T13:25:46.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.853+0000 7f97a5987640 1 -- 172.21.15.136:0/3102622339 wait complete. 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 Processor -- start 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 -- start start 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a00ca4e0 0x7f97a01edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 0x7f97a01ee290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a01634e0 0x7f97a01f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a01ed8c0 con 0x7f97a00cbc00 2024-02-17T13:25:46.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a015cfa0 con 0x7f97a01634e0 2024-02-17T13:25:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.854+0000 7f97a5987640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a015ee20 con 0x7f97a00ca4e0 2024-02-17T13:25:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.855+0000 7f979e7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 0x7f97a01ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.855+0000 7f979effd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a00ca4e0 0x7f97a01edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.855+0000 7f979f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a01634e0 0x7f97a01f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.855+0000 7f979e7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 0x7f97a01ee290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33306/0 (socket says 172.21.15.136:33306) 2024-02-17T13:25:46.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.855+0000 7f979e7fc640 1 -- 172.21.15.136:0/3202063547 learned_addr learned my addr 172.21.15.136:0/3202063547 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:46.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.859+0000 7f979e7fc640 1 -- 172.21.15.136:0/3202063547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a00ca4e0 msgr2=0x7f97a01edd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.859+0000 7f979e7fc640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a00ca4e0 0x7f97a01edd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.859+0000 7f979e7fc640 1 -- 172.21.15.136:0/3202063547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a01634e0 msgr2=0x7f97a01f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:46.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.859+0000 7f979e7fc640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a01634e0 0x7f97a01f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:46.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.859+0000 7f979e7fc640 1 -- 172.21.15.136:0/3202063547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798009400 con 0x7f97a00cbc00 2024-02-17T13:25:46.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.861+0000 7f979e7fc640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 0x7f97a01ee290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f979400c4d0 tx=0x7f979400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:46.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.863+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794007480 con 0x7f97a00cbc00 2024-02-17T13:25:46.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.863+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a015f0c0 con 0x7f97a00cbc00 2024-02-17T13:25:46.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.863+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a00ca040 con 0x7f97a00cbc00 2024-02-17T13:25:46.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.864+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a01eda30 con 0x7f97a00cbc00 2024-02-17T13:25:46.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.866+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9794007db0 con 0x7f97a00cbc00 2024-02-17T13:25:46.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:46.866+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940059a0 con 0x7f97a00cbc00 2024-02-17T13:25:47.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.107+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9794012400 con 0x7f97a00cbc00 2024-02-17T13:25:47.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.108+0000 7f9787fff640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f978c06b840 0x7f978c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.108+0000 7f979effd640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f978c06b840 0x7f978c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.108 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.108+0000 7f979effd640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f978c06b840 0x7f978c06dd00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9790001ea0 tx=0x7f9790009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.125+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f97940075e0 con 0x7f97a00cbc00 2024-02-17T13:25:47.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.125+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9794058530 con 0x7f97a00cbc00 2024-02-17T13:25:47.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.307+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97a004efc0 con 0x7f97a00cbc00 2024-02-17T13:25:47.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.313+0000 7f9787fff640 1 -- 172.21.15.136:0/3202063547 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97940210a0 con 0x7f97a00cbc00 2024-02-17T13:25:47.313 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T13:25:47.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.315+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f978c06b840 msgr2=0x7f978c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f978c06b840 0x7f978c06dd00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9790001ea0 tx=0x7f9790009040 comp rx=0 tx=0).stop 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 msgr2=0x7f97a01ee290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 0x7f97a01ee290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f979400c4d0 tx=0x7f979400c990 comp rx=0 tx=0).stop 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 shutdown_connections 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f978c06b840 0x7f978c06dd00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a01634e0 0x7f97a01f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a00cbc00 0x7f97a01ee290 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 --2- 172.21.15.136:0/3202063547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97a00ca4e0 0x7f97a01edd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 >> 172.21.15.136:0/3202063547 conn(0x7f97a00721f0 msgr2=0x7f97a00cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 shutdown_connections 2024-02-17T13:25:47.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.316+0000 7f97a5987640 1 -- 172.21.15.136:0/3202063547 wait complete. 2024-02-17T13:25:47.327 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T13:25:47.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 Processor -- start 2024-02-17T13:25:47.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 -- start start 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec0151c00 0x7fbec00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbec0070900 0x7fbec0070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec00c84a0 con 0x7fbec00c4270 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec00b0310 con 0x7fbec0070900 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.431+0000 7fbec7127640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01586c0 con 0x7fbec0151c00 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.432+0000 7fbec56c4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbec0070900 0x7fbec0070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.432+0000 7fbec4ec3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec0151c00 0x7fbec00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.432+0000 7fbebffff640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fbec00c4270 0x7fbec006f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:33812/0 (socket says 172.21.15.136:33812) 2024-02-17T13:25:47.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.432+0000 7fbebffff640 1 -- 172.21.15.136:0/139108154 learned_addr learned my addr 172.21.15.136:0/139108154 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:47.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.435+0000 7fbec56c4640 1 -- 172.21.15.136:0/139108154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec0151c00 msgr2=0x7fbec00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:47.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.435+0000 7fbec56c4640 1 --2- 172.21.15.136:0/139108154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec0151c00 0x7fbec00c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.435+0000 7fbec56c4640 1 -- 172.21.15.136:0/139108154 >> v1:172.21.15.160:6789/0 conn(0x7fbec00c4270 legacy=0x7fbec006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.435+0000 7fbec56c4640 1 -- 172.21.15.136:0/139108154 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0158960 con 0x7fbec0070900 2024-02-17T13:25:47.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.437+0000 7fbec56c4640 1 --2- 172.21.15.136:0/139108154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec0070d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00097a0 tx=0x7fbeb002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc1d69ad6dd1dc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:47.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.440+0000 7fbebf7fe640 1 -- 172.21.15.136:0/139108154 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0030610 con 0x7fbec0070900 2024-02-17T13:25:47.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.440+0000 7fbebf7fe640 1 -- 172.21.15.136:0/139108154 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0030770 con 0x7fbec0070900 2024-02-17T13:25:47.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.440+0000 7fbebf7fe640 1 -- 172.21.15.136:0/139108154 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0030b00 con 0x7fbec0070900 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 -- 172.21.15.136:0/139108154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 msgr2=0x7fbec0070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 --2- 172.21.15.136:0/139108154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec0070d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00097a0 tx=0x7fbeb002b960 comp rx=0 tx=0).stop 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 -- 172.21.15.136:0/139108154 shutdown_connections 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 --2- 172.21.15.136:0/139108154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec0070d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 --2- 172.21.15.136:0/139108154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec0151c00 0x7fbec00c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 -- 172.21.15.136:0/139108154 >> 172.21.15.136:0/139108154 conn(0x7fbec006b0f0 msgr2=0x7fbec00668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 -- 172.21.15.136:0/139108154 shutdown_connections 2024-02-17T13:25:47.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.441+0000 7fbec7127640 1 -- 172.21.15.136:0/139108154 wait complete. 2024-02-17T13:25:47.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.442+0000 7fbec7127640 1 Processor -- start 2024-02-17T13:25:47.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.442+0000 7fbec7127640 1 -- start start 2024-02-17T13:25:47.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.443+0000 7fbec7127640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec00aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.443+0000 7fbec7127640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec00c4270 0x7fbec00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.443+0000 7fbec7127640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbec0151c00 0x7fbec0148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.443+0000 7fbec7127640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec014f280 con 0x7fbec0070900 2024-02-17T13:25:47.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.443+0000 7fbec7127640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec006f840 con 0x7fbec0151c00 2024-02-17T13:25:47.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.443+0000 7fbec7127640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec00aecf0 con 0x7fbec00c4270 2024-02-17T13:25:47.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.444+0000 7fbebffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec00c4270 0x7fbec00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.444+0000 7fbec4ec3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec00aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.444+0000 7fbec56c4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbec0151c00 0x7fbec0148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.444+0000 7fbebffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec00c4270 0x7fbec00c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:52114/0 (socket says 172.21.15.136:52114) 2024-02-17T13:25:47.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.444+0000 7fbebffff640 1 -- 172.21.15.136:0/243055337 learned_addr learned my addr 172.21.15.136:0/243055337 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:47.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.448+0000 7fbec4ec3640 1 -- 172.21.15.136:0/243055337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec00c4270 msgr2=0x7fbec00c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.448+0000 7fbec4ec3640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec00c4270 0x7fbec00c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.448+0000 7fbec4ec3640 1 -- 172.21.15.136:0/243055337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbec0151c00 msgr2=0x7fbec0148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.448+0000 7fbec4ec3640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbec0151c00 0x7fbec0148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.448+0000 7fbec4ec3640 1 -- 172.21.15.136:0/243055337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb0009400 con 0x7fbec0070900 2024-02-17T13:25:47.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.450+0000 7fbec4ec3640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec00aefa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800ebc0 tx=0x7fbeb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:47.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.453+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800cda0 con 0x7fbec0070900 2024-02-17T13:25:47.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.454+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb800f040 con 0x7fbec0070900 2024-02-17T13:25:47.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.454+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec01494a0 con 0x7fbec0070900 2024-02-17T13:25:47.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.454+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80146c0 con 0x7fbec0070900 2024-02-17T13:25:47.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.454+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec014a020 con 0x7fbec0070900 2024-02-17T13:25:47.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.455+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec004efc0 con 0x7fbec0070900 2024-02-17T13:25:47.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.473+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbeb8014820 con 0x7fbec0070900 2024-02-17T13:25:47.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.473+0000 7fbebd7fa640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbeac06b860 0x7fbeac06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:47.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.474+0000 7fbebffff640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbeac06b860 0x7fbeac06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:47.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.474+0000 7fbebffff640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbeac06b860 0x7fbeac06dd20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ce540 tx=0x7fbeb4007f10 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:47.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.476+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fbeb8059c60 con 0x7fbec0070900 2024-02-17T13:25:47.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.712+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbeb8055f00 con 0x7fbec0070900 2024-02-17T13:25:47.901 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.902+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbec006fd70 con 0x7fbec0070900 2024-02-17T13:25:47.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.908+0000 7fbebd7fa640 1 -- 172.21.15.136:0/243055337 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbeb80595c0 con 0x7fbec0070900 2024-02-17T13:25:47.908 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbeac06b860 msgr2=0x7fbeac06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbeac06b860 0x7fbeac06dd20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ce540 tx=0x7fbeb4007f10 comp rx=0 tx=0).stop 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 msgr2=0x7fbec00aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec00aefa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800ebc0 tx=0x7fbeb800c490 comp rx=0 tx=0).stop 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 shutdown_connections 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbeac06b860 0x7fbeac06dd20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbec0151c00 0x7fbec0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbec00c4270 0x7fbec00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 --2- 172.21.15.136:0/243055337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec0070900 0x7fbec00aefa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:47.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 >> 172.21.15.136:0/243055337 conn(0x7fbec006b0f0 msgr2=0x7fbec0150960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:47.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 shutdown_connections 2024-02-17T13:25:47.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:47.910+0000 7fbec7127640 1 -- 172.21.15.136:0/243055337 wait complete. 2024-02-17T13:25:47.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T13:25:48.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.025+0000 7f75fc4c9640 1 Processor -- start 2024-02-17T13:25:48.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.025+0000 7f75fc4c9640 1 -- start start 2024-02-17T13:25:48.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.025+0000 7f75fc4c9640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75f4151c00 0x7f75f40c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.026+0000 7f75fc4c9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75f4070900 0x7f75f4070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.026+0000 7f75fc4c9640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f40c84a0 con 0x7f75f40c4270 2024-02-17T13:25:48.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.026+0000 7f75fc4c9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f40b0310 con 0x7f75f4070900 2024-02-17T13:25:48.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.026+0000 7f75fc4c9640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f41586c0 con 0x7f75f4151c00 2024-02-17T13:25:48.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.026+0000 7f75faa66640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75f4070900 0x7f75f4070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.026+0000 7f75fa265640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75f4151c00 0x7f75f40c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.027+0000 7f75faa66640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75f4070900 0x7f75f4070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33340/0 (socket says 172.21.15.136:33340) 2024-02-17T13:25:48.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.027+0000 7f75faa66640 1 -- 172.21.15.136:0/567943245 learned_addr learned my addr 172.21.15.136:0/567943245 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:48.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.029+0000 7f75faa66640 1 -- 172.21.15.136:0/567943245 >> v2:172.21.15.160:3300/0 conn(0x7f75f4151c00 msgr2=0x7f75f40c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:48.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.029+0000 7f75faa66640 1 --2- 172.21.15.136:0/567943245 >> v2:172.21.15.160:3300/0 conn(0x7f75f4151c00 0x7f75f40c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.029+0000 7f75faa66640 1 -- 172.21.15.136:0/567943245 >> v1:172.21.15.160:6789/0 conn(0x7f75f40c4270 legacy=0x7f75f406f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.029+0000 7f75faa66640 1 -- 172.21.15.136:0/567943245 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4158960 con 0x7f75f4070900 2024-02-17T13:25:48.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.030+0000 7f75faa66640 1 --2- 172.21.15.136:0/567943245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f4070900 0x7f75f4070d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f75f40677b0 tx=0x7f75ec02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a8bfc4d2eba1fa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:48.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.034+0000 7f75f9263640 1 -- 172.21.15.136:0/567943245 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec02cbb0 con 0x7f75f4070900 2024-02-17T13:25:48.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.034+0000 7f75f9263640 1 -- 172.21.15.136:0/567943245 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec02cd10 con 0x7f75f4070900 2024-02-17T13:25:48.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.034+0000 7f75f9263640 1 -- 172.21.15.136:0/567943245 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec034610 con 0x7f75f4070900 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 -- 172.21.15.136:0/567943245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f4070900 msgr2=0x7f75f4070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/567943245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f4070900 0x7f75f4070d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f75f40677b0 tx=0x7f75ec02c010 comp rx=0 tx=0).stop 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 -- 172.21.15.136:0/567943245 shutdown_connections 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/567943245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f4070900 0x7f75f4070d30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/567943245 >> v2:172.21.15.160:3300/0 conn(0x7f75f4151c00 0x7f75f40c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 -- 172.21.15.136:0/567943245 >> 172.21.15.136:0/567943245 conn(0x7f75f406b0f0 msgr2=0x7f75f40668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 -- 172.21.15.136:0/567943245 shutdown_connections 2024-02-17T13:25:48.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.035+0000 7f75fc4c9640 1 -- 172.21.15.136:0/567943245 wait complete. 2024-02-17T13:25:48.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.036+0000 7f75fc4c9640 1 Processor -- start 2024-02-17T13:25:48.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.036+0000 7f75fc4c9640 1 -- start start 2024-02-17T13:25:48.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75fc4c9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f4070900 0x7f75f406be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75fc4c9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 0x7f75f41efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75fc4c9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f4151c00 0x7f75f4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75fc4c9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41ef490 con 0x7f75f40c4270 2024-02-17T13:25:48.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75fc4c9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4159fc0 con 0x7f75f4070900 2024-02-17T13:25:48.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75fc4c9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4154b20 con 0x7f75f4151c00 2024-02-17T13:25:48.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.037+0000 7f75f9a64640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 0x7f75f41efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.038+0000 7f75f9a64640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 0x7f75f41efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33354/0 (socket says 172.21.15.136:33354) 2024-02-17T13:25:48.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.038+0000 7f75f9a64640 1 -- 172.21.15.136:0/199900155 learned_addr learned my addr 172.21.15.136:0/199900155 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:48.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.038+0000 7f75faa66640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f4151c00 0x7f75f4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.038+0000 7f75fa265640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f4070900 0x7f75f406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.041+0000 7f75f9a64640 1 -- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f4151c00 msgr2=0x7f75f4159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.041+0000 7f75f9a64640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f4151c00 0x7f75f4159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.041+0000 7f75f9a64640 1 -- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f4070900 msgr2=0x7f75f406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.041+0000 7f75f9a64640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f4070900 0x7f75f406be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.041+0000 7f75f9a64640 1 -- 172.21.15.136:0/199900155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec009b30 con 0x7f75f40c4270 2024-02-17T13:25:48.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.043+0000 7f75f9a64640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 0x7f75f41efba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75f000c400 tx=0x7f75f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:48.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.047+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00052d0 con 0x7f75f40c4270 2024-02-17T13:25:48.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.047+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0005450 con 0x7f75f40c4270 2024-02-17T13:25:48.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.047+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f41f3540 con 0x7f75f40c4270 2024-02-17T13:25:48.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.047+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0007260 con 0x7f75f40c4270 2024-02-17T13:25:48.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.047+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f40cb6e0 con 0x7f75f40c4270 2024-02-17T13:25:48.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.048+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f40cb870 con 0x7f75f40c4270 2024-02-17T13:25:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.292+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f75f00073c0 con 0x7f75f40c4270 2024-02-17T13:25:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.292+0000 7f75eaffd640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f75d806b860 0x7f75d806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.292+0000 7f75fa265640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f75d806b860 0x7f75d806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.293+0000 7f75fa265640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f75d806b860 0x7f75d806dd20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009aa0 tx=0x7f75e4009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:48.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.306+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f75f0007670 con 0x7f75f40c4270 2024-02-17T13:25:48.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.307+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75f0054700 con 0x7f75f40c4270 2024-02-17T13:25:48.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.490+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f75f40c84a0 con 0x7f75f40c4270 2024-02-17T13:25:48.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.500+0000 7f75eaffd640 1 -- 172.21.15.136:0/199900155 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f75f40c84a0 con 0x7f75f40c4270 2024-02-17T13:25:48.499 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f75d806b860 msgr2=0x7f75d806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f75d806b860 0x7f75d806dd20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009aa0 tx=0x7f75e4009190 comp rx=0 tx=0).stop 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 msgr2=0x7f75f41efba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 0x7f75f41efba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75f000c400 tx=0x7f75f000c8c0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 shutdown_connections 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f75d806b860 0x7f75d806dd20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f4151c00 0x7f75f4159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75f40c4270 0x7f75f41efba0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 --2- 172.21.15.136:0/199900155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f4070900 0x7f75f406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 >> 172.21.15.136:0/199900155 conn(0x7f75f406b0f0 msgr2=0x7f75f41566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:48.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 shutdown_connections 2024-02-17T13:25:48.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.502+0000 7f75fc4c9640 1 -- 172.21.15.136:0/199900155 wait complete. 2024-02-17T13:25:48.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T13:25:48.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.615+0000 7f49f9642640 1 Processor -- start 2024-02-17T13:25:48.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.615+0000 7f49f9642640 1 -- start start 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f9642640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f9642640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f49f41624d0 0x7f49f41648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f9642640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40cb470 con 0x7f49f40ca4e0 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f9642640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40cb750 con 0x7f49f41624d0 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f9642640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f415d1f0 con 0x7f49f40cbc00 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f2ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f27fc640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f49f40ca4e0 0x7f49f40cbfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60628/0 (socket says 172.21.15.136:60628) 2024-02-17T13:25:48.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f27fc640 1 -- 172.21.15.136:0/2493133294 learned_addr learned my addr 172.21.15.136:0/2493133294 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:48.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.616+0000 7f49f37fe640 1 --2- 172.21.15.136:0/2493133294 >> v2:172.21.15.160:3300/0 conn(0x7f49f41624d0 0x7f49f41648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.619+0000 7f49f1ffb640 1 -- 172.21.15.136:0/2493133294 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665225680 0 0) 0x7f49f40cb470 con 0x7f49f40ca4e0 2024-02-17T13:25:48.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.619+0000 7f49f1ffb640 1 -- 172.21.15.136:0/2493133294 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49dc003520 con 0x7f49f40ca4e0 2024-02-17T13:25:48.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.619+0000 7f49f2ffd640 1 -- 172.21.15.136:0/2493133294 >> v2:172.21.15.160:3300/0 conn(0x7f49f41624d0 msgr2=0x7f49f41648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:48.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.619+0000 7f49f2ffd640 1 --2- 172.21.15.136:0/2493133294 >> v2:172.21.15.160:3300/0 conn(0x7f49f41624d0 0x7f49f41648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.619+0000 7f49f2ffd640 1 -- 172.21.15.136:0/2493133294 >> v1:172.21.15.136:6789/0 conn(0x7f49f40ca4e0 legacy=0x7f49f40cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.619+0000 7f49f2ffd640 1 -- 172.21.15.136:0/2493133294 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f415d4d0 con 0x7f49f40cbc00 2024-02-17T13:25:48.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.622+0000 7f49f2ffd640 1 --2- 172.21.15.136:0/2493133294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f406acd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49e40097a0 tx=0x7f49e402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe4b8ae4a9ed2c2d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:48.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f1ffb640 1 -- 172.21.15.136:0/2493133294 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4030610 con 0x7f49f40cbc00 2024-02-17T13:25:48.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f1ffb640 1 -- 172.21.15.136:0/2493133294 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4030770 con 0x7f49f40cbc00 2024-02-17T13:25:48.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f1ffb640 1 -- 172.21.15.136:0/2493133294 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4030b00 con 0x7f49f40cbc00 2024-02-17T13:25:48.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 -- 172.21.15.136:0/2493133294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 msgr2=0x7f49f406acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 --2- 172.21.15.136:0/2493133294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f406acd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49e40097a0 tx=0x7f49e402b960 comp rx=0 tx=0).stop 2024-02-17T13:25:48.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 -- 172.21.15.136:0/2493133294 shutdown_connections 2024-02-17T13:25:48.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 --2- 172.21.15.136:0/2493133294 >> v2:172.21.15.160:3300/0 conn(0x7f49f41624d0 0x7f49f41648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 --2- 172.21.15.136:0/2493133294 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f406acd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 -- 172.21.15.136:0/2493133294 >> 172.21.15.136:0/2493133294 conn(0x7f49f40721f0 msgr2=0x7f49f40725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:48.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 -- 172.21.15.136:0/2493133294 shutdown_connections 2024-02-17T13:25:48.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.626+0000 7f49f9642640 1 -- 172.21.15.136:0/2493133294 wait complete. 2024-02-17T13:25:48.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 Processor -- start 2024-02-17T13:25:48.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 -- start start 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 0x7f49f40c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f40c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f41624d0 0x7f49f40c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c5d00 con 0x7f49f40ca4e0 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f415cf30 con 0x7f49f41624d0 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.628+0000 7f49f9642640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c8330 con 0x7f49f40cbc00 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.629+0000 7f49f2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 0x7f49f40c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.629+0000 7f49f27fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f40c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.629+0000 7f49f37fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f41624d0 0x7f49f40c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.629+0000 7f49f2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 0x7f49f40c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33368/0 (socket says 172.21.15.136:33368) 2024-02-17T13:25:48.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.629+0000 7f49f2ffd640 1 -- 172.21.15.136:0/664775029 learned_addr learned my addr 172.21.15.136:0/664775029 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:48.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.633+0000 7f49f2ffd640 1 -- 172.21.15.136:0/664775029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 msgr2=0x7f49f40c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.633+0000 7f49f2ffd640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f40c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.633+0000 7f49f2ffd640 1 -- 172.21.15.136:0/664775029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f41624d0 msgr2=0x7f49f40c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:48.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.633+0000 7f49f2ffd640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f41624d0 0x7f49f40c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:48.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.633+0000 7f49f2ffd640 1 -- 172.21.15.136:0/664775029 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009400 con 0x7f49f40ca4e0 2024-02-17T13:25:48.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.635+0000 7f49f2ffd640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 0x7f49f40c20a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f49e402bf70 tx=0x7f49e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:48.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.638+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e403e040 con 0x7f49f40ca4e0 2024-02-17T13:25:48.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.638+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4039a40 con 0x7f49f40ca4e0 2024-02-17T13:25:48.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.638+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f40cd720 con 0x7f49f40ca4e0 2024-02-17T13:25:48.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.638+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4039df0 con 0x7f49f40ca4e0 2024-02-17T13:25:48.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.639+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4149640 con 0x7f49f40ca4e0 2024-02-17T13:25:48.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.639+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f40cdc40 con 0x7f49f40ca4e0 2024-02-17T13:25:48.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.885+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f49e404d3b0 con 0x7f49f40ca4e0 2024-02-17T13:25:48.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.885+0000 7f49db7fe640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f49e006b860 0x7f49e006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:48.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.885+0000 7f49f27fc640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f49e006b860 0x7f49e006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:48.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.886+0000 7f49f27fc640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f49e006b860 0x7f49e006dd20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49f4151260 tx=0x7f49e8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:48.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.898+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f49e407b180 con 0x7f49f40ca4e0 2024-02-17T13:25:48.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:48.899+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49e4077420 con 0x7f49f40ca4e0 2024-02-17T13:25:49.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.082+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49f40cdc40 con 0x7f49f40ca4e0 2024-02-17T13:25:49.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.087+0000 7f49db7fe640 1 -- 172.21.15.136:0/664775029 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49f40cdc40 con 0x7f49f40ca4e0 2024-02-17T13:25:49.086 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f49e006b860 msgr2=0x7f49e006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f49e006b860 0x7f49e006dd20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49f4151260 tx=0x7f49e8009040 comp rx=0 tx=0).stop 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 msgr2=0x7f49f40c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 0x7f49f40c20a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f49e402bf70 tx=0x7f49e4004730 comp rx=0 tx=0).stop 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 shutdown_connections 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f49e006b860 0x7f49e006dd20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f41624d0 0x7f49f40c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49f40cbc00 0x7f49f40c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 --2- 172.21.15.136:0/664775029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f40ca4e0 0x7f49f40c20a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 >> 172.21.15.136:0/664775029 conn(0x7f49f40721f0 msgr2=0x7f49f40c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 shutdown_connections 2024-02-17T13:25:49.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:49.089+0000 7f49f9642640 1 -- 172.21.15.136:0/664775029 wait complete. 2024-02-17T13:25:49.101 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2024-02-17T13:25:49.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T13:25:49.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-17T13:25:49.128 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:25:49.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:ceph-fuse[48670]: fuse finished with error 0 and tester_r 0 2024-02-17T13:25:49.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:==00:00:26:50.414 48670== 2024-02-17T13:25:49.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:==00:00:26:50.414 48670== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:25:49.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi136.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:25:55.230 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:25:55.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T13:25:55.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T13:25:55.230 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T13:25:55.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T13:25:55.249 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-02-17T13:25:55.305 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T13:25:55.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T13:25:55.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T13:25:55.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T13:25:55.375 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-02-17T13:25:55.480 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-17T13:25:55.489 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T13:25:55.489 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T13:25:55.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.592+0000 7f23ba8ae640 1 Processor -- start 2024-02-17T13:25:55.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.592+0000 7f23ba8ae640 1 -- start start 2024-02-17T13:25:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.593+0000 7f23ba8ae640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f23b4150b50 0x7f23b406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.593+0000 7f23ba8ae640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23b406aac0 0x7f23b40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.593+0000 7f23ba8ae640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b4150f30 con 0x7f23b40c4e80 2024-02-17T13:25:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.593+0000 7f23ba8ae640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b40c64d0 con 0x7f23b406aac0 2024-02-17T13:25:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.593+0000 7f23ba8ae640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b40c5f10 con 0x7f23b4150b50 2024-02-17T13:25:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.594+0000 7f23b3fff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f23b4150b50 0x7f23b406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.594+0000 7f23b8e4b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23b406aac0 0x7f23b40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.594+0000 7f23b37fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f23b40c4e80 0x7f23b40c2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59724/0 (socket says 172.21.15.136:59724) 2024-02-17T13:25:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.594+0000 7f23b37fe640 1 -- 172.21.15.136:0/2760993310 learned_addr learned my addr 172.21.15.136:0/2760993310 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.597+0000 7f23b3fff640 1 -- 172.21.15.136:0/2760993310 >> v2:172.21.15.136:3300/0 conn(0x7f23b406aac0 msgr2=0x7f23b40c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.597+0000 7f23b3fff640 1 --2- 172.21.15.136:0/2760993310 >> v2:172.21.15.136:3300/0 conn(0x7f23b406aac0 0x7f23b40c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.597+0000 7f23b3fff640 1 -- 172.21.15.136:0/2760993310 >> v1:172.21.15.136:6789/0 conn(0x7f23b40c4e80 legacy=0x7f23b40c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.597+0000 7f23b3fff640 1 -- 172.21.15.136:0/2760993310 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40c61f0 con 0x7f23b4150b50 2024-02-17T13:25:55.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.599+0000 7f23b3fff640 1 --2- 172.21.15.136:0/2760993310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b406db70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f23b406e1c0 tx=0x7f23a402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fabe2055c5852e32 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.602+0000 7f23b2ffd640 1 -- 172.21.15.136:0/2760993310 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4031830 con 0x7f23b4150b50 2024-02-17T13:25:55.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.603+0000 7f23b2ffd640 1 -- 172.21.15.136:0/2760993310 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4031990 con 0x7f23b4150b50 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23b2ffd640 1 -- 172.21.15.136:0/2760993310 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4031d20 con 0x7f23b4150b50 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2760993310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 msgr2=0x7f23b406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2760993310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b406db70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f23b406e1c0 tx=0x7f23a402b8d0 comp rx=0 tx=0).stop 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2760993310 shutdown_connections 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2760993310 >> v2:172.21.15.136:3300/0 conn(0x7f23b406aac0 0x7f23b40c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2760993310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b406db70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2760993310 >> 172.21.15.136:0/2760993310 conn(0x7f23b40c7e90 msgr2=0x7f23b40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2760993310 shutdown_connections 2024-02-17T13:25:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.604+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2760993310 wait complete. 2024-02-17T13:25:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.605+0000 7f23ba8ae640 1 Processor -- start 2024-02-17T13:25:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 -- start start 2024-02-17T13:25:55.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23b406aac0 0x7f23b4143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:55.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 0x7f23b414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b41f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b414cd90 con 0x7f23b40c4e80 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b414eb10 con 0x7f23b4150b50 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.606+0000 7f23ba8ae640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b41f0c20 con 0x7f23b406aac0 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.607+0000 7f23b37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 0x7f23b414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.607+0000 7f23b8e4b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b41f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.607+0000 7f23b37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 0x7f23b414fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40760/0 (socket says 172.21.15.136:40760) 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.607+0000 7f23b37fe640 1 -- 172.21.15.136:0/2152652095 learned_addr learned my addr 172.21.15.136:0/2152652095 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:55.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.607+0000 7f23b3fff640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23b406aac0 0x7f23b4143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.610+0000 7f23b37fe640 1 -- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23b406aac0 msgr2=0x7f23b4143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.610+0000 7f23b37fe640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23b406aac0 0x7f23b4143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.610+0000 7f23b37fe640 1 -- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 msgr2=0x7f23b41f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.610+0000 7f23b37fe640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b41f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.610+0000 7f23b37fe640 1 -- 172.21.15.136:0/2152652095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009400 con 0x7f23b40c4e80 2024-02-17T13:25:55.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.613+0000 7f23b37fe640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 0x7f23b414fbd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c400 tx=0x7f23a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.616+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8005ce0 con 0x7f23b40c4e80 2024-02-17T13:25:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.616+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8005e40 con 0x7f23b40c4e80 2024-02-17T13:25:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.616+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80072d0 con 0x7f23b40c4e80 2024-02-17T13:25:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.616+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b41ed480 con 0x7f23b40c4e80 2024-02-17T13:25:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.616+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b414efc0 con 0x7f23b40c4e80 2024-02-17T13:25:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.617+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b404efc0 con 0x7f23b40c4e80 2024-02-17T13:25:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.636+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f23a80074f0 con 0x7f23b40c4e80 2024-02-17T13:25:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.636+0000 7f23b0ff9640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f23a006b860 0x7f23a006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.636+0000 7f23b3fff640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f23a006b860 0x7f23a006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.637+0000 7f23b3fff640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f23a006b860 0x7f23a006dd20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23a4036000 tx=0x7f23a403c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:55.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.873+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f23a80583f0 con 0x7f23b40c4e80 2024-02-17T13:25:55.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:55.873+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23a8054690 con 0x7f23b40c4e80 2024-02-17T13:25:56.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.058+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23b40c57e0 con 0x7f23a006b860 2024-02-17T13:25:56.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.067+0000 7f23b0ff9640 1 -- 172.21.15.136:0/2152652095 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371186 (secure 0 0 0) 0x7f23a4045410 con 0x7f23a006b860 2024-02-17T13:25:56.071 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:25:56.074 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.070+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f23a006b860 msgr2=0x7f23a006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.070+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f23a006b860 0x7f23a006dd20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23a4036000 tx=0x7f23a403c040 comp rx=0 tx=0).stop 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.070+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 msgr2=0x7f23b414fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.070+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 0x7f23b414fbd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c400 tx=0x7f23a800c8c0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 shutdown_connections 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f23a006b860 0x7f23a006dd20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23b4150b50 0x7f23b41f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23b40c4e80 0x7f23b414fbd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 --2- 172.21.15.136:0/2152652095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23b406aac0 0x7f23b4143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 >> 172.21.15.136:0/2152652095 conn(0x7f23b40c7e90 msgr2=0x7f23b40c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:56.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 shutdown_connections 2024-02-17T13:25:56.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.071+0000 7f23ba8ae640 1 -- 172.21.15.136:0/2152652095 wait complete. 2024-02-17T13:25:56.082 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":865,"stamp":"2024-02-17T13:25:54.352084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39668340,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1020,"num_read_kb":1067,"num_write":15160,"num_write_kb":353160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15994,"ondisk_log_size":15994,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":465312,"kb_used_data":79904,"kb_used_omap":12,"kb_used_meta":385331,"kb_avail":754509408,"statfs":{"total":773094113280,"available":772617633792,"internally_reserved":0,"allocated":81821696,"data_stored":80248720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":394579504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":116476,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12,"num_write":56,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002753"},"pg_stats":[{"pgid":"2.1f","version":"26'629","reported_seq":668,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:31.514596+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T13:25:31.514596+0000","last_peered":"2024-02-17T13:25:31.514596+0000","last_clean":"2024-02-17T13:25:31.514596+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T13:25:31.514596+0000","last_undegraded":"2024-02-17T13:25:31.514596+0000","last_fullsized":"2024-02-17T13:25:31.514596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"26'28","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.369320+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T13:25:49.369320+0000","last_peered":"2024-02-17T13:25:49.369320+0000","last_clean":"2024-02-17T13:25:49.369320+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T13:25:49.369320+0000","last_undegraded":"2024-02-17T13:25:49.369320+0000","last_fullsized":"2024-02-17T13:25:49.369320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'137","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.525946+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T13:25:19.525946+0000","last_peered":"2024-02-17T13:25:19.525946+0000","last_clean":"2024-02-17T13:25:19.525946+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T13:25:19.525946+0000","last_undegraded":"2024-02-17T13:25:19.525946+0000","last_fullsized":"2024-02-17T13:25:19.525946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'680","reported_seq":719,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:02.652322+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T13:24:02.652322+0000","last_peered":"2024-02-17T13:24:02.652322+0000","last_clean":"2024-02-17T13:24:02.652322+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T13:24:02.652322+0000","last_undegraded":"2024-02-17T13:24:02.652322+0000","last_fullsized":"2024-02-17T13:24:02.652322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":4495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.384035+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T13:25:49.384035+0000","last_peered":"2024-02-17T13:25:49.384035+0000","last_clean":"2024-02-17T13:25:49.384035+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T13:25:49.384035+0000","last_undegraded":"2024-02-17T13:25:49.384035+0000","last_fullsized":"2024-02-17T13:25:49.384035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"26'131","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.000552+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T13:25:19.000552+0000","last_peered":"2024-02-17T13:25:19.000552+0000","last_clean":"2024-02-17T13:25:19.000552+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T13:25:19.000552+0000","last_undegraded":"2024-02-17T13:25:19.000552+0000","last_fullsized":"2024-02-17T13:25:19.000552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'1331","reported_seq":1368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.829557+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T13:25:38.829557+0000","last_peered":"2024-02-17T13:25:38.829557+0000","last_clean":"2024-02-17T13:25:38.829557+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T13:25:38.829557+0000","last_undegraded":"2024-02-17T13:25:38.829557+0000","last_fullsized":"2024-02-17T13:25:38.829557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1331,"log_dups_size":0,"ondisk_log_size":1331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"26'31","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464446+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T13:25:49.464446+0000","last_peered":"2024-02-17T13:25:49.464446+0000","last_clean":"2024-02-17T13:25:49.464446+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T13:25:49.464446+0000","last_undegraded":"2024-02-17T13:25:49.464446+0000","last_fullsized":"2024-02-17T13:25:49.464446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'136","reported_seq":172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.323011+0000","last_change":"2024-02-17T12:58:37.887403+0000","last_active":"2024-02-17T13:25:20.323011+0000","last_peered":"2024-02-17T13:25:20.323011+0000","last_clean":"2024-02-17T13:25:20.323011+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T13:25:20.323011+0000","last_undegraded":"2024-02-17T13:25:20.323011+0000","last_fullsized":"2024-02-17T13:25:20.323011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":9317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.461295+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T13:25:28.461295+0000","last_peered":"2024-02-17T13:25:28.461295+0000","last_clean":"2024-02-17T13:25:28.461295+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T13:25:28.461295+0000","last_undegraded":"2024-02-17T13:25:28.461295+0000","last_fullsized":"2024-02-17T13:25:28.461295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.456929+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T13:25:49.456929+0000","last_peered":"2024-02-17T13:25:49.456929+0000","last_clean":"2024-02-17T13:25:49.456929+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T13:25:49.456929+0000","last_undegraded":"2024-02-17T13:25:49.456929+0000","last_fullsized":"2024-02-17T13:25:49.456929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"26'132","reported_seq":161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.091362+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T13:25:19.091362+0000","last_peered":"2024-02-17T13:25:19.091362+0000","last_clean":"2024-02-17T13:25:19.091362+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T13:25:19.091362+0000","last_undegraded":"2024-02-17T13:25:19.091362+0000","last_fullsized":"2024-02-17T13:25:19.091362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":5852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"26'36","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.454460+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T13:25:49.454460+0000","last_peered":"2024-02-17T13:25:49.454460+0000","last_clean":"2024-02-17T13:25:49.454460+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T13:25:49.454460+0000","last_undegraded":"2024-02-17T13:25:49.454460+0000","last_fullsized":"2024-02-17T13:25:49.454460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'621","reported_seq":659,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:40.856594+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T13:25:40.856594+0000","last_peered":"2024-02-17T13:25:40.856594+0000","last_clean":"2024-02-17T13:25:40.856594+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T13:25:40.856594+0000","last_undegraded":"2024-02-17T13:25:40.856594+0000","last_fullsized":"2024-02-17T13:25:40.856594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'112","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.367347+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T13:25:20.367347+0000","last_peered":"2024-02-17T13:25:20.367347+0000","last_clean":"2024-02-17T13:25:20.367347+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T13:25:20.367347+0000","last_undegraded":"2024-02-17T13:25:20.367347+0000","last_fullsized":"2024-02-17T13:25:20.367347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.388118+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T13:25:49.388118+0000","last_peered":"2024-02-17T13:25:49.388118+0000","last_clean":"2024-02-17T13:25:49.388118+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T13:25:49.388118+0000","last_undegraded":"2024-02-17T13:25:49.388118+0000","last_fullsized":"2024-02-17T13:25:49.388118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.261469+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T13:25:45.261469+0000","last_peered":"2024-02-17T13:25:45.261469+0000","last_clean":"2024-02-17T13:25:45.261469+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T13:25:45.261469+0000","last_undegraded":"2024-02-17T13:25:45.261469+0000","last_fullsized":"2024-02-17T13:25:45.261469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"26'166","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.474390+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T13:25:19.474390+0000","last_peered":"2024-02-17T13:25:19.474390+0000","last_clean":"2024-02-17T13:25:19.474390+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T13:25:19.474390+0000","last_undegraded":"2024-02-17T13:25:19.474390+0000","last_fullsized":"2024-02-17T13:25:19.474390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":14575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.503807+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T13:25:49.503807+0000","last_peered":"2024-02-17T13:25:49.503807+0000","last_clean":"2024-02-17T13:25:49.503807+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T13:25:49.503807+0000","last_undegraded":"2024-02-17T13:25:49.503807+0000","last_fullsized":"2024-02-17T13:25:49.503807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'9","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.456048+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T13:25:28.456048+0000","last_peered":"2024-02-17T13:25:28.456048+0000","last_clean":"2024-02-17T13:25:28.456048+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T13:25:28.456048+0000","last_undegraded":"2024-02-17T13:25:28.456048+0000","last_fullsized":"2024-02-17T13:25:28.456048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.486786+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T13:25:19.486786+0000","last_peered":"2024-02-17T13:25:19.486786+0000","last_clean":"2024-02-17T13:25:19.486786+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T13:25:19.486786+0000","last_undegraded":"2024-02-17T13:25:19.486786+0000","last_fullsized":"2024-02-17T13:25:19.486786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.878109+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T13:25:18.878109+0000","last_peered":"2024-02-17T13:25:18.878109+0000","last_clean":"2024-02-17T13:25:18.878109+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T13:25:18.878109+0000","last_undegraded":"2024-02-17T13:25:18.878109+0000","last_fullsized":"2024-02-17T13:25:18.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.773516+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T13:25:37.773516+0000","last_peered":"2024-02-17T13:25:37.773516+0000","last_clean":"2024-02-17T13:25:37.773516+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T13:25:37.773516+0000","last_undegraded":"2024-02-17T13:25:37.773516+0000","last_fullsized":"2024-02-17T13:25:37.773516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'126","reported_seq":156,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.546807+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T13:25:19.546807+0000","last_peered":"2024-02-17T13:25:19.546807+0000","last_clean":"2024-02-17T13:25:19.546807+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T13:25:19.546807+0000","last_undegraded":"2024-02-17T13:25:19.546807+0000","last_fullsized":"2024-02-17T13:25:19.546807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.526892+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T13:25:49.526892+0000","last_peered":"2024-02-17T13:25:49.526892+0000","last_clean":"2024-02-17T13:25:49.526892+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T13:25:49.526892+0000","last_undegraded":"2024-02-17T13:25:49.526892+0000","last_fullsized":"2024-02-17T13:25:49.526892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'16","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838762+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T13:25:42.838762+0000","last_peered":"2024-02-17T13:25:42.838762+0000","last_clean":"2024-02-17T13:25:42.838762+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T13:25:42.838762+0000","last_undegraded":"2024-02-17T13:25:42.838762+0000","last_fullsized":"2024-02-17T13:25:42.838762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"26'146","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.477902+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T13:25:19.477902+0000","last_peered":"2024-02-17T13:25:19.477902+0000","last_clean":"2024-02-17T13:25:19.477902+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T13:25:19.477902+0000","last_undegraded":"2024-02-17T13:25:19.477902+0000","last_fullsized":"2024-02-17T13:25:19.477902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564016+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T13:25:49.564016+0000","last_peered":"2024-02-17T13:25:49.564016+0000","last_clean":"2024-02-17T13:25:49.564016+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T13:25:49.564016+0000","last_undegraded":"2024-02-17T13:25:49.564016+0000","last_fullsized":"2024-02-17T13:25:49.564016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1339","reported_seq":1377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.528155+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T13:25:45.528155+0000","last_peered":"2024-02-17T13:25:45.528155+0000","last_clean":"2024-02-17T13:25:45.528155+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T13:25:45.528155+0000","last_undegraded":"2024-02-17T13:25:45.528155+0000","last_fullsized":"2024-02-17T13:25:45.528155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":1198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'135","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.343283+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T13:25:20.343283+0000","last_peered":"2024-02-17T13:25:20.343283+0000","last_clean":"2024-02-17T13:25:20.343283+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T13:25:20.343283+0000","last_undegraded":"2024-02-17T13:25:20.343283+0000","last_fullsized":"2024-02-17T13:25:20.343283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365217+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T13:25:49.365217+0000","last_peered":"2024-02-17T13:25:49.365217+0000","last_clean":"2024-02-17T13:25:49.365217+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T13:25:49.365217+0000","last_undegraded":"2024-02-17T13:25:49.365217+0000","last_fullsized":"2024-02-17T13:25:49.365217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.828180+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T13:25:38.828180+0000","last_peered":"2024-02-17T13:25:38.828180+0000","last_clean":"2024-02-17T13:25:38.828180+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T13:25:38.828180+0000","last_undegraded":"2024-02-17T13:25:38.828180+0000","last_fullsized":"2024-02-17T13:25:38.828180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"26'127","reported_seq":158,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.938919+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T13:25:18.938919+0000","last_peered":"2024-02-17T13:25:18.938919+0000","last_clean":"2024-02-17T13:25:18.938919+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T13:25:18.938919+0000","last_undegraded":"2024-02-17T13:25:18.938919+0000","last_fullsized":"2024-02-17T13:25:18.938919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.487042+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T13:25:49.487042+0000","last_peered":"2024-02-17T13:25:49.487042+0000","last_clean":"2024-02-17T13:25:49.487042+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T13:25:49.487042+0000","last_undegraded":"2024-02-17T13:25:49.487042+0000","last_fullsized":"2024-02-17T13:25:49.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'3","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.803465+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T13:25:38.803465+0000","last_peered":"2024-02-17T13:25:38.803465+0000","last_clean":"2024-02-17T13:25:38.803465+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T13:25:38.803465+0000","last_undegraded":"2024-02-17T13:25:38.803465+0000","last_fullsized":"2024-02-17T13:25:38.803465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"26'191","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.087918+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T13:25:19.087918+0000","last_peered":"2024-02-17T13:25:19.087918+0000","last_clean":"2024-02-17T13:25:19.087918+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T13:25:19.087918+0000","last_undegraded":"2024-02-17T13:25:19.087918+0000","last_fullsized":"2024-02-17T13:25:19.087918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489384+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T13:25:49.489384+0000","last_peered":"2024-02-17T13:25:49.489384+0000","last_clean":"2024-02-17T13:25:49.489384+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T13:25:49.489384+0000","last_undegraded":"2024-02-17T13:25:49.489384+0000","last_fullsized":"2024-02-17T13:25:49.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'11","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832523+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T13:25:39.832523+0000","last_peered":"2024-02-17T13:25:39.832523+0000","last_clean":"2024-02-17T13:25:39.832523+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T13:25:39.832523+0000","last_undegraded":"2024-02-17T13:25:39.832523+0000","last_fullsized":"2024-02-17T13:25:39.832523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'113","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.208163+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T13:25:19.208163+0000","last_peered":"2024-02-17T13:25:19.208163+0000","last_clean":"2024-02-17T13:25:19.208163+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T13:25:19.208163+0000","last_undegraded":"2024-02-17T13:25:19.208163+0000","last_fullsized":"2024-02-17T13:25:19.208163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"26'31","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.379514+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T13:25:49.379514+0000","last_peered":"2024-02-17T13:25:49.379514+0000","last_clean":"2024-02-17T13:25:49.379514+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T13:25:49.379514+0000","last_undegraded":"2024-02-17T13:25:49.379514+0000","last_fullsized":"2024-02-17T13:25:49.379514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'915","reported_seq":1858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:47.836576+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T13:25:47.836576+0000","last_peered":"2024-02-17T13:25:47.836576+0000","last_clean":"2024-02-17T13:25:47.836576+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T13:25:47.836576+0000","last_undegraded":"2024-02-17T13:25:47.836576+0000","last_fullsized":"2024-02-17T13:25:47.836576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210123,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":913,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'127","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.471424+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T13:25:19.471424+0000","last_peered":"2024-02-17T13:25:19.471424+0000","last_clean":"2024-02-17T13:25:19.471424+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T13:25:19.471424+0000","last_undegraded":"2024-02-17T13:25:19.471424+0000","last_fullsized":"2024-02-17T13:25:19.471424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"26'29","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365373+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T13:25:49.365373+0000","last_peered":"2024-02-17T13:25:49.365373+0000","last_clean":"2024-02-17T13:25:49.365373+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T13:25:49.365373+0000","last_undegraded":"2024-02-17T13:25:49.365373+0000","last_fullsized":"2024-02-17T13:25:49.365373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'489","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.777369+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T13:25:37.777369+0000","last_peered":"2024-02-17T13:25:37.777369+0000","last_clean":"2024-02-17T13:25:37.777369+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T13:25:37.777369+0000","last_undegraded":"2024-02-17T13:25:37.777369+0000","last_fullsized":"2024-02-17T13:25:37.777369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'120","reported_seq":150,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.298901+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T13:25:20.298901+0000","last_peered":"2024-02-17T13:25:20.298901+0000","last_clean":"2024-02-17T13:25:20.298901+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T13:25:20.298901+0000","last_undegraded":"2024-02-17T13:25:20.298901+0000","last_fullsized":"2024-02-17T13:25:20.298901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'33","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.497629+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T13:25:49.497629+0000","last_peered":"2024-02-17T13:25:49.497629+0000","last_clean":"2024-02-17T13:25:49.497629+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T13:25:49.497629+0000","last_undegraded":"2024-02-17T13:25:49.497629+0000","last_fullsized":"2024-02-17T13:25:49.497629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'8","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:25.324449+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T13:25:25.324449+0000","last_peered":"2024-02-17T13:25:25.324449+0000","last_clean":"2024-02-17T13:25:25.324449+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T13:25:25.324449+0000","last_undegraded":"2024-02-17T13:25:25.324449+0000","last_fullsized":"2024-02-17T13:25:25.324449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:23:47.670665+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T13:23:47.670665+0000","last_peered":"2024-02-17T13:23:47.670665+0000","last_clean":"2024-02-17T13:23:47.670665+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T13:23:47.670665+0000","last_undegraded":"2024-02-17T13:23:47.670665+0000","last_fullsized":"2024-02-17T13:23:47.670665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"26'170","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.758963+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T13:25:18.758963+0000","last_peered":"2024-02-17T13:25:18.758963+0000","last_clean":"2024-02-17T13:25:18.758963+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T13:25:18.758963+0000","last_undegraded":"2024-02-17T13:25:18.758963+0000","last_fullsized":"2024-02-17T13:25:18.758963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":8669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463142+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T13:25:49.463142+0000","last_peered":"2024-02-17T13:25:49.463142+0000","last_clean":"2024-02-17T13:25:49.463142+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T13:25:49.463142+0000","last_undegraded":"2024-02-17T13:25:49.463142+0000","last_fullsized":"2024-02-17T13:25:49.463142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832570+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T13:25:39.832570+0000","last_peered":"2024-02-17T13:25:39.832570+0000","last_clean":"2024-02-17T13:25:39.832570+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T13:25:39.832570+0000","last_undegraded":"2024-02-17T13:25:39.832570+0000","last_fullsized":"2024-02-17T13:25:39.832570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'141","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.250071+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T13:25:20.250071+0000","last_peered":"2024-02-17T13:25:20.250071+0000","last_clean":"2024-02-17T13:25:20.250071+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T13:25:20.250071+0000","last_undegraded":"2024-02-17T13:25:20.250071+0000","last_fullsized":"2024-02-17T13:25:20.250071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'39","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484983+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T13:25:49.484983+0000","last_peered":"2024-02-17T13:25:49.484983+0000","last_clean":"2024-02-17T13:25:49.484983+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T13:25:49.484983+0000","last_undegraded":"2024-02-17T13:25:49.484983+0000","last_fullsized":"2024-02-17T13:25:49.484983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.826449+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T13:25:39.826449+0000","last_peered":"2024-02-17T13:25:39.826449+0000","last_clean":"2024-02-17T13:25:39.826449+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T13:25:39.826449+0000","last_undegraded":"2024-02-17T13:25:39.826449+0000","last_fullsized":"2024-02-17T13:25:39.826449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'175","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.735811+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T13:25:18.735811+0000","last_peered":"2024-02-17T13:25:18.735811+0000","last_clean":"2024-02-17T13:25:18.735811+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T13:25:18.735811+0000","last_undegraded":"2024-02-17T13:25:18.735811+0000","last_fullsized":"2024-02-17T13:25:18.735811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"26'35","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493605+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T13:25:49.493605+0000","last_peered":"2024-02-17T13:25:49.493605+0000","last_clean":"2024-02-17T13:25:49.493605+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T13:25:49.493605+0000","last_undegraded":"2024-02-17T13:25:49.493605+0000","last_fullsized":"2024-02-17T13:25:49.493605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:56.868466+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T13:24:56.868466+0000","last_peered":"2024-02-17T13:24:56.868466+0000","last_clean":"2024-02-17T13:24:56.868466+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T13:24:56.868466+0000","last_undegraded":"2024-02-17T13:24:56.868466+0000","last_fullsized":"2024-02-17T13:24:56.868466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"26'122","reported_seq":152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.734689+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T13:25:18.734689+0000","last_peered":"2024-02-17T13:25:18.734689+0000","last_clean":"2024-02-17T13:25:18.734689+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T13:25:18.734689+0000","last_undegraded":"2024-02-17T13:25:18.734689+0000","last_fullsized":"2024-02-17T13:25:18.734689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'21","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.492241+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T13:25:49.492241+0000","last_peered":"2024-02-17T13:25:49.492241+0000","last_clean":"2024-02-17T13:25:49.492241+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T13:25:49.492241+0000","last_undegraded":"2024-02-17T13:25:49.492241+0000","last_fullsized":"2024-02-17T13:25:49.492241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.700211+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T13:25:36.700211+0000","last_peered":"2024-02-17T13:25:36.700211+0000","last_clean":"2024-02-17T13:25:36.700211+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T13:25:36.700211+0000","last_undegraded":"2024-02-17T13:25:36.700211+0000","last_fullsized":"2024-02-17T13:25:36.700211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"26'161","reported_seq":191,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.289519+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T13:25:20.289519+0000","last_peered":"2024-02-17T13:25:20.289519+0000","last_clean":"2024-02-17T13:25:20.289519+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T13:25:20.289519+0000","last_undegraded":"2024-02-17T13:25:20.289519+0000","last_fullsized":"2024-02-17T13:25:20.289519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.448139+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T13:25:49.448139+0000","last_peered":"2024-02-17T13:25:49.448139+0000","last_clean":"2024-02-17T13:25:49.448139+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T13:25:49.448139+0000","last_undegraded":"2024-02-17T13:25:49.448139+0000","last_fullsized":"2024-02-17T13:25:49.448139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'20","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.839150+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T13:25:42.839150+0000","last_peered":"2024-02-17T13:25:42.839150+0000","last_clean":"2024-02-17T13:25:42.839150+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T13:25:42.839150+0000","last_undegraded":"2024-02-17T13:25:42.839150+0000","last_fullsized":"2024-02-17T13:25:42.839150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"26'138","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.173860+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T13:25:19.173860+0000","last_peered":"2024-02-17T13:25:19.173860+0000","last_clean":"2024-02-17T13:25:19.173860+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T13:25:19.173860+0000","last_undegraded":"2024-02-17T13:25:19.173860+0000","last_fullsized":"2024-02-17T13:25:19.173860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'30","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.462936+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T13:25:49.462936+0000","last_peered":"2024-02-17T13:25:49.462936+0000","last_clean":"2024-02-17T13:25:49.462936+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T13:25:49.462936+0000","last_undegraded":"2024-02-17T13:25:49.462936+0000","last_fullsized":"2024-02-17T13:25:49.462936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.837114+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T13:25:42.837114+0000","last_peered":"2024-02-17T13:25:42.837114+0000","last_clean":"2024-02-17T13:25:42.837114+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T13:25:42.837114+0000","last_undegraded":"2024-02-17T13:25:42.837114+0000","last_fullsized":"2024-02-17T13:25:42.837114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"26'136","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.534811+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T13:25:19.534811+0000","last_peered":"2024-02-17T13:25:19.534811+0000","last_clean":"2024-02-17T13:25:19.534811+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T13:25:19.534811+0000","last_undegraded":"2024-02-17T13:25:19.534811+0000","last_fullsized":"2024-02-17T13:25:19.534811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457593+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T13:25:49.457593+0000","last_peered":"2024-02-17T13:25:49.457593+0000","last_clean":"2024-02-17T13:25:49.457593+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T13:25:49.457593+0000","last_undegraded":"2024-02-17T13:25:49.457593+0000","last_fullsized":"2024-02-17T13:25:49.457593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'15","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838689+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T13:25:42.838689+0000","last_peered":"2024-02-17T13:25:42.838689+0000","last_clean":"2024-02-17T13:25:42.838689+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T13:25:42.838689+0000","last_undegraded":"2024-02-17T13:25:42.838689+0000","last_fullsized":"2024-02-17T13:25:42.838689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'115","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.504760+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T13:25:19.504760+0000","last_peered":"2024-02-17T13:25:19.504760+0000","last_clean":"2024-02-17T13:25:19.504760+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T13:25:19.504760+0000","last_undegraded":"2024-02-17T13:25:19.504760+0000","last_fullsized":"2024-02-17T13:25:19.504760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365988+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T13:25:49.365988+0000","last_peered":"2024-02-17T13:25:49.365988+0000","last_clean":"2024-02-17T13:25:49.365988+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T13:25:49.365988+0000","last_undegraded":"2024-02-17T13:25:49.365988+0000","last_fullsized":"2024-02-17T13:25:49.365988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'131","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.189245+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T13:25:49.189245+0000","last_peered":"2024-02-17T13:25:49.189245+0000","last_clean":"2024-02-17T13:25:49.189245+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T13:25:49.189245+0000","last_undegraded":"2024-02-17T13:25:49.189245+0000","last_fullsized":"2024-02-17T13:25:49.189245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110453,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'131","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.517917+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T13:25:19.517917+0000","last_peered":"2024-02-17T13:25:19.517917+0000","last_clean":"2024-02-17T13:25:19.517917+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T13:25:19.517917+0000","last_undegraded":"2024-02-17T13:25:19.517917+0000","last_fullsized":"2024-02-17T13:25:19.517917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'37","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.492996+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T13:25:49.492996+0000","last_peered":"2024-02-17T13:25:49.492996+0000","last_clean":"2024-02-17T13:25:49.492996+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T13:25:49.492996+0000","last_undegraded":"2024-02-17T13:25:49.492996+0000","last_fullsized":"2024-02-17T13:25:49.492996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'822","reported_seq":859,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.668393+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T13:25:34.668393+0000","last_peered":"2024-02-17T13:25:34.668393+0000","last_clean":"2024-02-17T13:25:34.668393+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T13:25:34.668393+0000","last_undegraded":"2024-02-17T13:25:34.668393+0000","last_fullsized":"2024-02-17T13:25:34.668393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"26'125","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.074969+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T13:25:18.074969+0000","last_peered":"2024-02-17T13:25:18.074969+0000","last_clean":"2024-02-17T13:25:18.074969+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T13:25:18.074969+0000","last_undegraded":"2024-02-17T13:25:18.074969+0000","last_fullsized":"2024-02-17T13:25:18.074969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'32","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.456054+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T13:25:49.456054+0000","last_peered":"2024-02-17T13:25:49.456054+0000","last_clean":"2024-02-17T13:25:49.456054+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T13:25:49.456054+0000","last_undegraded":"2024-02-17T13:25:49.456054+0000","last_fullsized":"2024-02-17T13:25:49.456054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'655","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:43.826125+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T13:25:43.826125+0000","last_peered":"2024-02-17T13:25:43.826125+0000","last_clean":"2024-02-17T13:25:43.826125+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T13:25:43.826125+0000","last_undegraded":"2024-02-17T13:25:43.826125+0000","last_fullsized":"2024-02-17T13:25:43.826125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"26'151","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.524925+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T13:25:19.524925+0000","last_peered":"2024-02-17T13:25:19.524925+0000","last_clean":"2024-02-17T13:25:19.524925+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T13:25:19.524925+0000","last_undegraded":"2024-02-17T13:25:19.524925+0000","last_fullsized":"2024-02-17T13:25:19.524925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":23394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372478+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.372478+0000","last_peered":"2024-02-17T13:25:49.372478+0000","last_clean":"2024-02-17T13:25:49.372478+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T13:25:49.372478+0000","last_undegraded":"2024-02-17T13:25:49.372478+0000","last_fullsized":"2024-02-17T13:25:49.372478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:32.705035+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T13:24:32.705035+0000","last_peered":"2024-02-17T13:24:32.705035+0000","last_clean":"2024-02-17T13:24:32.705035+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T13:24:32.705035+0000","last_undegraded":"2024-02-17T13:24:32.705035+0000","last_fullsized":"2024-02-17T13:24:32.705035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'126","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.247930+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T13:25:20.247930+0000","last_peered":"2024-02-17T13:25:20.247930+0000","last_clean":"2024-02-17T13:25:20.247930+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T13:25:20.247930+0000","last_undegraded":"2024-02-17T13:25:20.247930+0000","last_fullsized":"2024-02-17T13:25:20.247930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":10959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'43","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.496309+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T13:25:49.496309+0000","last_peered":"2024-02-17T13:25:49.496309+0000","last_clean":"2024-02-17T13:25:49.496309+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T13:25:49.496309+0000","last_undegraded":"2024-02-17T13:25:49.496309+0000","last_fullsized":"2024-02-17T13:25:49.496309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'13","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.189468+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T13:25:49.189468+0000","last_peered":"2024-02-17T13:25:49.189468+0000","last_clean":"2024-02-17T13:25:49.189468+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T13:25:49.189468+0000","last_undegraded":"2024-02-17T13:25:49.189468+0000","last_fullsized":"2024-02-17T13:25:49.189468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'167","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.177328+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T13:25:21.177328+0000","last_peered":"2024-02-17T13:25:21.177328+0000","last_clean":"2024-02-17T13:25:21.177328+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T13:25:21.177328+0000","last_undegraded":"2024-02-17T13:25:21.177328+0000","last_fullsized":"2024-02-17T13:25:21.177328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"26'142","reported_seq":173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.459798+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T13:25:19.459798+0000","last_peered":"2024-02-17T13:25:19.459798+0000","last_clean":"2024-02-17T13:25:19.459798+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T13:25:19.459798+0000","last_undegraded":"2024-02-17T13:25:19.459798+0000","last_fullsized":"2024-02-17T13:25:19.459798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":9062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564794+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T13:25:49.564794+0000","last_peered":"2024-02-17T13:25:49.564794+0000","last_clean":"2024-02-17T13:25:49.564794+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T13:25:49.564794+0000","last_undegraded":"2024-02-17T13:25:49.564794+0000","last_fullsized":"2024-02-17T13:25:49.564794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.661702+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T13:25:34.661702+0000","last_peered":"2024-02-17T13:25:34.661702+0000","last_clean":"2024-02-17T13:25:34.661702+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T13:25:34.661702+0000","last_undegraded":"2024-02-17T13:25:34.661702+0000","last_fullsized":"2024-02-17T13:25:34.661702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.167721+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T13:25:21.167721+0000","last_peered":"2024-02-17T13:25:21.167721+0000","last_clean":"2024-02-17T13:25:21.167721+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T13:25:21.167721+0000","last_undegraded":"2024-02-17T13:25:21.167721+0000","last_fullsized":"2024-02-17T13:25:21.167721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":20244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.381918+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T13:25:49.381918+0000","last_peered":"2024-02-17T13:25:49.381918+0000","last_clean":"2024-02-17T13:25:49.381918+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T13:25:49.381918+0000","last_undegraded":"2024-02-17T13:25:49.381918+0000","last_fullsized":"2024-02-17T13:25:49.381918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'12","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.704801+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T13:25:36.704801+0000","last_peered":"2024-02-17T13:25:36.704801+0000","last_clean":"2024-02-17T13:25:36.704801+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T13:25:36.704801+0000","last_undegraded":"2024-02-17T13:25:36.704801+0000","last_fullsized":"2024-02-17T13:25:36.704801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'680","reported_seq":717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:32.633839+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T13:25:32.633839+0000","last_peered":"2024-02-17T13:25:32.633839+0000","last_clean":"2024-02-17T13:25:32.633839+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T13:25:32.633839+0000","last_undegraded":"2024-02-17T13:25:32.633839+0000","last_fullsized":"2024-02-17T13:25:32.633839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.529720+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T13:25:49.529720+0000","last_peered":"2024-02-17T13:25:49.529720+0000","last_clean":"2024-02-17T13:25:49.529720+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T13:25:49.529720+0000","last_undegraded":"2024-02-17T13:25:49.529720+0000","last_fullsized":"2024-02-17T13:25:49.529720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'95","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.545426+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T13:25:19.545426+0000","last_peered":"2024-02-17T13:25:19.545426+0000","last_clean":"2024-02-17T13:25:19.545426+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T13:25:19.545426+0000","last_undegraded":"2024-02-17T13:25:19.545426+0000","last_fullsized":"2024-02-17T13:25:19.545426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'659","reported_seq":696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.776248+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T13:25:37.776248+0000","last_peered":"2024-02-17T13:25:37.776248+0000","last_clean":"2024-02-17T13:25:37.776248+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T13:25:37.776248+0000","last_undegraded":"2024-02-17T13:25:37.776248+0000","last_fullsized":"2024-02-17T13:25:37.776248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463775+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T13:25:49.463775+0000","last_peered":"2024-02-17T13:25:49.463775+0000","last_clean":"2024-02-17T13:25:49.463775+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T13:25:49.463775+0000","last_undegraded":"2024-02-17T13:25:49.463775+0000","last_fullsized":"2024-02-17T13:25:49.463775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'162","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.268760+0000","last_change":"2024-02-17T12:58:37.887482+0000","last_active":"2024-02-17T13:25:20.268760+0000","last_peered":"2024-02-17T13:25:20.268760+0000","last_clean":"2024-02-17T13:25:20.268760+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T13:25:20.268760+0000","last_undegraded":"2024-02-17T13:25:20.268760+0000","last_fullsized":"2024-02-17T13:25:20.268760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:58.699256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493265+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T13:25:49.493265+0000","last_peered":"2024-02-17T13:25:49.493265+0000","last_clean":"2024-02-17T13:25:49.493265+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T13:25:49.493265+0000","last_undegraded":"2024-02-17T13:25:49.493265+0000","last_fullsized":"2024-02-17T13:25:49.493265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387808+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T13:25:49.387808+0000","last_peered":"2024-02-17T13:25:49.387808+0000","last_clean":"2024-02-17T13:25:49.387808+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T13:25:49.387808+0000","last_undegraded":"2024-02-17T13:25:49.387808+0000","last_fullsized":"2024-02-17T13:25:49.387808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"26'45","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.441835+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T13:25:49.441835+0000","last_peered":"2024-02-17T13:25:49.441835+0000","last_clean":"2024-02-17T13:25:49.441835+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T13:25:49.441835+0000","last_undegraded":"2024-02-17T13:25:49.441835+0000","last_fullsized":"2024-02-17T13:25:49.441835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.383488+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T13:25:49.383488+0000","last_peered":"2024-02-17T13:25:49.383488+0000","last_clean":"2024-02-17T13:25:49.383488+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T13:25:49.383488+0000","last_undegraded":"2024-02-17T13:25:49.383488+0000","last_fullsized":"2024-02-17T13:25:49.383488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"26'27","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.368239+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T13:25:49.368239+0000","last_peered":"2024-02-17T13:25:49.368239+0000","last_clean":"2024-02-17T13:25:49.368239+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T13:25:49.368239+0000","last_undegraded":"2024-02-17T13:25:49.368239+0000","last_fullsized":"2024-02-17T13:25:49.368239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367306+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T13:25:49.367306+0000","last_peered":"2024-02-17T13:25:49.367306+0000","last_clean":"2024-02-17T13:25:49.367306+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T13:25:49.367306+0000","last_undegraded":"2024-02-17T13:25:49.367306+0000","last_fullsized":"2024-02-17T13:25:49.367306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'43","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489937+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T13:25:49.489937+0000","last_peered":"2024-02-17T13:25:49.489937+0000","last_clean":"2024-02-17T13:25:49.489937+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T13:25:49.489937+0000","last_undegraded":"2024-02-17T13:25:49.489937+0000","last_fullsized":"2024-02-17T13:25:49.489937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"26'31","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.370293+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.370293+0000","last_peered":"2024-02-17T13:25:49.370293+0000","last_clean":"2024-02-17T13:25:49.370293+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T13:25:49.370293+0000","last_undegraded":"2024-02-17T13:25:49.370293+0000","last_fullsized":"2024-02-17T13:25:49.370293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449478+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T13:25:49.449478+0000","last_peered":"2024-02-17T13:25:49.449478+0000","last_clean":"2024-02-17T13:25:49.449478+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T13:25:49.449478+0000","last_undegraded":"2024-02-17T13:25:49.449478+0000","last_fullsized":"2024-02-17T13:25:49.449478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.377561+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T13:25:49.377561+0000","last_peered":"2024-02-17T13:25:49.377561+0000","last_clean":"2024-02-17T13:25:49.377561+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T13:25:49.377561+0000","last_undegraded":"2024-02-17T13:25:49.377561+0000","last_fullsized":"2024-02-17T13:25:49.377561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"26'38","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463712+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T13:25:49.463712+0000","last_peered":"2024-02-17T13:25:49.463712+0000","last_clean":"2024-02-17T13:25:49.463712+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T13:25:49.463712+0000","last_undegraded":"2024-02-17T13:25:49.463712+0000","last_fullsized":"2024-02-17T13:25:49.463712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.527824+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T13:25:49.527824+0000","last_peered":"2024-02-17T13:25:49.527824+0000","last_clean":"2024-02-17T13:25:49.527824+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T13:25:49.527824+0000","last_undegraded":"2024-02-17T13:25:49.527824+0000","last_fullsized":"2024-02-17T13:25:49.527824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'39","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387085+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T13:25:49.387085+0000","last_peered":"2024-02-17T13:25:49.387085+0000","last_clean":"2024-02-17T13:25:49.387085+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T13:25:49.387085+0000","last_undegraded":"2024-02-17T13:25:49.387085+0000","last_fullsized":"2024-02-17T13:25:49.387085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.446228+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T13:25:49.446228+0000","last_peered":"2024-02-17T13:25:49.446228+0000","last_clean":"2024-02-17T13:25:49.446228+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T13:25:49.446228+0000","last_undegraded":"2024-02-17T13:25:49.446228+0000","last_fullsized":"2024-02-17T13:25:49.446228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387119+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T13:25:49.387119+0000","last_peered":"2024-02-17T13:25:49.387119+0000","last_clean":"2024-02-17T13:25:49.387119+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T13:25:49.387119+0000","last_undegraded":"2024-02-17T13:25:49.387119+0000","last_fullsized":"2024-02-17T13:25:49.387119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457531+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T13:25:49.457531+0000","last_peered":"2024-02-17T13:25:49.457531+0000","last_clean":"2024-02-17T13:25:49.457531+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T13:25:49.457531+0000","last_undegraded":"2024-02-17T13:25:49.457531+0000","last_fullsized":"2024-02-17T13:25:49.457531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"26'42","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449553+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T13:25:49.449553+0000","last_peered":"2024-02-17T13:25:49.449553+0000","last_clean":"2024-02-17T13:25:49.449553+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T13:25:49.449553+0000","last_undegraded":"2024-02-17T13:25:49.449553+0000","last_fullsized":"2024-02-17T13:25:49.449553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.373687+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T13:25:49.373687+0000","last_peered":"2024-02-17T13:25:49.373687+0000","last_clean":"2024-02-17T13:25:49.373687+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T13:25:49.373687+0000","last_undegraded":"2024-02-17T13:25:49.373687+0000","last_fullsized":"2024-02-17T13:25:49.373687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367333+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T13:25:49.367333+0000","last_peered":"2024-02-17T13:25:49.367333+0000","last_clean":"2024-02-17T13:25:49.367333+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T13:25:49.367333+0000","last_undegraded":"2024-02-17T13:25:49.367333+0000","last_fullsized":"2024-02-17T13:25:49.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367607+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T13:25:49.367607+0000","last_peered":"2024-02-17T13:25:49.367607+0000","last_clean":"2024-02-17T13:25:49.367607+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T13:25:49.367607+0000","last_undegraded":"2024-02-17T13:25:49.367607+0000","last_fullsized":"2024-02-17T13:25:49.367607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494123+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T13:25:49.494123+0000","last_peered":"2024-02-17T13:25:49.494123+0000","last_clean":"2024-02-17T13:25:49.494123+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T13:25:49.494123+0000","last_undegraded":"2024-02-17T13:25:49.494123+0000","last_fullsized":"2024-02-17T13:25:49.494123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489516+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T13:25:49.489516+0000","last_peered":"2024-02-17T13:25:49.489516+0000","last_clean":"2024-02-17T13:25:49.489516+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T13:25:49.489516+0000","last_undegraded":"2024-02-17T13:25:49.489516+0000","last_fullsized":"2024-02-17T13:25:49.489516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"26'48","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494410+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T13:25:49.494410+0000","last_peered":"2024-02-17T13:25:49.494410+0000","last_clean":"2024-02-17T13:25:49.494410+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T13:25:49.494410+0000","last_undegraded":"2024-02-17T13:25:49.494410+0000","last_fullsized":"2024-02-17T13:25:49.494410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"26'38","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464326+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T13:25:49.464326+0000","last_peered":"2024-02-17T13:25:49.464326+0000","last_clean":"2024-02-17T13:25:49.464326+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T13:25:49.464326+0000","last_undegraded":"2024-02-17T13:25:49.464326+0000","last_fullsized":"2024-02-17T13:25:49.464326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382911+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T13:25:49.382911+0000","last_peered":"2024-02-17T13:25:49.382911+0000","last_clean":"2024-02-17T13:25:49.382911+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T13:25:49.382911+0000","last_undegraded":"2024-02-17T13:25:49.382911+0000","last_fullsized":"2024-02-17T13:25:49.382911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484270+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T13:25:49.484270+0000","last_peered":"2024-02-17T13:25:49.484270+0000","last_clean":"2024-02-17T13:25:49.484270+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T13:25:49.484270+0000","last_undegraded":"2024-02-17T13:25:49.484270+0000","last_fullsized":"2024-02-17T13:25:49.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.490441+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T13:25:49.490441+0000","last_peered":"2024-02-17T13:25:49.490441+0000","last_clean":"2024-02-17T13:25:49.490441+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T13:25:49.490441+0000","last_undegraded":"2024-02-17T13:25:49.490441+0000","last_fullsized":"2024-02-17T13:25:49.490441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.487475+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T13:25:49.487475+0000","last_peered":"2024-02-17T13:25:49.487475+0000","last_clean":"2024-02-17T13:25:49.487475+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T13:25:49.487475+0000","last_undegraded":"2024-02-17T13:25:49.487475+0000","last_fullsized":"2024-02-17T13:25:49.487475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'26","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489870+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T13:25:49.489870+0000","last_peered":"2024-02-17T13:25:49.489870+0000","last_clean":"2024-02-17T13:25:49.489870+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T13:25:49.489870+0000","last_undegraded":"2024-02-17T13:25:49.489870+0000","last_fullsized":"2024-02-17T13:25:49.489870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'41","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382700+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T13:25:49.382700+0000","last_peered":"2024-02-17T13:25:49.382700+0000","last_clean":"2024-02-17T13:25:49.382700+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T13:25:49.382700+0000","last_undegraded":"2024-02-17T13:25:49.382700+0000","last_fullsized":"2024-02-17T13:25:49.382700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372153+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T13:25:49.372153+0000","last_peered":"2024-02-17T13:25:49.372153+0000","last_clean":"2024-02-17T13:25:49.372153+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T13:25:49.372153+0000","last_undegraded":"2024-02-17T13:25:49.372153+0000","last_fullsized":"2024-02-17T13:25:49.372153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"26'26","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484733+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T13:25:49.484733+0000","last_peered":"2024-02-17T13:25:49.484733+0000","last_clean":"2024-02-17T13:25:49.484733+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T13:25:49.484733+0000","last_undegraded":"2024-02-17T13:25:49.484733+0000","last_fullsized":"2024-02-17T13:25:49.484733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3911,"num_write_kb":306687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4416,"ondisk_log_size":4416,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39077972,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":11090,"num_write_kb":44057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78405632,"data_stored":78155944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9139,"ondisk_log_size":9139,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575191,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63244,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308596,"statfs":{"total":96636764160,"available":96572002304,"internally_reserved":0,"allocated":5836800,"data_stored":5629759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":0.55900000000000005,"5min":0.65000000000000002,"15min":0.71199999999999997},"last":0.38},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.64400000000000002,"15min":0.749},"last":0.44600000000000001}]},{"osd":2,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.72999999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.623,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.52800000000000002,"5min":0.69599999999999995,"15min":0.73599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":0.63600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.79400000000000004},"last":0.32900000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76300000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.27000000000000002},"max":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.31},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81599999999999995,"5min":0.90200000000000002,"15min":0.92800000000000005},"last":0.42999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":4388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":4493312,"data_stored":4311853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28799999999999998,"15min":0.217},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.68300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65500000000000003,"5min":0.67800000000000005,"15min":0.75700000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.70899999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.80000000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.63200000000000001,"5min":0.71899999999999997,"15min":0.72099999999999997},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.49299999999999999,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.27400000000000002},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.77300000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.86199999999999999,"15min":0.93400000000000005},"last":0.378},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.23599999999999999},"max":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.84199999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.878},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.80800000000000005,"15min":0.94899999999999995},"last":0.44700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575190,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70916,"kb_used_data":13372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300924,"statfs":{"total":96636764160,"available":96564146176,"internally_reserved":0,"allocated":13692928,"data_stored":13498704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57199999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.435},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.78100000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.751},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.28799999999999998},"max":{"1min":0.61799999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.40899999999999997,"5min":0.28999999999999998,"15min":0.28199999999999997},"max":{"1min":0.67200000000000004,"5min":0.73299999999999998,"15min":0.75600000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":4,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27300000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.79700000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.71199999999999997}]},{"osd":6,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.872},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575190,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53580,"kb_used_data":8516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318260,"statfs":{"total":96636764160,"available":96581898240,"internally_reserved":0,"allocated":8720384,"data_stored":8505123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.59099999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.69199999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57799999999999996,"5min":0.621,"15min":0.745},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.71899999999999997},"last":0.433}]},{"osd":2,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.77900000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29699999999999999},"max":{"1min":0.63700000000000001,"5min":0.68400000000000005,"15min":0.68500000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.82199999999999995},"last":0.498}]},{"osd":5,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44600000000000001,"15min":0.46999999999999997},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.318},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.47899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64200000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38400000000000001}]},{"osd":6,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46800000000000003,"15min":0.48799999999999999},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66300000000000003,"5min":0.76800000000000002,"15min":0.872},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.36599999999999999}]},{"osd":7,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575191,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78404,"kb_used_data":16700,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293436,"statfs":{"total":96636764160,"available":96556478464,"internally_reserved":0,"allocated":17100800,"data_stored":16894525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.29799999999999999,"15min":0.30199999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.47499999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"last":0.37},{"interface":"front","average":{"1min":0.318,"5min":0.309,"15min":0.311},"min":{"1min":0.223,"5min":0.223,"15min":0.21099999999999999},"max":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48799999999999999},"last":0.24199999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.19400000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.626,"5min":0.626,"15min":0.64600000000000002},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32100000000000001},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.79100000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.77000000000000002,"15min":0.77300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.75900000000000001,"15min":0.81899999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.85599999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.754,"15min":0.82499999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.79300000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.375},"max":{"1min":0.624,"5min":0.88,"15min":0.88},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8503353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.187,"15min":0.186},"max":{"1min":0.44700000000000001,"5min":0.59599999999999997,"15min":0.82899999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.19800000000000001},"max":{"1min":0.371,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.94299999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.33500000000000002,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.377,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.54100000000000004},"last":0.379},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":1.02},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.29199999999999998},"max":{"1min":0.63900000000000001,"5min":0.74199999999999999,"15min":1.577},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.78600000000000003,"15min":0.86399999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.62,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63400000000000001,"5min":0.77000000000000002,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.76900000000000002,"15min":1.177},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36699999999999999},"max":{"1min":0.64300000000000002,"5min":0.80200000000000005,"15min":0.82399999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834575190,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48560,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323280,"statfs":{"total":96636764160,"available":96587038720,"internally_reserved":0,"allocated":9281536,"data_stored":9094395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.69299999999999995},"last":0.252},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.40699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32100000000000001,"15min":0.311},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.504,"5min":0.622,"15min":0.622},"last":0.318},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.56599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.378,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.60799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.50900000000000001,"15min":0.81699999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.626},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.87,"15min":0.87},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.90700000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35699999999999998},"max":{"1min":0.63600000000000001,"5min":0.80800000000000005,"15min":0.81399999999999995},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66400000000000003,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71228,"kb_used_data":13684,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300612,"statfs":{"total":96636764160,"available":96563826688,"internally_reserved":0,"allocated":14012416,"data_stored":13811008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29299999999999998},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.52900000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.38900000000000001,"5min":0.55000000000000004,"15min":0.58399999999999996},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.45100000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.497,"5min":0.54600000000000004,"15min":0.624},"last":0.371}]},{"osd":3,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.42999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.252},"max":{"1min":0.53300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.73699999999999999,"15min":0.77100000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.78400000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.752},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.84699999999999998},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":0.71399999999999997,"15min":0.77200000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.61699999999999999,"5min":0.72499999999999998,"15min":0.78400000000000003},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":13697003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12820480,"data_stored":12794331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5515754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T13:25:56.089 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T13:25:56.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.224+0000 7ff43e69d640 1 Processor -- start 2024-02-17T13:25:56.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.224+0000 7ff43e69d640 1 -- start start 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.225+0000 7ff43e69d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff43806db70 0x7ff4380c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.225+0000 7ff43e69d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43806dfa0 con 0x7ff4380c4e80 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.225+0000 7ff43e69d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff438150f30 con 0x7ff438150b50 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.225+0000 7ff43e69d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4380c64d0 con 0x7ff43806db70 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.225+0000 7ff43cc3a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff43806db70 0x7ff4380c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.226+0000 7ff4377fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff4380c4e80 0x7ff43806aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59738/0 (socket says 172.21.15.136:59738) 2024-02-17T13:25:56.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.226+0000 7ff4377fe640 1 -- 172.21.15.136:0/2040545712 learned_addr learned my addr 172.21.15.136:0/2040545712 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:56.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.229+0000 7ff436ffd640 1 -- 172.21.15.136:0/2040545712 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777227576 0 0) 0x7ff438150f30 con 0x7ff438150b50 2024-02-17T13:25:56.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.229+0000 7ff436ffd640 1 -- 172.21.15.136:0/2040545712 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff420003520 con 0x7ff438150b50 2024-02-17T13:25:56.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.229+0000 7ff43cc3a640 1 -- 172.21.15.136:0/2040545712 >> v1:172.21.15.160:6789/0 conn(0x7ff438150b50 legacy=0x7ff4380c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.229+0000 7ff43cc3a640 1 -- 172.21.15.136:0/2040545712 >> v1:172.21.15.136:6789/0 conn(0x7ff4380c4e80 legacy=0x7ff43806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.229+0000 7ff43cc3a640 1 -- 172.21.15.136:0/2040545712 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380c5f10 con 0x7ff43806db70 2024-02-17T13:25:56.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.234+0000 7ff43cc3a640 1 --2- 172.21.15.136:0/2040545712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff43806db70 0x7ff4380c7150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff430009d90 tx=0x7ff43002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45c16b90242a6cb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:56.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff436ffd640 1 -- 172.21.15.136:0/2040545712 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43002cd00 con 0x7ff43806db70 2024-02-17T13:25:56.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff436ffd640 1 -- 172.21.15.136:0/2040545712 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43002ce60 con 0x7ff43806db70 2024-02-17T13:25:56.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff436ffd640 1 -- 172.21.15.136:0/2040545712 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430034660 con 0x7ff43806db70 2024-02-17T13:25:56.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 -- 172.21.15.136:0/2040545712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff43806db70 msgr2=0x7ff4380c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 --2- 172.21.15.136:0/2040545712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff43806db70 0x7ff4380c7150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff430009d90 tx=0x7ff43002bf50 comp rx=0 tx=0).stop 2024-02-17T13:25:56.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 -- 172.21.15.136:0/2040545712 shutdown_connections 2024-02-17T13:25:56.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 --2- 172.21.15.136:0/2040545712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff43806db70 0x7ff4380c7150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 -- 172.21.15.136:0/2040545712 >> 172.21.15.136:0/2040545712 conn(0x7ff4380c7e90 msgr2=0x7ff4380c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:56.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 -- 172.21.15.136:0/2040545712 shutdown_connections 2024-02-17T13:25:56.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.238+0000 7ff43e69d640 1 -- 172.21.15.136:0/2040545712 wait complete. 2024-02-17T13:25:56.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 Processor -- start 2024-02-17T13:25:56.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 -- start start 2024-02-17T13:25:56.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff43806db70 0x7ff438138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4380c4e80 0x7ff438131510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 0x7ff43814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438131a50 con 0x7ff438150b50 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438139260 con 0x7ff43806db70 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.240+0000 7ff43e69d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380cb170 con 0x7ff4380c4e80 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.241+0000 7ff43cc3a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 0x7ff43814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.241+0000 7ff43cc3a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 0x7ff43814d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40792/0 (socket says 172.21.15.136:40792) 2024-02-17T13:25:56.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.241+0000 7ff43cc3a640 1 -- 172.21.15.136:0/495060935 learned_addr learned my addr 172.21.15.136:0/495060935 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:56.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.241+0000 7ff437fff640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff43806db70 0x7ff438138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.241+0000 7ff4377fe640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4380c4e80 0x7ff438131510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.244+0000 7ff43cc3a640 1 -- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4380c4e80 msgr2=0x7ff438131510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.244+0000 7ff43cc3a640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4380c4e80 0x7ff438131510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.244+0000 7ff43cc3a640 1 -- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff43806db70 msgr2=0x7ff438138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.244+0000 7ff43cc3a640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff43806db70 0x7ff438138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.244+0000 7ff43cc3a640 1 -- 172.21.15.136:0/495060935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009a70 con 0x7ff438150b50 2024-02-17T13:25:56.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.246+0000 7ff43cc3a640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 0x7ff43814d020 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff430009eb0 tx=0x7ff430004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.250+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43003e610 con 0x7ff438150b50 2024-02-17T13:25:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.250+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43003e770 con 0x7ff438150b50 2024-02-17T13:25:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.250+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff438139500 con 0x7ff438150b50 2024-02-17T13:25:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.250+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43003eb20 con 0x7ff438150b50 2024-02-17T13:25:56.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.250+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43814c820 con 0x7ff438150b50 2024-02-17T13:25:56.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.251+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff438074240 con 0x7ff438150b50 2024-02-17T13:25:56.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.270+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff43003b050 con 0x7ff438150b50 2024-02-17T13:25:56.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.270+0000 7ff434ff9640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff42406b840 0x7ff42406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.270+0000 7ff437fff640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff42406b840 0x7ff42406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.271+0000 7ff437fff640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff42406b840 0x7ff42406dd00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff428007fd0 tx=0x7ff428009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:56.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.272+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7ff43007b610 con 0x7ff438150b50 2024-02-17T13:25:56.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.509+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4300778b0 con 0x7ff438150b50 2024-02-17T13:25:56.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.701+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4380c4680 con 0x7ff42406b840 2024-02-17T13:25:56.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.710+0000 7ff434ff9640 1 -- 172.21.15.136:0/495060935 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371182 (secure 0 0 0) 0x7ff42800f850 con 0x7ff42406b840 2024-02-17T13:25:56.713 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:25:56.716 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T13:25:56.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.713+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff42406b840 msgr2=0x7ff42406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.713+0000 7ff43e69d640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff42406b840 0x7ff42406dd00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff428007fd0 tx=0x7ff428009040 comp rx=0 tx=0).stop 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.713+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 msgr2=0x7ff43814d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.713+0000 7ff43e69d640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 0x7ff43814d020 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff430009eb0 tx=0x7ff430004a40 comp rx=0 tx=0).stop 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 shutdown_connections 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7ff42406b840 0x7ff42406dd00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff438150b50 0x7ff43814d020 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4380c4e80 0x7ff438131510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 --2- 172.21.15.136:0/495060935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff43806db70 0x7ff438138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 >> 172.21.15.136:0/495060935 conn(0x7ff4380c7e90 msgr2=0x7ff43806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 shutdown_connections 2024-02-17T13:25:56.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.714+0000 7ff43e69d640 1 -- 172.21.15.136:0/495060935 wait complete. 2024-02-17T13:25:56.725 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":866,"stamp":"2024-02-17T13:25:56.352734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39668340,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1020,"num_read_kb":1067,"num_write":15160,"num_write_kb":353160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15994,"ondisk_log_size":15994,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":465312,"kb_used_data":79904,"kb_used_omap":12,"kb_used_meta":385331,"kb_avail":754509408,"statfs":{"total":773094113280,"available":772617633792,"internally_reserved":0,"allocated":81821696,"data_stored":80248720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":394579504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19511,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":36,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003018"},"pg_stats":[{"pgid":"2.1f","version":"26'629","reported_seq":668,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:31.514596+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T13:25:31.514596+0000","last_peered":"2024-02-17T13:25:31.514596+0000","last_clean":"2024-02-17T13:25:31.514596+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T13:25:31.514596+0000","last_undegraded":"2024-02-17T13:25:31.514596+0000","last_fullsized":"2024-02-17T13:25:31.514596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"26'28","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.369320+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T13:25:49.369320+0000","last_peered":"2024-02-17T13:25:49.369320+0000","last_clean":"2024-02-17T13:25:49.369320+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T13:25:49.369320+0000","last_undegraded":"2024-02-17T13:25:49.369320+0000","last_fullsized":"2024-02-17T13:25:49.369320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'137","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.525946+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T13:25:19.525946+0000","last_peered":"2024-02-17T13:25:19.525946+0000","last_clean":"2024-02-17T13:25:19.525946+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T13:25:19.525946+0000","last_undegraded":"2024-02-17T13:25:19.525946+0000","last_fullsized":"2024-02-17T13:25:19.525946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'680","reported_seq":719,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:02.652322+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T13:24:02.652322+0000","last_peered":"2024-02-17T13:24:02.652322+0000","last_clean":"2024-02-17T13:24:02.652322+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T13:24:02.652322+0000","last_undegraded":"2024-02-17T13:24:02.652322+0000","last_fullsized":"2024-02-17T13:24:02.652322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":4495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.384035+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T13:25:49.384035+0000","last_peered":"2024-02-17T13:25:49.384035+0000","last_clean":"2024-02-17T13:25:49.384035+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T13:25:49.384035+0000","last_undegraded":"2024-02-17T13:25:49.384035+0000","last_fullsized":"2024-02-17T13:25:49.384035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"26'131","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.000552+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T13:25:19.000552+0000","last_peered":"2024-02-17T13:25:19.000552+0000","last_clean":"2024-02-17T13:25:19.000552+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T13:25:19.000552+0000","last_undegraded":"2024-02-17T13:25:19.000552+0000","last_fullsized":"2024-02-17T13:25:19.000552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'1331","reported_seq":1368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.829557+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T13:25:38.829557+0000","last_peered":"2024-02-17T13:25:38.829557+0000","last_clean":"2024-02-17T13:25:38.829557+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T13:25:38.829557+0000","last_undegraded":"2024-02-17T13:25:38.829557+0000","last_fullsized":"2024-02-17T13:25:38.829557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1331,"log_dups_size":0,"ondisk_log_size":1331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"26'31","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464446+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T13:25:49.464446+0000","last_peered":"2024-02-17T13:25:49.464446+0000","last_clean":"2024-02-17T13:25:49.464446+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T13:25:49.464446+0000","last_undegraded":"2024-02-17T13:25:49.464446+0000","last_fullsized":"2024-02-17T13:25:49.464446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'136","reported_seq":172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.323011+0000","last_change":"2024-02-17T12:58:37.887403+0000","last_active":"2024-02-17T13:25:20.323011+0000","last_peered":"2024-02-17T13:25:20.323011+0000","last_clean":"2024-02-17T13:25:20.323011+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T13:25:20.323011+0000","last_undegraded":"2024-02-17T13:25:20.323011+0000","last_fullsized":"2024-02-17T13:25:20.323011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":9317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.461295+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T13:25:28.461295+0000","last_peered":"2024-02-17T13:25:28.461295+0000","last_clean":"2024-02-17T13:25:28.461295+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T13:25:28.461295+0000","last_undegraded":"2024-02-17T13:25:28.461295+0000","last_fullsized":"2024-02-17T13:25:28.461295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.456929+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T13:25:49.456929+0000","last_peered":"2024-02-17T13:25:49.456929+0000","last_clean":"2024-02-17T13:25:49.456929+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T13:25:49.456929+0000","last_undegraded":"2024-02-17T13:25:49.456929+0000","last_fullsized":"2024-02-17T13:25:49.456929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"26'132","reported_seq":161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.091362+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T13:25:19.091362+0000","last_peered":"2024-02-17T13:25:19.091362+0000","last_clean":"2024-02-17T13:25:19.091362+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T13:25:19.091362+0000","last_undegraded":"2024-02-17T13:25:19.091362+0000","last_fullsized":"2024-02-17T13:25:19.091362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":5852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"26'36","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.454460+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T13:25:49.454460+0000","last_peered":"2024-02-17T13:25:49.454460+0000","last_clean":"2024-02-17T13:25:49.454460+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T13:25:49.454460+0000","last_undegraded":"2024-02-17T13:25:49.454460+0000","last_fullsized":"2024-02-17T13:25:49.454460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'621","reported_seq":659,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:40.856594+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T13:25:40.856594+0000","last_peered":"2024-02-17T13:25:40.856594+0000","last_clean":"2024-02-17T13:25:40.856594+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T13:25:40.856594+0000","last_undegraded":"2024-02-17T13:25:40.856594+0000","last_fullsized":"2024-02-17T13:25:40.856594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'112","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.367347+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T13:25:20.367347+0000","last_peered":"2024-02-17T13:25:20.367347+0000","last_clean":"2024-02-17T13:25:20.367347+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T13:25:20.367347+0000","last_undegraded":"2024-02-17T13:25:20.367347+0000","last_fullsized":"2024-02-17T13:25:20.367347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.388118+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T13:25:49.388118+0000","last_peered":"2024-02-17T13:25:49.388118+0000","last_clean":"2024-02-17T13:25:49.388118+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T13:25:49.388118+0000","last_undegraded":"2024-02-17T13:25:49.388118+0000","last_fullsized":"2024-02-17T13:25:49.388118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.261469+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T13:25:45.261469+0000","last_peered":"2024-02-17T13:25:45.261469+0000","last_clean":"2024-02-17T13:25:45.261469+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T13:25:45.261469+0000","last_undegraded":"2024-02-17T13:25:45.261469+0000","last_fullsized":"2024-02-17T13:25:45.261469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"26'166","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.474390+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T13:25:19.474390+0000","last_peered":"2024-02-17T13:25:19.474390+0000","last_clean":"2024-02-17T13:25:19.474390+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T13:25:19.474390+0000","last_undegraded":"2024-02-17T13:25:19.474390+0000","last_fullsized":"2024-02-17T13:25:19.474390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":14575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.503807+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T13:25:49.503807+0000","last_peered":"2024-02-17T13:25:49.503807+0000","last_clean":"2024-02-17T13:25:49.503807+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T13:25:49.503807+0000","last_undegraded":"2024-02-17T13:25:49.503807+0000","last_fullsized":"2024-02-17T13:25:49.503807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'9","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.456048+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T13:25:28.456048+0000","last_peered":"2024-02-17T13:25:28.456048+0000","last_clean":"2024-02-17T13:25:28.456048+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T13:25:28.456048+0000","last_undegraded":"2024-02-17T13:25:28.456048+0000","last_fullsized":"2024-02-17T13:25:28.456048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.486786+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T13:25:19.486786+0000","last_peered":"2024-02-17T13:25:19.486786+0000","last_clean":"2024-02-17T13:25:19.486786+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T13:25:19.486786+0000","last_undegraded":"2024-02-17T13:25:19.486786+0000","last_fullsized":"2024-02-17T13:25:19.486786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.878109+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T13:25:18.878109+0000","last_peered":"2024-02-17T13:25:18.878109+0000","last_clean":"2024-02-17T13:25:18.878109+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T13:25:18.878109+0000","last_undegraded":"2024-02-17T13:25:18.878109+0000","last_fullsized":"2024-02-17T13:25:18.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.773516+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T13:25:37.773516+0000","last_peered":"2024-02-17T13:25:37.773516+0000","last_clean":"2024-02-17T13:25:37.773516+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T13:25:37.773516+0000","last_undegraded":"2024-02-17T13:25:37.773516+0000","last_fullsized":"2024-02-17T13:25:37.773516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'126","reported_seq":156,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.546807+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T13:25:19.546807+0000","last_peered":"2024-02-17T13:25:19.546807+0000","last_clean":"2024-02-17T13:25:19.546807+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T13:25:19.546807+0000","last_undegraded":"2024-02-17T13:25:19.546807+0000","last_fullsized":"2024-02-17T13:25:19.546807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.526892+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T13:25:49.526892+0000","last_peered":"2024-02-17T13:25:49.526892+0000","last_clean":"2024-02-17T13:25:49.526892+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T13:25:49.526892+0000","last_undegraded":"2024-02-17T13:25:49.526892+0000","last_fullsized":"2024-02-17T13:25:49.526892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'16","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838762+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T13:25:42.838762+0000","last_peered":"2024-02-17T13:25:42.838762+0000","last_clean":"2024-02-17T13:25:42.838762+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T13:25:42.838762+0000","last_undegraded":"2024-02-17T13:25:42.838762+0000","last_fullsized":"2024-02-17T13:25:42.838762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"26'146","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.477902+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T13:25:19.477902+0000","last_peered":"2024-02-17T13:25:19.477902+0000","last_clean":"2024-02-17T13:25:19.477902+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T13:25:19.477902+0000","last_undegraded":"2024-02-17T13:25:19.477902+0000","last_fullsized":"2024-02-17T13:25:19.477902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564016+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T13:25:49.564016+0000","last_peered":"2024-02-17T13:25:49.564016+0000","last_clean":"2024-02-17T13:25:49.564016+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T13:25:49.564016+0000","last_undegraded":"2024-02-17T13:25:49.564016+0000","last_fullsized":"2024-02-17T13:25:49.564016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1339","reported_seq":1377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.528155+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T13:25:45.528155+0000","last_peered":"2024-02-17T13:25:45.528155+0000","last_clean":"2024-02-17T13:25:45.528155+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T13:25:45.528155+0000","last_undegraded":"2024-02-17T13:25:45.528155+0000","last_fullsized":"2024-02-17T13:25:45.528155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":1198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'135","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.343283+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T13:25:20.343283+0000","last_peered":"2024-02-17T13:25:20.343283+0000","last_clean":"2024-02-17T13:25:20.343283+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T13:25:20.343283+0000","last_undegraded":"2024-02-17T13:25:20.343283+0000","last_fullsized":"2024-02-17T13:25:20.343283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365217+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T13:25:49.365217+0000","last_peered":"2024-02-17T13:25:49.365217+0000","last_clean":"2024-02-17T13:25:49.365217+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T13:25:49.365217+0000","last_undegraded":"2024-02-17T13:25:49.365217+0000","last_fullsized":"2024-02-17T13:25:49.365217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.828180+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T13:25:38.828180+0000","last_peered":"2024-02-17T13:25:38.828180+0000","last_clean":"2024-02-17T13:25:38.828180+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T13:25:38.828180+0000","last_undegraded":"2024-02-17T13:25:38.828180+0000","last_fullsized":"2024-02-17T13:25:38.828180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"26'127","reported_seq":158,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.938919+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T13:25:18.938919+0000","last_peered":"2024-02-17T13:25:18.938919+0000","last_clean":"2024-02-17T13:25:18.938919+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T13:25:18.938919+0000","last_undegraded":"2024-02-17T13:25:18.938919+0000","last_fullsized":"2024-02-17T13:25:18.938919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.487042+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T13:25:49.487042+0000","last_peered":"2024-02-17T13:25:49.487042+0000","last_clean":"2024-02-17T13:25:49.487042+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T13:25:49.487042+0000","last_undegraded":"2024-02-17T13:25:49.487042+0000","last_fullsized":"2024-02-17T13:25:49.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'3","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.803465+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T13:25:38.803465+0000","last_peered":"2024-02-17T13:25:38.803465+0000","last_clean":"2024-02-17T13:25:38.803465+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T13:25:38.803465+0000","last_undegraded":"2024-02-17T13:25:38.803465+0000","last_fullsized":"2024-02-17T13:25:38.803465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"26'191","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.087918+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T13:25:19.087918+0000","last_peered":"2024-02-17T13:25:19.087918+0000","last_clean":"2024-02-17T13:25:19.087918+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T13:25:19.087918+0000","last_undegraded":"2024-02-17T13:25:19.087918+0000","last_fullsized":"2024-02-17T13:25:19.087918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489384+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T13:25:49.489384+0000","last_peered":"2024-02-17T13:25:49.489384+0000","last_clean":"2024-02-17T13:25:49.489384+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T13:25:49.489384+0000","last_undegraded":"2024-02-17T13:25:49.489384+0000","last_fullsized":"2024-02-17T13:25:49.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'11","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832523+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T13:25:39.832523+0000","last_peered":"2024-02-17T13:25:39.832523+0000","last_clean":"2024-02-17T13:25:39.832523+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T13:25:39.832523+0000","last_undegraded":"2024-02-17T13:25:39.832523+0000","last_fullsized":"2024-02-17T13:25:39.832523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'113","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.208163+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T13:25:19.208163+0000","last_peered":"2024-02-17T13:25:19.208163+0000","last_clean":"2024-02-17T13:25:19.208163+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T13:25:19.208163+0000","last_undegraded":"2024-02-17T13:25:19.208163+0000","last_fullsized":"2024-02-17T13:25:19.208163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"26'31","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.379514+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T13:25:49.379514+0000","last_peered":"2024-02-17T13:25:49.379514+0000","last_clean":"2024-02-17T13:25:49.379514+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T13:25:49.379514+0000","last_undegraded":"2024-02-17T13:25:49.379514+0000","last_fullsized":"2024-02-17T13:25:49.379514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'915","reported_seq":1858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:47.836576+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T13:25:47.836576+0000","last_peered":"2024-02-17T13:25:47.836576+0000","last_clean":"2024-02-17T13:25:47.836576+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T13:25:47.836576+0000","last_undegraded":"2024-02-17T13:25:47.836576+0000","last_fullsized":"2024-02-17T13:25:47.836576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210123,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":913,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'127","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.471424+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T13:25:19.471424+0000","last_peered":"2024-02-17T13:25:19.471424+0000","last_clean":"2024-02-17T13:25:19.471424+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T13:25:19.471424+0000","last_undegraded":"2024-02-17T13:25:19.471424+0000","last_fullsized":"2024-02-17T13:25:19.471424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"26'29","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365373+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T13:25:49.365373+0000","last_peered":"2024-02-17T13:25:49.365373+0000","last_clean":"2024-02-17T13:25:49.365373+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T13:25:49.365373+0000","last_undegraded":"2024-02-17T13:25:49.365373+0000","last_fullsized":"2024-02-17T13:25:49.365373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'489","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.777369+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T13:25:37.777369+0000","last_peered":"2024-02-17T13:25:37.777369+0000","last_clean":"2024-02-17T13:25:37.777369+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T13:25:37.777369+0000","last_undegraded":"2024-02-17T13:25:37.777369+0000","last_fullsized":"2024-02-17T13:25:37.777369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'120","reported_seq":150,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.298901+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T13:25:20.298901+0000","last_peered":"2024-02-17T13:25:20.298901+0000","last_clean":"2024-02-17T13:25:20.298901+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T13:25:20.298901+0000","last_undegraded":"2024-02-17T13:25:20.298901+0000","last_fullsized":"2024-02-17T13:25:20.298901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'33","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.497629+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T13:25:49.497629+0000","last_peered":"2024-02-17T13:25:49.497629+0000","last_clean":"2024-02-17T13:25:49.497629+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T13:25:49.497629+0000","last_undegraded":"2024-02-17T13:25:49.497629+0000","last_fullsized":"2024-02-17T13:25:49.497629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'8","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:25.324449+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T13:25:25.324449+0000","last_peered":"2024-02-17T13:25:25.324449+0000","last_clean":"2024-02-17T13:25:25.324449+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T13:25:25.324449+0000","last_undegraded":"2024-02-17T13:25:25.324449+0000","last_fullsized":"2024-02-17T13:25:25.324449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:23:47.670665+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T13:23:47.670665+0000","last_peered":"2024-02-17T13:23:47.670665+0000","last_clean":"2024-02-17T13:23:47.670665+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T13:23:47.670665+0000","last_undegraded":"2024-02-17T13:23:47.670665+0000","last_fullsized":"2024-02-17T13:23:47.670665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"26'170","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.758963+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T13:25:18.758963+0000","last_peered":"2024-02-17T13:25:18.758963+0000","last_clean":"2024-02-17T13:25:18.758963+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T13:25:18.758963+0000","last_undegraded":"2024-02-17T13:25:18.758963+0000","last_fullsized":"2024-02-17T13:25:18.758963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":8669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463142+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T13:25:49.463142+0000","last_peered":"2024-02-17T13:25:49.463142+0000","last_clean":"2024-02-17T13:25:49.463142+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T13:25:49.463142+0000","last_undegraded":"2024-02-17T13:25:49.463142+0000","last_fullsized":"2024-02-17T13:25:49.463142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832570+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T13:25:39.832570+0000","last_peered":"2024-02-17T13:25:39.832570+0000","last_clean":"2024-02-17T13:25:39.832570+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T13:25:39.832570+0000","last_undegraded":"2024-02-17T13:25:39.832570+0000","last_fullsized":"2024-02-17T13:25:39.832570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'141","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.250071+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T13:25:20.250071+0000","last_peered":"2024-02-17T13:25:20.250071+0000","last_clean":"2024-02-17T13:25:20.250071+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T13:25:20.250071+0000","last_undegraded":"2024-02-17T13:25:20.250071+0000","last_fullsized":"2024-02-17T13:25:20.250071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'39","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484983+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T13:25:49.484983+0000","last_peered":"2024-02-17T13:25:49.484983+0000","last_clean":"2024-02-17T13:25:49.484983+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T13:25:49.484983+0000","last_undegraded":"2024-02-17T13:25:49.484983+0000","last_fullsized":"2024-02-17T13:25:49.484983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.826449+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T13:25:39.826449+0000","last_peered":"2024-02-17T13:25:39.826449+0000","last_clean":"2024-02-17T13:25:39.826449+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T13:25:39.826449+0000","last_undegraded":"2024-02-17T13:25:39.826449+0000","last_fullsized":"2024-02-17T13:25:39.826449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'175","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.735811+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T13:25:18.735811+0000","last_peered":"2024-02-17T13:25:18.735811+0000","last_clean":"2024-02-17T13:25:18.735811+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T13:25:18.735811+0000","last_undegraded":"2024-02-17T13:25:18.735811+0000","last_fullsized":"2024-02-17T13:25:18.735811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"26'35","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493605+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T13:25:49.493605+0000","last_peered":"2024-02-17T13:25:49.493605+0000","last_clean":"2024-02-17T13:25:49.493605+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T13:25:49.493605+0000","last_undegraded":"2024-02-17T13:25:49.493605+0000","last_fullsized":"2024-02-17T13:25:49.493605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:56.868466+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T13:24:56.868466+0000","last_peered":"2024-02-17T13:24:56.868466+0000","last_clean":"2024-02-17T13:24:56.868466+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T13:24:56.868466+0000","last_undegraded":"2024-02-17T13:24:56.868466+0000","last_fullsized":"2024-02-17T13:24:56.868466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"26'122","reported_seq":152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.734689+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T13:25:18.734689+0000","last_peered":"2024-02-17T13:25:18.734689+0000","last_clean":"2024-02-17T13:25:18.734689+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T13:25:18.734689+0000","last_undegraded":"2024-02-17T13:25:18.734689+0000","last_fullsized":"2024-02-17T13:25:18.734689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'21","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.492241+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T13:25:49.492241+0000","last_peered":"2024-02-17T13:25:49.492241+0000","last_clean":"2024-02-17T13:25:49.492241+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T13:25:49.492241+0000","last_undegraded":"2024-02-17T13:25:49.492241+0000","last_fullsized":"2024-02-17T13:25:49.492241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.700211+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T13:25:36.700211+0000","last_peered":"2024-02-17T13:25:36.700211+0000","last_clean":"2024-02-17T13:25:36.700211+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T13:25:36.700211+0000","last_undegraded":"2024-02-17T13:25:36.700211+0000","last_fullsized":"2024-02-17T13:25:36.700211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"26'161","reported_seq":191,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.289519+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T13:25:20.289519+0000","last_peered":"2024-02-17T13:25:20.289519+0000","last_clean":"2024-02-17T13:25:20.289519+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T13:25:20.289519+0000","last_undegraded":"2024-02-17T13:25:20.289519+0000","last_fullsized":"2024-02-17T13:25:20.289519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.448139+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T13:25:49.448139+0000","last_peered":"2024-02-17T13:25:49.448139+0000","last_clean":"2024-02-17T13:25:49.448139+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T13:25:49.448139+0000","last_undegraded":"2024-02-17T13:25:49.448139+0000","last_fullsized":"2024-02-17T13:25:49.448139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'20","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.839150+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T13:25:42.839150+0000","last_peered":"2024-02-17T13:25:42.839150+0000","last_clean":"2024-02-17T13:25:42.839150+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T13:25:42.839150+0000","last_undegraded":"2024-02-17T13:25:42.839150+0000","last_fullsized":"2024-02-17T13:25:42.839150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"26'138","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.173860+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T13:25:19.173860+0000","last_peered":"2024-02-17T13:25:19.173860+0000","last_clean":"2024-02-17T13:25:19.173860+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T13:25:19.173860+0000","last_undegraded":"2024-02-17T13:25:19.173860+0000","last_fullsized":"2024-02-17T13:25:19.173860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'30","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.462936+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T13:25:49.462936+0000","last_peered":"2024-02-17T13:25:49.462936+0000","last_clean":"2024-02-17T13:25:49.462936+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T13:25:49.462936+0000","last_undegraded":"2024-02-17T13:25:49.462936+0000","last_fullsized":"2024-02-17T13:25:49.462936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.837114+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T13:25:42.837114+0000","last_peered":"2024-02-17T13:25:42.837114+0000","last_clean":"2024-02-17T13:25:42.837114+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T13:25:42.837114+0000","last_undegraded":"2024-02-17T13:25:42.837114+0000","last_fullsized":"2024-02-17T13:25:42.837114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"26'136","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.534811+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T13:25:19.534811+0000","last_peered":"2024-02-17T13:25:19.534811+0000","last_clean":"2024-02-17T13:25:19.534811+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T13:25:19.534811+0000","last_undegraded":"2024-02-17T13:25:19.534811+0000","last_fullsized":"2024-02-17T13:25:19.534811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457593+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T13:25:49.457593+0000","last_peered":"2024-02-17T13:25:49.457593+0000","last_clean":"2024-02-17T13:25:49.457593+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T13:25:49.457593+0000","last_undegraded":"2024-02-17T13:25:49.457593+0000","last_fullsized":"2024-02-17T13:25:49.457593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'15","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838689+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T13:25:42.838689+0000","last_peered":"2024-02-17T13:25:42.838689+0000","last_clean":"2024-02-17T13:25:42.838689+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T13:25:42.838689+0000","last_undegraded":"2024-02-17T13:25:42.838689+0000","last_fullsized":"2024-02-17T13:25:42.838689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'115","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.504760+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T13:25:19.504760+0000","last_peered":"2024-02-17T13:25:19.504760+0000","last_clean":"2024-02-17T13:25:19.504760+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T13:25:19.504760+0000","last_undegraded":"2024-02-17T13:25:19.504760+0000","last_fullsized":"2024-02-17T13:25:19.504760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365988+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T13:25:49.365988+0000","last_peered":"2024-02-17T13:25:49.365988+0000","last_clean":"2024-02-17T13:25:49.365988+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T13:25:49.365988+0000","last_undegraded":"2024-02-17T13:25:49.365988+0000","last_fullsized":"2024-02-17T13:25:49.365988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'131","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.189245+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T13:25:49.189245+0000","last_peered":"2024-02-17T13:25:49.189245+0000","last_clean":"2024-02-17T13:25:49.189245+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T13:25:49.189245+0000","last_undegraded":"2024-02-17T13:25:49.189245+0000","last_fullsized":"2024-02-17T13:25:49.189245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110453,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'131","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.517917+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T13:25:19.517917+0000","last_peered":"2024-02-17T13:25:19.517917+0000","last_clean":"2024-02-17T13:25:19.517917+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T13:25:19.517917+0000","last_undegraded":"2024-02-17T13:25:19.517917+0000","last_fullsized":"2024-02-17T13:25:19.517917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'37","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.492996+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T13:25:49.492996+0000","last_peered":"2024-02-17T13:25:49.492996+0000","last_clean":"2024-02-17T13:25:49.492996+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T13:25:49.492996+0000","last_undegraded":"2024-02-17T13:25:49.492996+0000","last_fullsized":"2024-02-17T13:25:49.492996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'822","reported_seq":859,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.668393+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T13:25:34.668393+0000","last_peered":"2024-02-17T13:25:34.668393+0000","last_clean":"2024-02-17T13:25:34.668393+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T13:25:34.668393+0000","last_undegraded":"2024-02-17T13:25:34.668393+0000","last_fullsized":"2024-02-17T13:25:34.668393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"26'125","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.074969+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T13:25:18.074969+0000","last_peered":"2024-02-17T13:25:18.074969+0000","last_clean":"2024-02-17T13:25:18.074969+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T13:25:18.074969+0000","last_undegraded":"2024-02-17T13:25:18.074969+0000","last_fullsized":"2024-02-17T13:25:18.074969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'32","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.456054+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T13:25:49.456054+0000","last_peered":"2024-02-17T13:25:49.456054+0000","last_clean":"2024-02-17T13:25:49.456054+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T13:25:49.456054+0000","last_undegraded":"2024-02-17T13:25:49.456054+0000","last_fullsized":"2024-02-17T13:25:49.456054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'655","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:43.826125+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T13:25:43.826125+0000","last_peered":"2024-02-17T13:25:43.826125+0000","last_clean":"2024-02-17T13:25:43.826125+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T13:25:43.826125+0000","last_undegraded":"2024-02-17T13:25:43.826125+0000","last_fullsized":"2024-02-17T13:25:43.826125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"26'151","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.524925+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T13:25:19.524925+0000","last_peered":"2024-02-17T13:25:19.524925+0000","last_clean":"2024-02-17T13:25:19.524925+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T13:25:19.524925+0000","last_undegraded":"2024-02-17T13:25:19.524925+0000","last_fullsized":"2024-02-17T13:25:19.524925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":23394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372478+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.372478+0000","last_peered":"2024-02-17T13:25:49.372478+0000","last_clean":"2024-02-17T13:25:49.372478+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T13:25:49.372478+0000","last_undegraded":"2024-02-17T13:25:49.372478+0000","last_fullsized":"2024-02-17T13:25:49.372478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:32.705035+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T13:24:32.705035+0000","last_peered":"2024-02-17T13:24:32.705035+0000","last_clean":"2024-02-17T13:24:32.705035+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T13:24:32.705035+0000","last_undegraded":"2024-02-17T13:24:32.705035+0000","last_fullsized":"2024-02-17T13:24:32.705035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'126","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.247930+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T13:25:20.247930+0000","last_peered":"2024-02-17T13:25:20.247930+0000","last_clean":"2024-02-17T13:25:20.247930+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T13:25:20.247930+0000","last_undegraded":"2024-02-17T13:25:20.247930+0000","last_fullsized":"2024-02-17T13:25:20.247930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":10959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'43","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.496309+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T13:25:49.496309+0000","last_peered":"2024-02-17T13:25:49.496309+0000","last_clean":"2024-02-17T13:25:49.496309+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T13:25:49.496309+0000","last_undegraded":"2024-02-17T13:25:49.496309+0000","last_fullsized":"2024-02-17T13:25:49.496309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'13","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.189468+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T13:25:49.189468+0000","last_peered":"2024-02-17T13:25:49.189468+0000","last_clean":"2024-02-17T13:25:49.189468+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T13:25:49.189468+0000","last_undegraded":"2024-02-17T13:25:49.189468+0000","last_fullsized":"2024-02-17T13:25:49.189468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'167","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.177328+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T13:25:21.177328+0000","last_peered":"2024-02-17T13:25:21.177328+0000","last_clean":"2024-02-17T13:25:21.177328+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T13:25:21.177328+0000","last_undegraded":"2024-02-17T13:25:21.177328+0000","last_fullsized":"2024-02-17T13:25:21.177328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"26'142","reported_seq":173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.459798+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T13:25:19.459798+0000","last_peered":"2024-02-17T13:25:19.459798+0000","last_clean":"2024-02-17T13:25:19.459798+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T13:25:19.459798+0000","last_undegraded":"2024-02-17T13:25:19.459798+0000","last_fullsized":"2024-02-17T13:25:19.459798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":9062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564794+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T13:25:49.564794+0000","last_peered":"2024-02-17T13:25:49.564794+0000","last_clean":"2024-02-17T13:25:49.564794+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T13:25:49.564794+0000","last_undegraded":"2024-02-17T13:25:49.564794+0000","last_fullsized":"2024-02-17T13:25:49.564794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.661702+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T13:25:34.661702+0000","last_peered":"2024-02-17T13:25:34.661702+0000","last_clean":"2024-02-17T13:25:34.661702+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T13:25:34.661702+0000","last_undegraded":"2024-02-17T13:25:34.661702+0000","last_fullsized":"2024-02-17T13:25:34.661702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.167721+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T13:25:21.167721+0000","last_peered":"2024-02-17T13:25:21.167721+0000","last_clean":"2024-02-17T13:25:21.167721+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T13:25:21.167721+0000","last_undegraded":"2024-02-17T13:25:21.167721+0000","last_fullsized":"2024-02-17T13:25:21.167721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":20244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.381918+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T13:25:49.381918+0000","last_peered":"2024-02-17T13:25:49.381918+0000","last_clean":"2024-02-17T13:25:49.381918+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T13:25:49.381918+0000","last_undegraded":"2024-02-17T13:25:49.381918+0000","last_fullsized":"2024-02-17T13:25:49.381918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'12","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.704801+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T13:25:36.704801+0000","last_peered":"2024-02-17T13:25:36.704801+0000","last_clean":"2024-02-17T13:25:36.704801+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T13:25:36.704801+0000","last_undegraded":"2024-02-17T13:25:36.704801+0000","last_fullsized":"2024-02-17T13:25:36.704801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'680","reported_seq":717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:32.633839+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T13:25:32.633839+0000","last_peered":"2024-02-17T13:25:32.633839+0000","last_clean":"2024-02-17T13:25:32.633839+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T13:25:32.633839+0000","last_undegraded":"2024-02-17T13:25:32.633839+0000","last_fullsized":"2024-02-17T13:25:32.633839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.529720+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T13:25:49.529720+0000","last_peered":"2024-02-17T13:25:49.529720+0000","last_clean":"2024-02-17T13:25:49.529720+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T13:25:49.529720+0000","last_undegraded":"2024-02-17T13:25:49.529720+0000","last_fullsized":"2024-02-17T13:25:49.529720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'95","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.545426+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T13:25:19.545426+0000","last_peered":"2024-02-17T13:25:19.545426+0000","last_clean":"2024-02-17T13:25:19.545426+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T13:25:19.545426+0000","last_undegraded":"2024-02-17T13:25:19.545426+0000","last_fullsized":"2024-02-17T13:25:19.545426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'659","reported_seq":696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.776248+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T13:25:37.776248+0000","last_peered":"2024-02-17T13:25:37.776248+0000","last_clean":"2024-02-17T13:25:37.776248+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T13:25:37.776248+0000","last_undegraded":"2024-02-17T13:25:37.776248+0000","last_fullsized":"2024-02-17T13:25:37.776248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463775+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T13:25:49.463775+0000","last_peered":"2024-02-17T13:25:49.463775+0000","last_clean":"2024-02-17T13:25:49.463775+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T13:25:49.463775+0000","last_undegraded":"2024-02-17T13:25:49.463775+0000","last_fullsized":"2024-02-17T13:25:49.463775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'162","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.268760+0000","last_change":"2024-02-17T12:58:37.887482+0000","last_active":"2024-02-17T13:25:20.268760+0000","last_peered":"2024-02-17T13:25:20.268760+0000","last_clean":"2024-02-17T13:25:20.268760+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T13:25:20.268760+0000","last_undegraded":"2024-02-17T13:25:20.268760+0000","last_fullsized":"2024-02-17T13:25:20.268760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:58.699256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493265+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T13:25:49.493265+0000","last_peered":"2024-02-17T13:25:49.493265+0000","last_clean":"2024-02-17T13:25:49.493265+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T13:25:49.493265+0000","last_undegraded":"2024-02-17T13:25:49.493265+0000","last_fullsized":"2024-02-17T13:25:49.493265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387808+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T13:25:49.387808+0000","last_peered":"2024-02-17T13:25:49.387808+0000","last_clean":"2024-02-17T13:25:49.387808+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T13:25:49.387808+0000","last_undegraded":"2024-02-17T13:25:49.387808+0000","last_fullsized":"2024-02-17T13:25:49.387808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"26'45","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.441835+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T13:25:49.441835+0000","last_peered":"2024-02-17T13:25:49.441835+0000","last_clean":"2024-02-17T13:25:49.441835+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T13:25:49.441835+0000","last_undegraded":"2024-02-17T13:25:49.441835+0000","last_fullsized":"2024-02-17T13:25:49.441835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.383488+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T13:25:49.383488+0000","last_peered":"2024-02-17T13:25:49.383488+0000","last_clean":"2024-02-17T13:25:49.383488+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T13:25:49.383488+0000","last_undegraded":"2024-02-17T13:25:49.383488+0000","last_fullsized":"2024-02-17T13:25:49.383488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"26'27","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.368239+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T13:25:49.368239+0000","last_peered":"2024-02-17T13:25:49.368239+0000","last_clean":"2024-02-17T13:25:49.368239+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T13:25:49.368239+0000","last_undegraded":"2024-02-17T13:25:49.368239+0000","last_fullsized":"2024-02-17T13:25:49.368239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367306+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T13:25:49.367306+0000","last_peered":"2024-02-17T13:25:49.367306+0000","last_clean":"2024-02-17T13:25:49.367306+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T13:25:49.367306+0000","last_undegraded":"2024-02-17T13:25:49.367306+0000","last_fullsized":"2024-02-17T13:25:49.367306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'43","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489937+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T13:25:49.489937+0000","last_peered":"2024-02-17T13:25:49.489937+0000","last_clean":"2024-02-17T13:25:49.489937+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T13:25:49.489937+0000","last_undegraded":"2024-02-17T13:25:49.489937+0000","last_fullsized":"2024-02-17T13:25:49.489937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"26'31","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.370293+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.370293+0000","last_peered":"2024-02-17T13:25:49.370293+0000","last_clean":"2024-02-17T13:25:49.370293+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T13:25:49.370293+0000","last_undegraded":"2024-02-17T13:25:49.370293+0000","last_fullsized":"2024-02-17T13:25:49.370293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449478+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T13:25:49.449478+0000","last_peered":"2024-02-17T13:25:49.449478+0000","last_clean":"2024-02-17T13:25:49.449478+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T13:25:49.449478+0000","last_undegraded":"2024-02-17T13:25:49.449478+0000","last_fullsized":"2024-02-17T13:25:49.449478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.377561+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T13:25:49.377561+0000","last_peered":"2024-02-17T13:25:49.377561+0000","last_clean":"2024-02-17T13:25:49.377561+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T13:25:49.377561+0000","last_undegraded":"2024-02-17T13:25:49.377561+0000","last_fullsized":"2024-02-17T13:25:49.377561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"26'38","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463712+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T13:25:49.463712+0000","last_peered":"2024-02-17T13:25:49.463712+0000","last_clean":"2024-02-17T13:25:49.463712+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T13:25:49.463712+0000","last_undegraded":"2024-02-17T13:25:49.463712+0000","last_fullsized":"2024-02-17T13:25:49.463712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.527824+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T13:25:49.527824+0000","last_peered":"2024-02-17T13:25:49.527824+0000","last_clean":"2024-02-17T13:25:49.527824+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T13:25:49.527824+0000","last_undegraded":"2024-02-17T13:25:49.527824+0000","last_fullsized":"2024-02-17T13:25:49.527824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'39","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387085+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T13:25:49.387085+0000","last_peered":"2024-02-17T13:25:49.387085+0000","last_clean":"2024-02-17T13:25:49.387085+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T13:25:49.387085+0000","last_undegraded":"2024-02-17T13:25:49.387085+0000","last_fullsized":"2024-02-17T13:25:49.387085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.446228+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T13:25:49.446228+0000","last_peered":"2024-02-17T13:25:49.446228+0000","last_clean":"2024-02-17T13:25:49.446228+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T13:25:49.446228+0000","last_undegraded":"2024-02-17T13:25:49.446228+0000","last_fullsized":"2024-02-17T13:25:49.446228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387119+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T13:25:49.387119+0000","last_peered":"2024-02-17T13:25:49.387119+0000","last_clean":"2024-02-17T13:25:49.387119+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T13:25:49.387119+0000","last_undegraded":"2024-02-17T13:25:49.387119+0000","last_fullsized":"2024-02-17T13:25:49.387119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457531+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T13:25:49.457531+0000","last_peered":"2024-02-17T13:25:49.457531+0000","last_clean":"2024-02-17T13:25:49.457531+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T13:25:49.457531+0000","last_undegraded":"2024-02-17T13:25:49.457531+0000","last_fullsized":"2024-02-17T13:25:49.457531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"26'42","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449553+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T13:25:49.449553+0000","last_peered":"2024-02-17T13:25:49.449553+0000","last_clean":"2024-02-17T13:25:49.449553+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T13:25:49.449553+0000","last_undegraded":"2024-02-17T13:25:49.449553+0000","last_fullsized":"2024-02-17T13:25:49.449553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.373687+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T13:25:49.373687+0000","last_peered":"2024-02-17T13:25:49.373687+0000","last_clean":"2024-02-17T13:25:49.373687+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T13:25:49.373687+0000","last_undegraded":"2024-02-17T13:25:49.373687+0000","last_fullsized":"2024-02-17T13:25:49.373687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367333+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T13:25:49.367333+0000","last_peered":"2024-02-17T13:25:49.367333+0000","last_clean":"2024-02-17T13:25:49.367333+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T13:25:49.367333+0000","last_undegraded":"2024-02-17T13:25:49.367333+0000","last_fullsized":"2024-02-17T13:25:49.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367607+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T13:25:49.367607+0000","last_peered":"2024-02-17T13:25:49.367607+0000","last_clean":"2024-02-17T13:25:49.367607+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T13:25:49.367607+0000","last_undegraded":"2024-02-17T13:25:49.367607+0000","last_fullsized":"2024-02-17T13:25:49.367607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494123+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T13:25:49.494123+0000","last_peered":"2024-02-17T13:25:49.494123+0000","last_clean":"2024-02-17T13:25:49.494123+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T13:25:49.494123+0000","last_undegraded":"2024-02-17T13:25:49.494123+0000","last_fullsized":"2024-02-17T13:25:49.494123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489516+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T13:25:49.489516+0000","last_peered":"2024-02-17T13:25:49.489516+0000","last_clean":"2024-02-17T13:25:49.489516+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T13:25:49.489516+0000","last_undegraded":"2024-02-17T13:25:49.489516+0000","last_fullsized":"2024-02-17T13:25:49.489516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"26'48","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494410+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T13:25:49.494410+0000","last_peered":"2024-02-17T13:25:49.494410+0000","last_clean":"2024-02-17T13:25:49.494410+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T13:25:49.494410+0000","last_undegraded":"2024-02-17T13:25:49.494410+0000","last_fullsized":"2024-02-17T13:25:49.494410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"26'38","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464326+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T13:25:49.464326+0000","last_peered":"2024-02-17T13:25:49.464326+0000","last_clean":"2024-02-17T13:25:49.464326+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T13:25:49.464326+0000","last_undegraded":"2024-02-17T13:25:49.464326+0000","last_fullsized":"2024-02-17T13:25:49.464326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382911+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T13:25:49.382911+0000","last_peered":"2024-02-17T13:25:49.382911+0000","last_clean":"2024-02-17T13:25:49.382911+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T13:25:49.382911+0000","last_undegraded":"2024-02-17T13:25:49.382911+0000","last_fullsized":"2024-02-17T13:25:49.382911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484270+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T13:25:49.484270+0000","last_peered":"2024-02-17T13:25:49.484270+0000","last_clean":"2024-02-17T13:25:49.484270+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T13:25:49.484270+0000","last_undegraded":"2024-02-17T13:25:49.484270+0000","last_fullsized":"2024-02-17T13:25:49.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.490441+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T13:25:49.490441+0000","last_peered":"2024-02-17T13:25:49.490441+0000","last_clean":"2024-02-17T13:25:49.490441+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T13:25:49.490441+0000","last_undegraded":"2024-02-17T13:25:49.490441+0000","last_fullsized":"2024-02-17T13:25:49.490441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.487475+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T13:25:49.487475+0000","last_peered":"2024-02-17T13:25:49.487475+0000","last_clean":"2024-02-17T13:25:49.487475+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T13:25:49.487475+0000","last_undegraded":"2024-02-17T13:25:49.487475+0000","last_fullsized":"2024-02-17T13:25:49.487475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'26","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489870+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T13:25:49.489870+0000","last_peered":"2024-02-17T13:25:49.489870+0000","last_clean":"2024-02-17T13:25:49.489870+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T13:25:49.489870+0000","last_undegraded":"2024-02-17T13:25:49.489870+0000","last_fullsized":"2024-02-17T13:25:49.489870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'41","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382700+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T13:25:49.382700+0000","last_peered":"2024-02-17T13:25:49.382700+0000","last_clean":"2024-02-17T13:25:49.382700+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T13:25:49.382700+0000","last_undegraded":"2024-02-17T13:25:49.382700+0000","last_fullsized":"2024-02-17T13:25:49.382700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372153+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T13:25:49.372153+0000","last_peered":"2024-02-17T13:25:49.372153+0000","last_clean":"2024-02-17T13:25:49.372153+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T13:25:49.372153+0000","last_undegraded":"2024-02-17T13:25:49.372153+0000","last_fullsized":"2024-02-17T13:25:49.372153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"26'26","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484733+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T13:25:49.484733+0000","last_peered":"2024-02-17T13:25:49.484733+0000","last_clean":"2024-02-17T13:25:49.484733+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T13:25:49.484733+0000","last_undegraded":"2024-02-17T13:25:49.484733+0000","last_fullsized":"2024-02-17T13:25:49.484733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3911,"num_write_kb":306687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4416,"ondisk_log_size":4416,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39077972,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":11090,"num_write_kb":44057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78405632,"data_stored":78155944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9139,"ondisk_log_size":9139,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575191,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63244,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308596,"statfs":{"total":96636764160,"available":96572002304,"internally_reserved":0,"allocated":5836800,"data_stored":5629759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":0.55900000000000005,"5min":0.65000000000000002,"15min":0.71199999999999997},"last":0.38},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.64400000000000002,"15min":0.749},"last":0.44600000000000001}]},{"osd":2,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.72999999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.623,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.52800000000000002,"5min":0.69599999999999995,"15min":0.73599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":0.63600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.79400000000000004},"last":0.32900000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76300000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.27000000000000002},"max":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.31},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81599999999999995,"5min":0.90200000000000002,"15min":0.92800000000000005},"last":0.42999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":4388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":4493312,"data_stored":4311853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28799999999999998,"15min":0.217},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.68300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65500000000000003,"5min":0.67800000000000005,"15min":0.75700000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.70899999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.80000000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.63200000000000001,"5min":0.71899999999999997,"15min":0.72099999999999997},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.49299999999999999,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.27400000000000002},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.77300000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.86199999999999999,"15min":0.93400000000000005},"last":0.378},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.23599999999999999},"max":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.84199999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.878},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.80800000000000005,"15min":0.94899999999999995},"last":0.44700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575190,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70916,"kb_used_data":13372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300924,"statfs":{"total":96636764160,"available":96564146176,"internally_reserved":0,"allocated":13692928,"data_stored":13498704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57199999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.435},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.78100000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.751},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.28799999999999998},"max":{"1min":0.61799999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.40899999999999997,"5min":0.28999999999999998,"15min":0.28199999999999997},"max":{"1min":0.67200000000000004,"5min":0.73299999999999998,"15min":0.75600000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":4,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27300000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.79700000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.71199999999999997}]},{"osd":6,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.872},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575190,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53580,"kb_used_data":8516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318260,"statfs":{"total":96636764160,"available":96581898240,"internally_reserved":0,"allocated":8720384,"data_stored":8505123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.59099999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.69199999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57799999999999996,"5min":0.621,"15min":0.745},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.71899999999999997},"last":0.433}]},{"osd":2,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.77900000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29699999999999999},"max":{"1min":0.63700000000000001,"5min":0.68400000000000005,"15min":0.68500000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.82199999999999995},"last":0.498}]},{"osd":5,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44600000000000001,"15min":0.46999999999999997},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.318},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.47899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64200000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38400000000000001}]},{"osd":6,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46800000000000003,"15min":0.48799999999999999},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66300000000000003,"5min":0.76800000000000002,"15min":0.872},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.36599999999999999}]},{"osd":7,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575191,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78404,"kb_used_data":16700,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293436,"statfs":{"total":96636764160,"available":96556478464,"internally_reserved":0,"allocated":17100800,"data_stored":16894525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.29799999999999999,"15min":0.30199999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.47499999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"last":0.37},{"interface":"front","average":{"1min":0.318,"5min":0.309,"15min":0.311},"min":{"1min":0.223,"5min":0.223,"15min":0.21099999999999999},"max":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48799999999999999},"last":0.24199999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.19400000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.626,"5min":0.626,"15min":0.64600000000000002},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32100000000000001},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.79100000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.77000000000000002,"15min":0.77300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.75900000000000001,"15min":0.81899999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.85599999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.754,"15min":0.82499999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.79300000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.375},"max":{"1min":0.624,"5min":0.88,"15min":0.88},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8503353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.187,"15min":0.186},"max":{"1min":0.44700000000000001,"5min":0.59599999999999997,"15min":0.82899999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.19800000000000001},"max":{"1min":0.371,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.94299999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.33500000000000002,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.377,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.54100000000000004},"last":0.379},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":1.02},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.29199999999999998},"max":{"1min":0.63900000000000001,"5min":0.74199999999999999,"15min":1.577},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.78600000000000003,"15min":0.86399999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.62,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63400000000000001,"5min":0.77000000000000002,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.76900000000000002,"15min":1.177},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36699999999999999},"max":{"1min":0.64300000000000002,"5min":0.80200000000000005,"15min":0.82399999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834575190,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48560,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323280,"statfs":{"total":96636764160,"available":96587038720,"internally_reserved":0,"allocated":9281536,"data_stored":9094395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.69299999999999995},"last":0.252},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.40699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32100000000000001,"15min":0.311},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.504,"5min":0.622,"15min":0.622},"last":0.318},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.56599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.378,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.60799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.50900000000000001,"15min":0.81699999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.626},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.87,"15min":0.87},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.90700000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35699999999999998},"max":{"1min":0.63600000000000001,"5min":0.80800000000000005,"15min":0.81399999999999995},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66400000000000003,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71228,"kb_used_data":13684,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300612,"statfs":{"total":96636764160,"available":96563826688,"internally_reserved":0,"allocated":14012416,"data_stored":13811008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29299999999999998},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.52900000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.38900000000000001,"5min":0.55000000000000004,"15min":0.58399999999999996},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.45100000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.497,"5min":0.54600000000000004,"15min":0.624},"last":0.371}]},{"osd":3,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.42999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.252},"max":{"1min":0.53300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.73699999999999999,"15min":0.77100000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.78400000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.752},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.84699999999999998},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":0.71399999999999997,"15min":0.77200000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.61699999999999999,"5min":0.72499999999999998,"15min":0.78400000000000003},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":13697003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12820480,"data_stored":12794331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5515754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T13:25:56.732 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T13:25:56.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T13:25:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.866+0000 7fab4653a640 1 Processor -- start 2024-02-17T13:25:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.866+0000 7fab4653a640 1 -- start start 2024-02-17T13:25:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.867+0000 7fab4653a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab400c4270 0x7fab400c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.867+0000 7fab4653a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400c84a0 con 0x7fab40070900 2024-02-17T13:25:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.867+0000 7fab4653a640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab401586c0 con 0x7fab40151c00 2024-02-17T13:25:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.867+0000 7fab4653a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab400b0310 con 0x7fab400c4270 2024-02-17T13:25:56.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.868+0000 7fab3ffff640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fab40151c00 0x7fab4006f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:35910/0 (socket says 172.21.15.136:35910) 2024-02-17T13:25:56.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.868+0000 7fab3ffff640 1 -- 172.21.15.136:0/3168843426 learned_addr learned my addr 172.21.15.136:0/3168843426 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:56.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.868+0000 7fab3f7fe640 1 --2- 172.21.15.136:0/3168843426 >> v2:172.21.15.136:3300/0 conn(0x7fab400c4270 0x7fab400c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.870+0000 7fab3effd640 1 -- 172.21.15.136:0/3168843426 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007379678 0 0) 0x7fab401586c0 con 0x7fab40151c00 2024-02-17T13:25:56.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.870+0000 7fab3effd640 1 -- 172.21.15.136:0/3168843426 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab28003520 con 0x7fab40151c00 2024-02-17T13:25:56.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.873+0000 7fab3f7fe640 1 -- 172.21.15.136:0/3168843426 >> v1:172.21.15.160:6789/0 conn(0x7fab40151c00 legacy=0x7fab4006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.873+0000 7fab3f7fe640 1 -- 172.21.15.136:0/3168843426 >> v1:172.21.15.136:6789/0 conn(0x7fab40070900 legacy=0x7fab40070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.873+0000 7fab3f7fe640 1 -- 172.21.15.136:0/3168843426 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40158960 con 0x7fab400c4270 2024-02-17T13:25:56.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.876+0000 7fab3f7fe640 1 --2- 172.21.15.136:0/3168843426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab400c4270 0x7fab400c7f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fab340097a0 tx=0x7fab3402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d01b2baa10c06b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:56.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.880+0000 7fab3effd640 1 -- 172.21.15.136:0/3168843426 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3402f810 con 0x7fab400c4270 2024-02-17T13:25:56.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.880+0000 7fab3effd640 1 -- 172.21.15.136:0/3168843426 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3402f970 con 0x7fab400c4270 2024-02-17T13:25:56.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.880+0000 7fab3effd640 1 -- 172.21.15.136:0/3168843426 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3402fd00 con 0x7fab400c4270 2024-02-17T13:25:56.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 -- 172.21.15.136:0/3168843426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab400c4270 msgr2=0x7fab400c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 --2- 172.21.15.136:0/3168843426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab400c4270 0x7fab400c7f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fab340097a0 tx=0x7fab3402b9f0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 -- 172.21.15.136:0/3168843426 shutdown_connections 2024-02-17T13:25:56.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 --2- 172.21.15.136:0/3168843426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab400c4270 0x7fab400c7f60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 -- 172.21.15.136:0/3168843426 >> 172.21.15.136:0/3168843426 conn(0x7fab4006b0f0 msgr2=0x7fab400668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:56.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 -- 172.21.15.136:0/3168843426 shutdown_connections 2024-02-17T13:25:56.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.881+0000 7fab4653a640 1 -- 172.21.15.136:0/3168843426 wait complete. 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.882+0000 7fab4653a640 1 Processor -- start 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 -- start start 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab40070900 0x7fab400cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab400c4270 0x7fab401ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab40151c00 0x7fab4014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401472b0 con 0x7fab40151c00 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401463e0 con 0x7fab40070900 2024-02-17T13:25:56.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.883+0000 7fab4653a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab401466a0 con 0x7fab400c4270 2024-02-17T13:25:56.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.884+0000 7fab44ad7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab40151c00 0x7fab4014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.884+0000 7fab3ffff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab40070900 0x7fab400cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.884+0000 7fab3f7fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab400c4270 0x7fab401ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:56.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.884+0000 7fab44ad7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab40151c00 0x7fab4014ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40810/0 (socket says 172.21.15.136:40810) 2024-02-17T13:25:56.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.884+0000 7fab44ad7640 1 -- 172.21.15.136:0/713586728 learned_addr learned my addr 172.21.15.136:0/713586728 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:56.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.888+0000 7fab3ffff640 1 -- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab400c4270 msgr2=0x7fab401ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.888+0000 7fab3ffff640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab400c4270 0x7fab401ef0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.888+0000 7fab3ffff640 1 -- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab40151c00 msgr2=0x7fab4014ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:56.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.888+0000 7fab3ffff640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab40151c00 0x7fab4014ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:56.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.888+0000 7fab3ffff640 1 -- 172.21.15.136:0/713586728 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009400 con 0x7fab40070900 2024-02-17T13:25:56.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.890+0000 7fab3ffff640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab40070900 0x7fab400cde50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c390 tx=0x7fab30001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:56.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.893+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30005ce0 con 0x7fab40070900 2024-02-17T13:25:56.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.893+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30005e40 con 0x7fab40070900 2024-02-17T13:25:56.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.893+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab40146980 con 0x7fab40070900 2024-02-17T13:25:56.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.893+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300072f0 con 0x7fab40070900 2024-02-17T13:25:56.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.893+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab40146f40 con 0x7fab40070900 2024-02-17T13:25:56.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:56.894+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab400b1510 con 0x7fab40070900 2024-02-17T13:25:57.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.141+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fab30007510 con 0x7fab40070900 2024-02-17T13:25:57.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.141+0000 7fab3cff9640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fab2c06b860 0x7fab2c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.141+0000 7fab3f7fe640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fab2c06b860 0x7fab2c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.142+0000 7fab3f7fe640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fab2c06b860 0x7fab2c06dd20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab34036000 tx=0x7fab34008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:57.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.145+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fab30007e20 con 0x7fab40070900 2024-02-17T13:25:57.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.155+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab300548d0 con 0x7fab40070900 2024-02-17T13:25:57.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.326+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab400c3a50 con 0x7fab2c06b860 2024-02-17T13:25:57.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.334+0000 7fab3cff9640 1 -- 172.21.15.136:0/713586728 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371182 (secure 0 0 0) 0x7fab400c3a50 con 0x7fab2c06b860 2024-02-17T13:25:57.338 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:25:57.340 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fab2c06b860 msgr2=0x7fab2c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fab2c06b860 0x7fab2c06dd20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab34036000 tx=0x7fab34008030 comp rx=0 tx=0).stop 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab40070900 msgr2=0x7fab400cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab40070900 0x7fab400cde50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c390 tx=0x7fab30001e70 comp rx=0 tx=0).stop 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 shutdown_connections 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fab2c06b860 0x7fab2c06dd20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab40151c00 0x7fab4014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab400c4270 0x7fab401ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 --2- 172.21.15.136:0/713586728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab40070900 0x7fab400cde50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 >> 172.21.15.136:0/713586728 conn(0x7fab4006b0f0 msgr2=0x7fab401568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:57.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 shutdown_connections 2024-02-17T13:25:57.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.338+0000 7fab4653a640 1 -- 172.21.15.136:0/713586728 wait complete. 2024-02-17T13:25:57.349 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":866,"stamp":"2024-02-17T13:25:56.352734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39668340,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1020,"num_read_kb":1067,"num_write":15160,"num_write_kb":353160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15994,"ondisk_log_size":15994,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":465312,"kb_used_data":79904,"kb_used_omap":12,"kb_used_meta":385331,"kb_avail":754509408,"statfs":{"total":773094113280,"available":772617633792,"internally_reserved":0,"allocated":81821696,"data_stored":80248720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":394579504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19511,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":36,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003018"},"pg_stats":[{"pgid":"2.1f","version":"26'629","reported_seq":668,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:31.514596+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T13:25:31.514596+0000","last_peered":"2024-02-17T13:25:31.514596+0000","last_clean":"2024-02-17T13:25:31.514596+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T13:25:31.514596+0000","last_undegraded":"2024-02-17T13:25:31.514596+0000","last_fullsized":"2024-02-17T13:25:31.514596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"26'28","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.369320+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T13:25:49.369320+0000","last_peered":"2024-02-17T13:25:49.369320+0000","last_clean":"2024-02-17T13:25:49.369320+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T13:25:49.369320+0000","last_undegraded":"2024-02-17T13:25:49.369320+0000","last_fullsized":"2024-02-17T13:25:49.369320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'137","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.525946+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T13:25:19.525946+0000","last_peered":"2024-02-17T13:25:19.525946+0000","last_clean":"2024-02-17T13:25:19.525946+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T13:25:19.525946+0000","last_undegraded":"2024-02-17T13:25:19.525946+0000","last_fullsized":"2024-02-17T13:25:19.525946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'680","reported_seq":719,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:02.652322+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T13:24:02.652322+0000","last_peered":"2024-02-17T13:24:02.652322+0000","last_clean":"2024-02-17T13:24:02.652322+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T13:24:02.652322+0000","last_undegraded":"2024-02-17T13:24:02.652322+0000","last_fullsized":"2024-02-17T13:24:02.652322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":4495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.384035+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T13:25:49.384035+0000","last_peered":"2024-02-17T13:25:49.384035+0000","last_clean":"2024-02-17T13:25:49.384035+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T13:25:49.384035+0000","last_undegraded":"2024-02-17T13:25:49.384035+0000","last_fullsized":"2024-02-17T13:25:49.384035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"26'131","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.000552+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T13:25:19.000552+0000","last_peered":"2024-02-17T13:25:19.000552+0000","last_clean":"2024-02-17T13:25:19.000552+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T13:25:19.000552+0000","last_undegraded":"2024-02-17T13:25:19.000552+0000","last_fullsized":"2024-02-17T13:25:19.000552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'1331","reported_seq":1368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.829557+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T13:25:38.829557+0000","last_peered":"2024-02-17T13:25:38.829557+0000","last_clean":"2024-02-17T13:25:38.829557+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T13:25:38.829557+0000","last_undegraded":"2024-02-17T13:25:38.829557+0000","last_fullsized":"2024-02-17T13:25:38.829557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1331,"log_dups_size":0,"ondisk_log_size":1331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"26'31","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464446+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T13:25:49.464446+0000","last_peered":"2024-02-17T13:25:49.464446+0000","last_clean":"2024-02-17T13:25:49.464446+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T13:25:49.464446+0000","last_undegraded":"2024-02-17T13:25:49.464446+0000","last_fullsized":"2024-02-17T13:25:49.464446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'136","reported_seq":172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.323011+0000","last_change":"2024-02-17T12:58:37.887403+0000","last_active":"2024-02-17T13:25:20.323011+0000","last_peered":"2024-02-17T13:25:20.323011+0000","last_clean":"2024-02-17T13:25:20.323011+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T13:25:20.323011+0000","last_undegraded":"2024-02-17T13:25:20.323011+0000","last_fullsized":"2024-02-17T13:25:20.323011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":9317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.461295+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T13:25:28.461295+0000","last_peered":"2024-02-17T13:25:28.461295+0000","last_clean":"2024-02-17T13:25:28.461295+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T13:25:28.461295+0000","last_undegraded":"2024-02-17T13:25:28.461295+0000","last_fullsized":"2024-02-17T13:25:28.461295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:56.376192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.456929+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T13:25:49.456929+0000","last_peered":"2024-02-17T13:25:49.456929+0000","last_clean":"2024-02-17T13:25:49.456929+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T13:25:49.456929+0000","last_undegraded":"2024-02-17T13:25:49.456929+0000","last_fullsized":"2024-02-17T13:25:49.456929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:23.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"26'132","reported_seq":161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.091362+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T13:25:19.091362+0000","last_peered":"2024-02-17T13:25:19.091362+0000","last_clean":"2024-02-17T13:25:19.091362+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T13:25:19.091362+0000","last_undegraded":"2024-02-17T13:25:19.091362+0000","last_fullsized":"2024-02-17T13:25:19.091362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":5852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"26'36","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.454460+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T13:25:49.454460+0000","last_peered":"2024-02-17T13:25:49.454460+0000","last_clean":"2024-02-17T13:25:49.454460+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T13:25:49.454460+0000","last_undegraded":"2024-02-17T13:25:49.454460+0000","last_fullsized":"2024-02-17T13:25:49.454460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.514373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'621","reported_seq":659,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:40.856594+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T13:25:40.856594+0000","last_peered":"2024-02-17T13:25:40.856594+0000","last_clean":"2024-02-17T13:25:40.856594+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T13:25:40.856594+0000","last_undegraded":"2024-02-17T13:25:40.856594+0000","last_fullsized":"2024-02-17T13:25:40.856594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:29.073965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'112","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.367347+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T13:25:20.367347+0000","last_peered":"2024-02-17T13:25:20.367347+0000","last_clean":"2024-02-17T13:25:20.367347+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T13:25:20.367347+0000","last_undegraded":"2024-02-17T13:25:20.367347+0000","last_fullsized":"2024-02-17T13:25:20.367347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.441306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.388118+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T13:25:49.388118+0000","last_peered":"2024-02-17T13:25:49.388118+0000","last_clean":"2024-02-17T13:25:49.388118+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T13:25:49.388118+0000","last_undegraded":"2024-02-17T13:25:49.388118+0000","last_fullsized":"2024-02-17T13:25:49.388118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.261469+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T13:25:45.261469+0000","last_peered":"2024-02-17T13:25:45.261469+0000","last_clean":"2024-02-17T13:25:45.261469+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T13:25:45.261469+0000","last_undegraded":"2024-02-17T13:25:45.261469+0000","last_fullsized":"2024-02-17T13:25:45.261469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"26'166","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.474390+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T13:25:19.474390+0000","last_peered":"2024-02-17T13:25:19.474390+0000","last_clean":"2024-02-17T13:25:19.474390+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T13:25:19.474390+0000","last_undegraded":"2024-02-17T13:25:19.474390+0000","last_fullsized":"2024-02-17T13:25:19.474390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":14575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.503807+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T13:25:49.503807+0000","last_peered":"2024-02-17T13:25:49.503807+0000","last_clean":"2024-02-17T13:25:49.503807+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T13:25:49.503807+0000","last_undegraded":"2024-02-17T13:25:49.503807+0000","last_fullsized":"2024-02-17T13:25:49.503807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'9","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.456048+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T13:25:28.456048+0000","last_peered":"2024-02-17T13:25:28.456048+0000","last_clean":"2024-02-17T13:25:28.456048+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T13:25:28.456048+0000","last_undegraded":"2024-02-17T13:25:28.456048+0000","last_fullsized":"2024-02-17T13:25:28.456048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.486786+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T13:25:19.486786+0000","last_peered":"2024-02-17T13:25:19.486786+0000","last_clean":"2024-02-17T13:25:19.486786+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T13:25:19.486786+0000","last_undegraded":"2024-02-17T13:25:19.486786+0000","last_fullsized":"2024-02-17T13:25:19.486786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.878109+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T13:25:18.878109+0000","last_peered":"2024-02-17T13:25:18.878109+0000","last_clean":"2024-02-17T13:25:18.878109+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T13:25:18.878109+0000","last_undegraded":"2024-02-17T13:25:18.878109+0000","last_fullsized":"2024-02-17T13:25:18.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:06.104235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.773516+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T13:25:37.773516+0000","last_peered":"2024-02-17T13:25:37.773516+0000","last_clean":"2024-02-17T13:25:37.773516+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T13:25:37.773516+0000","last_undegraded":"2024-02-17T13:25:37.773516+0000","last_fullsized":"2024-02-17T13:25:37.773516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'126","reported_seq":156,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.546807+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T13:25:19.546807+0000","last_peered":"2024-02-17T13:25:19.546807+0000","last_clean":"2024-02-17T13:25:19.546807+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T13:25:19.546807+0000","last_undegraded":"2024-02-17T13:25:19.546807+0000","last_fullsized":"2024-02-17T13:25:19.546807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.526892+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T13:25:49.526892+0000","last_peered":"2024-02-17T13:25:49.526892+0000","last_clean":"2024-02-17T13:25:49.526892+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T13:25:49.526892+0000","last_undegraded":"2024-02-17T13:25:49.526892+0000","last_fullsized":"2024-02-17T13:25:49.526892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'16","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838762+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T13:25:42.838762+0000","last_peered":"2024-02-17T13:25:42.838762+0000","last_clean":"2024-02-17T13:25:42.838762+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T13:25:42.838762+0000","last_undegraded":"2024-02-17T13:25:42.838762+0000","last_fullsized":"2024-02-17T13:25:42.838762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"26'146","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.477902+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T13:25:19.477902+0000","last_peered":"2024-02-17T13:25:19.477902+0000","last_clean":"2024-02-17T13:25:19.477902+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T13:25:19.477902+0000","last_undegraded":"2024-02-17T13:25:19.477902+0000","last_fullsized":"2024-02-17T13:25:19.477902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564016+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T13:25:49.564016+0000","last_peered":"2024-02-17T13:25:49.564016+0000","last_clean":"2024-02-17T13:25:49.564016+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T13:25:49.564016+0000","last_undegraded":"2024-02-17T13:25:49.564016+0000","last_fullsized":"2024-02-17T13:25:49.564016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1339","reported_seq":1377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.528155+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T13:25:45.528155+0000","last_peered":"2024-02-17T13:25:45.528155+0000","last_clean":"2024-02-17T13:25:45.528155+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T13:25:45.528155+0000","last_undegraded":"2024-02-17T13:25:45.528155+0000","last_fullsized":"2024-02-17T13:25:45.528155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":1198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'135","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.343283+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T13:25:20.343283+0000","last_peered":"2024-02-17T13:25:20.343283+0000","last_clean":"2024-02-17T13:25:20.343283+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T13:25:20.343283+0000","last_undegraded":"2024-02-17T13:25:20.343283+0000","last_fullsized":"2024-02-17T13:25:20.343283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365217+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T13:25:49.365217+0000","last_peered":"2024-02-17T13:25:49.365217+0000","last_clean":"2024-02-17T13:25:49.365217+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T13:25:49.365217+0000","last_undegraded":"2024-02-17T13:25:49.365217+0000","last_fullsized":"2024-02-17T13:25:49.365217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.828180+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T13:25:38.828180+0000","last_peered":"2024-02-17T13:25:38.828180+0000","last_clean":"2024-02-17T13:25:38.828180+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T13:25:38.828180+0000","last_undegraded":"2024-02-17T13:25:38.828180+0000","last_fullsized":"2024-02-17T13:25:38.828180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:25.433933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"26'127","reported_seq":158,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.938919+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T13:25:18.938919+0000","last_peered":"2024-02-17T13:25:18.938919+0000","last_clean":"2024-02-17T13:25:18.938919+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T13:25:18.938919+0000","last_undegraded":"2024-02-17T13:25:18.938919+0000","last_fullsized":"2024-02-17T13:25:18.938919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.487042+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T13:25:49.487042+0000","last_peered":"2024-02-17T13:25:49.487042+0000","last_clean":"2024-02-17T13:25:49.487042+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T13:25:49.487042+0000","last_undegraded":"2024-02-17T13:25:49.487042+0000","last_fullsized":"2024-02-17T13:25:49.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:13.563296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'3","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.803465+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T13:25:38.803465+0000","last_peered":"2024-02-17T13:25:38.803465+0000","last_clean":"2024-02-17T13:25:38.803465+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T13:25:38.803465+0000","last_undegraded":"2024-02-17T13:25:38.803465+0000","last_fullsized":"2024-02-17T13:25:38.803465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"26'191","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.087918+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T13:25:19.087918+0000","last_peered":"2024-02-17T13:25:19.087918+0000","last_clean":"2024-02-17T13:25:19.087918+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T13:25:19.087918+0000","last_undegraded":"2024-02-17T13:25:19.087918+0000","last_fullsized":"2024-02-17T13:25:19.087918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489384+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T13:25:49.489384+0000","last_peered":"2024-02-17T13:25:49.489384+0000","last_clean":"2024-02-17T13:25:49.489384+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T13:25:49.489384+0000","last_undegraded":"2024-02-17T13:25:49.489384+0000","last_fullsized":"2024-02-17T13:25:49.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'11","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832523+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T13:25:39.832523+0000","last_peered":"2024-02-17T13:25:39.832523+0000","last_clean":"2024-02-17T13:25:39.832523+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T13:25:39.832523+0000","last_undegraded":"2024-02-17T13:25:39.832523+0000","last_fullsized":"2024-02-17T13:25:39.832523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:37.977758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'113","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.208163+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T13:25:19.208163+0000","last_peered":"2024-02-17T13:25:19.208163+0000","last_clean":"2024-02-17T13:25:19.208163+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T13:25:19.208163+0000","last_undegraded":"2024-02-17T13:25:19.208163+0000","last_fullsized":"2024-02-17T13:25:19.208163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"26'31","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.379514+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T13:25:49.379514+0000","last_peered":"2024-02-17T13:25:49.379514+0000","last_clean":"2024-02-17T13:25:49.379514+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T13:25:49.379514+0000","last_undegraded":"2024-02-17T13:25:49.379514+0000","last_fullsized":"2024-02-17T13:25:49.379514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'915","reported_seq":1858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:47.836576+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T13:25:47.836576+0000","last_peered":"2024-02-17T13:25:47.836576+0000","last_clean":"2024-02-17T13:25:47.836576+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T13:25:47.836576+0000","last_undegraded":"2024-02-17T13:25:47.836576+0000","last_fullsized":"2024-02-17T13:25:47.836576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210123,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":913,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'127","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.471424+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T13:25:19.471424+0000","last_peered":"2024-02-17T13:25:19.471424+0000","last_clean":"2024-02-17T13:25:19.471424+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T13:25:19.471424+0000","last_undegraded":"2024-02-17T13:25:19.471424+0000","last_fullsized":"2024-02-17T13:25:19.471424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"26'29","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365373+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T13:25:49.365373+0000","last_peered":"2024-02-17T13:25:49.365373+0000","last_clean":"2024-02-17T13:25:49.365373+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T13:25:49.365373+0000","last_undegraded":"2024-02-17T13:25:49.365373+0000","last_fullsized":"2024-02-17T13:25:49.365373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'489","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.777369+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T13:25:37.777369+0000","last_peered":"2024-02-17T13:25:37.777369+0000","last_clean":"2024-02-17T13:25:37.777369+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T13:25:37.777369+0000","last_undegraded":"2024-02-17T13:25:37.777369+0000","last_fullsized":"2024-02-17T13:25:37.777369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'120","reported_seq":150,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.298901+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T13:25:20.298901+0000","last_peered":"2024-02-17T13:25:20.298901+0000","last_clean":"2024-02-17T13:25:20.298901+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T13:25:20.298901+0000","last_undegraded":"2024-02-17T13:25:20.298901+0000","last_fullsized":"2024-02-17T13:25:20.298901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'33","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.497629+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T13:25:49.497629+0000","last_peered":"2024-02-17T13:25:49.497629+0000","last_clean":"2024-02-17T13:25:49.497629+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T13:25:49.497629+0000","last_undegraded":"2024-02-17T13:25:49.497629+0000","last_fullsized":"2024-02-17T13:25:49.497629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'8","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:25.324449+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T13:25:25.324449+0000","last_peered":"2024-02-17T13:25:25.324449+0000","last_clean":"2024-02-17T13:25:25.324449+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T13:25:25.324449+0000","last_undegraded":"2024-02-17T13:25:25.324449+0000","last_fullsized":"2024-02-17T13:25:25.324449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:34.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:23:47.670665+0000","last_change":"2024-02-17T12:57:44.603638+0000","last_active":"2024-02-17T13:23:47.670665+0000","last_peered":"2024-02-17T13:23:47.670665+0000","last_clean":"2024-02-17T13:23:47.670665+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T13:23:47.670665+0000","last_undegraded":"2024-02-17T13:23:47.670665+0000","last_fullsized":"2024-02-17T13:23:47.670665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:42.506542+0000","last_clean_scrub_stamp":"2024-02-17T12:57:42.506542+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:43:32.677762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"26'170","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.758963+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T13:25:18.758963+0000","last_peered":"2024-02-17T13:25:18.758963+0000","last_clean":"2024-02-17T13:25:18.758963+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T13:25:18.758963+0000","last_undegraded":"2024-02-17T13:25:18.758963+0000","last_fullsized":"2024-02-17T13:25:18.758963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:35.159199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":8669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463142+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T13:25:49.463142+0000","last_peered":"2024-02-17T13:25:49.463142+0000","last_clean":"2024-02-17T13:25:49.463142+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T13:25:49.463142+0000","last_undegraded":"2024-02-17T13:25:49.463142+0000","last_fullsized":"2024-02-17T13:25:49.463142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:16.491968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832570+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T13:25:39.832570+0000","last_peered":"2024-02-17T13:25:39.832570+0000","last_clean":"2024-02-17T13:25:39.832570+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T13:25:39.832570+0000","last_undegraded":"2024-02-17T13:25:39.832570+0000","last_fullsized":"2024-02-17T13:25:39.832570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'141","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.250071+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T13:25:20.250071+0000","last_peered":"2024-02-17T13:25:20.250071+0000","last_clean":"2024-02-17T13:25:20.250071+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T13:25:20.250071+0000","last_undegraded":"2024-02-17T13:25:20.250071+0000","last_fullsized":"2024-02-17T13:25:20.250071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'39","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484983+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T13:25:49.484983+0000","last_peered":"2024-02-17T13:25:49.484983+0000","last_clean":"2024-02-17T13:25:49.484983+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T13:25:49.484983+0000","last_undegraded":"2024-02-17T13:25:49.484983+0000","last_fullsized":"2024-02-17T13:25:49.484983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.826449+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T13:25:39.826449+0000","last_peered":"2024-02-17T13:25:39.826449+0000","last_clean":"2024-02-17T13:25:39.826449+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T13:25:39.826449+0000","last_undegraded":"2024-02-17T13:25:39.826449+0000","last_fullsized":"2024-02-17T13:25:39.826449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'175","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.735811+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T13:25:18.735811+0000","last_peered":"2024-02-17T13:25:18.735811+0000","last_clean":"2024-02-17T13:25:18.735811+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T13:25:18.735811+0000","last_undegraded":"2024-02-17T13:25:18.735811+0000","last_fullsized":"2024-02-17T13:25:18.735811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"26'35","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493605+0000","last_change":"2024-02-17T12:57:57.772842+0000","last_active":"2024-02-17T13:25:49.493605+0000","last_peered":"2024-02-17T13:25:49.493605+0000","last_clean":"2024-02-17T13:25:49.493605+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T13:25:49.493605+0000","last_undegraded":"2024-02-17T13:25:49.493605+0000","last_fullsized":"2024-02-17T13:25:49.493605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:56.868466+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T13:24:56.868466+0000","last_peered":"2024-02-17T13:24:56.868466+0000","last_clean":"2024-02-17T13:24:56.868466+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T13:24:56.868466+0000","last_undegraded":"2024-02-17T13:24:56.868466+0000","last_fullsized":"2024-02-17T13:24:56.868466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"26'122","reported_seq":152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.734689+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T13:25:18.734689+0000","last_peered":"2024-02-17T13:25:18.734689+0000","last_clean":"2024-02-17T13:25:18.734689+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T13:25:18.734689+0000","last_undegraded":"2024-02-17T13:25:18.734689+0000","last_fullsized":"2024-02-17T13:25:18.734689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:11.394613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'21","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.492241+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T13:25:49.492241+0000","last_peered":"2024-02-17T13:25:49.492241+0000","last_clean":"2024-02-17T13:25:49.492241+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T13:25:49.492241+0000","last_undegraded":"2024-02-17T13:25:49.492241+0000","last_fullsized":"2024-02-17T13:25:49.492241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.700211+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T13:25:36.700211+0000","last_peered":"2024-02-17T13:25:36.700211+0000","last_clean":"2024-02-17T13:25:36.700211+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T13:25:36.700211+0000","last_undegraded":"2024-02-17T13:25:36.700211+0000","last_fullsized":"2024-02-17T13:25:36.700211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:10:12.528245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"26'161","reported_seq":191,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.289519+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T13:25:20.289519+0000","last_peered":"2024-02-17T13:25:20.289519+0000","last_clean":"2024-02-17T13:25:20.289519+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T13:25:20.289519+0000","last_undegraded":"2024-02-17T13:25:20.289519+0000","last_fullsized":"2024-02-17T13:25:20.289519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.448139+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T13:25:49.448139+0000","last_peered":"2024-02-17T13:25:49.448139+0000","last_clean":"2024-02-17T13:25:49.448139+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T13:25:49.448139+0000","last_undegraded":"2024-02-17T13:25:49.448139+0000","last_fullsized":"2024-02-17T13:25:49.448139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:03.661288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'20","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.839150+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T13:25:42.839150+0000","last_peered":"2024-02-17T13:25:42.839150+0000","last_clean":"2024-02-17T13:25:42.839150+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T13:25:42.839150+0000","last_undegraded":"2024-02-17T13:25:42.839150+0000","last_fullsized":"2024-02-17T13:25:42.839150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"26'138","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.173860+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T13:25:19.173860+0000","last_peered":"2024-02-17T13:25:19.173860+0000","last_clean":"2024-02-17T13:25:19.173860+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T13:25:19.173860+0000","last_undegraded":"2024-02-17T13:25:19.173860+0000","last_fullsized":"2024-02-17T13:25:19.173860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'30","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.462936+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T13:25:49.462936+0000","last_peered":"2024-02-17T13:25:49.462936+0000","last_clean":"2024-02-17T13:25:49.462936+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T13:25:49.462936+0000","last_undegraded":"2024-02-17T13:25:49.462936+0000","last_fullsized":"2024-02-17T13:25:49.462936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.837114+0000","last_change":"2024-02-17T12:57:56.648213+0000","last_active":"2024-02-17T13:25:42.837114+0000","last_peered":"2024-02-17T13:25:42.837114+0000","last_clean":"2024-02-17T13:25:42.837114+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T13:25:42.837114+0000","last_undegraded":"2024-02-17T13:25:42.837114+0000","last_fullsized":"2024-02-17T13:25:42.837114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:15.566688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"26'136","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.534811+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T13:25:19.534811+0000","last_peered":"2024-02-17T13:25:19.534811+0000","last_clean":"2024-02-17T13:25:19.534811+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T13:25:19.534811+0000","last_undegraded":"2024-02-17T13:25:19.534811+0000","last_fullsized":"2024-02-17T13:25:19.534811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457593+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T13:25:49.457593+0000","last_peered":"2024-02-17T13:25:49.457593+0000","last_clean":"2024-02-17T13:25:49.457593+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T13:25:49.457593+0000","last_undegraded":"2024-02-17T13:25:49.457593+0000","last_fullsized":"2024-02-17T13:25:49.457593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:05.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'15","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838689+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T13:25:42.838689+0000","last_peered":"2024-02-17T13:25:42.838689+0000","last_clean":"2024-02-17T13:25:42.838689+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T13:25:42.838689+0000","last_undegraded":"2024-02-17T13:25:42.838689+0000","last_fullsized":"2024-02-17T13:25:42.838689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:02.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'115","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.504760+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T13:25:19.504760+0000","last_peered":"2024-02-17T13:25:19.504760+0000","last_clean":"2024-02-17T13:25:19.504760+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T13:25:19.504760+0000","last_undegraded":"2024-02-17T13:25:19.504760+0000","last_fullsized":"2024-02-17T13:25:19.504760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365988+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T13:25:49.365988+0000","last_peered":"2024-02-17T13:25:49.365988+0000","last_clean":"2024-02-17T13:25:49.365988+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T13:25:49.365988+0000","last_undegraded":"2024-02-17T13:25:49.365988+0000","last_fullsized":"2024-02-17T13:25:49.365988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'131","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.189245+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T13:25:49.189245+0000","last_peered":"2024-02-17T13:25:49.189245+0000","last_clean":"2024-02-17T13:25:49.189245+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T13:25:49.189245+0000","last_undegraded":"2024-02-17T13:25:49.189245+0000","last_fullsized":"2024-02-17T13:25:49.189245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110453,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'131","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.517917+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T13:25:19.517917+0000","last_peered":"2024-02-17T13:25:19.517917+0000","last_clean":"2024-02-17T13:25:19.517917+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T13:25:19.517917+0000","last_undegraded":"2024-02-17T13:25:19.517917+0000","last_fullsized":"2024-02-17T13:25:19.517917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:53.194550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'37","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.492996+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T13:25:49.492996+0000","last_peered":"2024-02-17T13:25:49.492996+0000","last_clean":"2024-02-17T13:25:49.492996+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T13:25:49.492996+0000","last_undegraded":"2024-02-17T13:25:49.492996+0000","last_fullsized":"2024-02-17T13:25:49.492996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'822","reported_seq":859,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.668393+0000","last_change":"2024-02-17T12:57:56.621083+0000","last_active":"2024-02-17T13:25:34.668393+0000","last_peered":"2024-02-17T13:25:34.668393+0000","last_clean":"2024-02-17T13:25:34.668393+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T13:25:34.668393+0000","last_undegraded":"2024-02-17T13:25:34.668393+0000","last_fullsized":"2024-02-17T13:25:34.668393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:06.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"26'125","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.074969+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T13:25:18.074969+0000","last_peered":"2024-02-17T13:25:18.074969+0000","last_clean":"2024-02-17T13:25:18.074969+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T13:25:18.074969+0000","last_undegraded":"2024-02-17T13:25:18.074969+0000","last_fullsized":"2024-02-17T13:25:18.074969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'32","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.456054+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T13:25:49.456054+0000","last_peered":"2024-02-17T13:25:49.456054+0000","last_clean":"2024-02-17T13:25:49.456054+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T13:25:49.456054+0000","last_undegraded":"2024-02-17T13:25:49.456054+0000","last_fullsized":"2024-02-17T13:25:49.456054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'655","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:43.826125+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T13:25:43.826125+0000","last_peered":"2024-02-17T13:25:43.826125+0000","last_clean":"2024-02-17T13:25:43.826125+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T13:25:43.826125+0000","last_undegraded":"2024-02-17T13:25:43.826125+0000","last_fullsized":"2024-02-17T13:25:43.826125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"26'151","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.524925+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T13:25:19.524925+0000","last_peered":"2024-02-17T13:25:19.524925+0000","last_clean":"2024-02-17T13:25:19.524925+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T13:25:19.524925+0000","last_undegraded":"2024-02-17T13:25:19.524925+0000","last_fullsized":"2024-02-17T13:25:19.524925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":23394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372478+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.372478+0000","last_peered":"2024-02-17T13:25:49.372478+0000","last_clean":"2024-02-17T13:25:49.372478+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T13:25:49.372478+0000","last_undegraded":"2024-02-17T13:25:49.372478+0000","last_fullsized":"2024-02-17T13:25:49.372478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:32.705035+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T13:24:32.705035+0000","last_peered":"2024-02-17T13:24:32.705035+0000","last_clean":"2024-02-17T13:24:32.705035+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T13:24:32.705035+0000","last_undegraded":"2024-02-17T13:24:32.705035+0000","last_fullsized":"2024-02-17T13:24:32.705035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:23.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'126","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.247930+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T13:25:20.247930+0000","last_peered":"2024-02-17T13:25:20.247930+0000","last_clean":"2024-02-17T13:25:20.247930+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T13:25:20.247930+0000","last_undegraded":"2024-02-17T13:25:20.247930+0000","last_fullsized":"2024-02-17T13:25:20.247930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":10959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'43","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.496309+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T13:25:49.496309+0000","last_peered":"2024-02-17T13:25:49.496309+0000","last_clean":"2024-02-17T13:25:49.496309+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T13:25:49.496309+0000","last_undegraded":"2024-02-17T13:25:49.496309+0000","last_fullsized":"2024-02-17T13:25:49.496309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'13","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.189468+0000","last_change":"2024-02-17T12:57:56.656560+0000","last_active":"2024-02-17T13:25:49.189468+0000","last_peered":"2024-02-17T13:25:49.189468+0000","last_clean":"2024-02-17T13:25:49.189468+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T13:25:49.189468+0000","last_undegraded":"2024-02-17T13:25:49.189468+0000","last_fullsized":"2024-02-17T13:25:49.189468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'167","reported_seq":196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.177328+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T13:25:21.177328+0000","last_peered":"2024-02-17T13:25:21.177328+0000","last_clean":"2024-02-17T13:25:21.177328+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T13:25:21.177328+0000","last_undegraded":"2024-02-17T13:25:21.177328+0000","last_fullsized":"2024-02-17T13:25:21.177328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"26'142","reported_seq":173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.459798+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T13:25:19.459798+0000","last_peered":"2024-02-17T13:25:19.459798+0000","last_clean":"2024-02-17T13:25:19.459798+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T13:25:19.459798+0000","last_undegraded":"2024-02-17T13:25:19.459798+0000","last_fullsized":"2024-02-17T13:25:19.459798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":9062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564794+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T13:25:49.564794+0000","last_peered":"2024-02-17T13:25:49.564794+0000","last_clean":"2024-02-17T13:25:49.564794+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T13:25:49.564794+0000","last_undegraded":"2024-02-17T13:25:49.564794+0000","last_fullsized":"2024-02-17T13:25:49.564794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.661702+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T13:25:34.661702+0000","last_peered":"2024-02-17T13:25:34.661702+0000","last_clean":"2024-02-17T13:25:34.661702+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T13:25:34.661702+0000","last_undegraded":"2024-02-17T13:25:34.661702+0000","last_fullsized":"2024-02-17T13:25:34.661702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.193065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.167721+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T13:25:21.167721+0000","last_peered":"2024-02-17T13:25:21.167721+0000","last_clean":"2024-02-17T13:25:21.167721+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T13:25:21.167721+0000","last_undegraded":"2024-02-17T13:25:21.167721+0000","last_fullsized":"2024-02-17T13:25:21.167721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:57:03.747503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":20244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.381918+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T13:25:49.381918+0000","last_peered":"2024-02-17T13:25:49.381918+0000","last_clean":"2024-02-17T13:25:49.381918+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T13:25:49.381918+0000","last_undegraded":"2024-02-17T13:25:49.381918+0000","last_fullsized":"2024-02-17T13:25:49.381918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'12","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.704801+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T13:25:36.704801+0000","last_peered":"2024-02-17T13:25:36.704801+0000","last_clean":"2024-02-17T13:25:36.704801+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T13:25:36.704801+0000","last_undegraded":"2024-02-17T13:25:36.704801+0000","last_fullsized":"2024-02-17T13:25:36.704801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'680","reported_seq":717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:32.633839+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T13:25:32.633839+0000","last_peered":"2024-02-17T13:25:32.633839+0000","last_clean":"2024-02-17T13:25:32.633839+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T13:25:32.633839+0000","last_undegraded":"2024-02-17T13:25:32.633839+0000","last_fullsized":"2024-02-17T13:25:32.633839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:25.039648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.529720+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T13:25:49.529720+0000","last_peered":"2024-02-17T13:25:49.529720+0000","last_clean":"2024-02-17T13:25:49.529720+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T13:25:49.529720+0000","last_undegraded":"2024-02-17T13:25:49.529720+0000","last_fullsized":"2024-02-17T13:25:49.529720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'95","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.545426+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T13:25:19.545426+0000","last_peered":"2024-02-17T13:25:19.545426+0000","last_clean":"2024-02-17T13:25:19.545426+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T13:25:19.545426+0000","last_undegraded":"2024-02-17T13:25:19.545426+0000","last_fullsized":"2024-02-17T13:25:19.545426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'659","reported_seq":696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.776248+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T13:25:37.776248+0000","last_peered":"2024-02-17T13:25:37.776248+0000","last_clean":"2024-02-17T13:25:37.776248+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T13:25:37.776248+0000","last_undegraded":"2024-02-17T13:25:37.776248+0000","last_fullsized":"2024-02-17T13:25:37.776248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463775+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T13:25:49.463775+0000","last_peered":"2024-02-17T13:25:49.463775+0000","last_clean":"2024-02-17T13:25:49.463775+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T13:25:49.463775+0000","last_undegraded":"2024-02-17T13:25:49.463775+0000","last_fullsized":"2024-02-17T13:25:49.463775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'162","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.268760+0000","last_change":"2024-02-17T12:58:37.887482+0000","last_active":"2024-02-17T13:25:20.268760+0000","last_peered":"2024-02-17T13:25:20.268760+0000","last_clean":"2024-02-17T13:25:20.268760+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T13:25:20.268760+0000","last_undegraded":"2024-02-17T13:25:20.268760+0000","last_fullsized":"2024-02-17T13:25:20.268760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:58.699256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493265+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T13:25:49.493265+0000","last_peered":"2024-02-17T13:25:49.493265+0000","last_clean":"2024-02-17T13:25:49.493265+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T13:25:49.493265+0000","last_undegraded":"2024-02-17T13:25:49.493265+0000","last_fullsized":"2024-02-17T13:25:49.493265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387808+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T13:25:49.387808+0000","last_peered":"2024-02-17T13:25:49.387808+0000","last_clean":"2024-02-17T13:25:49.387808+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T13:25:49.387808+0000","last_undegraded":"2024-02-17T13:25:49.387808+0000","last_fullsized":"2024-02-17T13:25:49.387808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"26'45","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.441835+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T13:25:49.441835+0000","last_peered":"2024-02-17T13:25:49.441835+0000","last_clean":"2024-02-17T13:25:49.441835+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T13:25:49.441835+0000","last_undegraded":"2024-02-17T13:25:49.441835+0000","last_fullsized":"2024-02-17T13:25:49.441835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:06.336962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.383488+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T13:25:49.383488+0000","last_peered":"2024-02-17T13:25:49.383488+0000","last_clean":"2024-02-17T13:25:49.383488+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T13:25:49.383488+0000","last_undegraded":"2024-02-17T13:25:49.383488+0000","last_fullsized":"2024-02-17T13:25:49.383488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"26'27","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.368239+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T13:25:49.368239+0000","last_peered":"2024-02-17T13:25:49.368239+0000","last_clean":"2024-02-17T13:25:49.368239+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T13:25:49.368239+0000","last_undegraded":"2024-02-17T13:25:49.368239+0000","last_fullsized":"2024-02-17T13:25:49.368239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367306+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T13:25:49.367306+0000","last_peered":"2024-02-17T13:25:49.367306+0000","last_clean":"2024-02-17T13:25:49.367306+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T13:25:49.367306+0000","last_undegraded":"2024-02-17T13:25:49.367306+0000","last_fullsized":"2024-02-17T13:25:49.367306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'43","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489937+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T13:25:49.489937+0000","last_peered":"2024-02-17T13:25:49.489937+0000","last_clean":"2024-02-17T13:25:49.489937+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T13:25:49.489937+0000","last_undegraded":"2024-02-17T13:25:49.489937+0000","last_fullsized":"2024-02-17T13:25:49.489937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"26'31","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.370293+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.370293+0000","last_peered":"2024-02-17T13:25:49.370293+0000","last_clean":"2024-02-17T13:25:49.370293+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T13:25:49.370293+0000","last_undegraded":"2024-02-17T13:25:49.370293+0000","last_fullsized":"2024-02-17T13:25:49.370293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449478+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T13:25:49.449478+0000","last_peered":"2024-02-17T13:25:49.449478+0000","last_clean":"2024-02-17T13:25:49.449478+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T13:25:49.449478+0000","last_undegraded":"2024-02-17T13:25:49.449478+0000","last_fullsized":"2024-02-17T13:25:49.449478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:41.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.377561+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T13:25:49.377561+0000","last_peered":"2024-02-17T13:25:49.377561+0000","last_clean":"2024-02-17T13:25:49.377561+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T13:25:49.377561+0000","last_undegraded":"2024-02-17T13:25:49.377561+0000","last_fullsized":"2024-02-17T13:25:49.377561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"26'38","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463712+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T13:25:49.463712+0000","last_peered":"2024-02-17T13:25:49.463712+0000","last_clean":"2024-02-17T13:25:49.463712+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T13:25:49.463712+0000","last_undegraded":"2024-02-17T13:25:49.463712+0000","last_fullsized":"2024-02-17T13:25:49.463712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.527824+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T13:25:49.527824+0000","last_peered":"2024-02-17T13:25:49.527824+0000","last_clean":"2024-02-17T13:25:49.527824+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T13:25:49.527824+0000","last_undegraded":"2024-02-17T13:25:49.527824+0000","last_fullsized":"2024-02-17T13:25:49.527824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'39","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387085+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T13:25:49.387085+0000","last_peered":"2024-02-17T13:25:49.387085+0000","last_clean":"2024-02-17T13:25:49.387085+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T13:25:49.387085+0000","last_undegraded":"2024-02-17T13:25:49.387085+0000","last_fullsized":"2024-02-17T13:25:49.387085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.446228+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T13:25:49.446228+0000","last_peered":"2024-02-17T13:25:49.446228+0000","last_clean":"2024-02-17T13:25:49.446228+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T13:25:49.446228+0000","last_undegraded":"2024-02-17T13:25:49.446228+0000","last_fullsized":"2024-02-17T13:25:49.446228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:53.898663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"26'47","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387119+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T13:25:49.387119+0000","last_peered":"2024-02-17T13:25:49.387119+0000","last_clean":"2024-02-17T13:25:49.387119+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T13:25:49.387119+0000","last_undegraded":"2024-02-17T13:25:49.387119+0000","last_fullsized":"2024-02-17T13:25:49.387119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457531+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T13:25:49.457531+0000","last_peered":"2024-02-17T13:25:49.457531+0000","last_clean":"2024-02-17T13:25:49.457531+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T13:25:49.457531+0000","last_undegraded":"2024-02-17T13:25:49.457531+0000","last_fullsized":"2024-02-17T13:25:49.457531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:40.958965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"26'42","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449553+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T13:25:49.449553+0000","last_peered":"2024-02-17T13:25:49.449553+0000","last_clean":"2024-02-17T13:25:49.449553+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T13:25:49.449553+0000","last_undegraded":"2024-02-17T13:25:49.449553+0000","last_fullsized":"2024-02-17T13:25:49.449553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.373687+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T13:25:49.373687+0000","last_peered":"2024-02-17T13:25:49.373687+0000","last_clean":"2024-02-17T13:25:49.373687+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T13:25:49.373687+0000","last_undegraded":"2024-02-17T13:25:49.373687+0000","last_fullsized":"2024-02-17T13:25:49.373687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367333+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T13:25:49.367333+0000","last_peered":"2024-02-17T13:25:49.367333+0000","last_clean":"2024-02-17T13:25:49.367333+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T13:25:49.367333+0000","last_undegraded":"2024-02-17T13:25:49.367333+0000","last_fullsized":"2024-02-17T13:25:49.367333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367607+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T13:25:49.367607+0000","last_peered":"2024-02-17T13:25:49.367607+0000","last_clean":"2024-02-17T13:25:49.367607+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T13:25:49.367607+0000","last_undegraded":"2024-02-17T13:25:49.367607+0000","last_fullsized":"2024-02-17T13:25:49.367607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494123+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T13:25:49.494123+0000","last_peered":"2024-02-17T13:25:49.494123+0000","last_clean":"2024-02-17T13:25:49.494123+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T13:25:49.494123+0000","last_undegraded":"2024-02-17T13:25:49.494123+0000","last_fullsized":"2024-02-17T13:25:49.494123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489516+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T13:25:49.489516+0000","last_peered":"2024-02-17T13:25:49.489516+0000","last_clean":"2024-02-17T13:25:49.489516+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T13:25:49.489516+0000","last_undegraded":"2024-02-17T13:25:49.489516+0000","last_fullsized":"2024-02-17T13:25:49.489516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.340542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"26'48","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494410+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T13:25:49.494410+0000","last_peered":"2024-02-17T13:25:49.494410+0000","last_clean":"2024-02-17T13:25:49.494410+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T13:25:49.494410+0000","last_undegraded":"2024-02-17T13:25:49.494410+0000","last_fullsized":"2024-02-17T13:25:49.494410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:44.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"26'38","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464326+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T13:25:49.464326+0000","last_peered":"2024-02-17T13:25:49.464326+0000","last_clean":"2024-02-17T13:25:49.464326+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T13:25:49.464326+0000","last_undegraded":"2024-02-17T13:25:49.464326+0000","last_fullsized":"2024-02-17T13:25:49.464326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382911+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T13:25:49.382911+0000","last_peered":"2024-02-17T13:25:49.382911+0000","last_clean":"2024-02-17T13:25:49.382911+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T13:25:49.382911+0000","last_undegraded":"2024-02-17T13:25:49.382911+0000","last_fullsized":"2024-02-17T13:25:49.382911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484270+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T13:25:49.484270+0000","last_peered":"2024-02-17T13:25:49.484270+0000","last_clean":"2024-02-17T13:25:49.484270+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T13:25:49.484270+0000","last_undegraded":"2024-02-17T13:25:49.484270+0000","last_fullsized":"2024-02-17T13:25:49.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"26'35","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.490441+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T13:25:49.490441+0000","last_peered":"2024-02-17T13:25:49.490441+0000","last_clean":"2024-02-17T13:25:49.490441+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T13:25:49.490441+0000","last_undegraded":"2024-02-17T13:25:49.490441+0000","last_fullsized":"2024-02-17T13:25:49.490441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.487475+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T13:25:49.487475+0000","last_peered":"2024-02-17T13:25:49.487475+0000","last_clean":"2024-02-17T13:25:49.487475+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T13:25:49.487475+0000","last_undegraded":"2024-02-17T13:25:49.487475+0000","last_fullsized":"2024-02-17T13:25:49.487475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'26","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489870+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T13:25:49.489870+0000","last_peered":"2024-02-17T13:25:49.489870+0000","last_clean":"2024-02-17T13:25:49.489870+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T13:25:49.489870+0000","last_undegraded":"2024-02-17T13:25:49.489870+0000","last_fullsized":"2024-02-17T13:25:49.489870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'41","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382700+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T13:25:49.382700+0000","last_peered":"2024-02-17T13:25:49.382700+0000","last_clean":"2024-02-17T13:25:49.382700+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T13:25:49.382700+0000","last_undegraded":"2024-02-17T13:25:49.382700+0000","last_fullsized":"2024-02-17T13:25:49.382700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372153+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T13:25:49.372153+0000","last_peered":"2024-02-17T13:25:49.372153+0000","last_clean":"2024-02-17T13:25:49.372153+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T13:25:49.372153+0000","last_undegraded":"2024-02-17T13:25:49.372153+0000","last_fullsized":"2024-02-17T13:25:49.372153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"26'26","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484733+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T13:25:49.484733+0000","last_peered":"2024-02-17T13:25:49.484733+0000","last_clean":"2024-02-17T13:25:49.484733+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T13:25:49.484733+0000","last_undegraded":"2024-02-17T13:25:49.484733+0000","last_fullsized":"2024-02-17T13:25:49.484733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3911,"num_write_kb":306687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4416,"ondisk_log_size":4416,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39077972,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":11090,"num_write_kb":44057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78405632,"data_stored":78155944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9139,"ondisk_log_size":9139,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575191,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63244,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308596,"statfs":{"total":96636764160,"available":96572002304,"internally_reserved":0,"allocated":5836800,"data_stored":5629759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":0.55900000000000005,"5min":0.65000000000000002,"15min":0.71199999999999997},"last":0.38},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.64400000000000002,"15min":0.749},"last":0.44600000000000001}]},{"osd":2,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.72999999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.623,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.52800000000000002,"5min":0.69599999999999995,"15min":0.73599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":0.63600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.79400000000000004},"last":0.32900000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76300000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.27000000000000002},"max":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.31},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81599999999999995,"5min":0.90200000000000002,"15min":0.92800000000000005},"last":0.42999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":4388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":4493312,"data_stored":4311853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28799999999999998,"15min":0.217},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.68300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65500000000000003,"5min":0.67800000000000005,"15min":0.75700000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.70899999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.80000000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.63200000000000001,"5min":0.71899999999999997,"15min":0.72099999999999997},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.49299999999999999,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.27400000000000002},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.81299999999999994},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.77300000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.86199999999999999,"15min":0.93400000000000005},"last":0.378},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.23599999999999999},"max":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.84199999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.878},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.80800000000000005,"15min":0.94899999999999995},"last":0.44700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575190,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70916,"kb_used_data":13372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300924,"statfs":{"total":96636764160,"available":96564146176,"internally_reserved":0,"allocated":13692928,"data_stored":13498704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57199999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.435},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.78100000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.751},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.28799999999999998},"max":{"1min":0.61799999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.40899999999999997,"5min":0.28999999999999998,"15min":0.28199999999999997},"max":{"1min":0.67200000000000004,"5min":0.73299999999999998,"15min":0.75600000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":4,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27300000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.79700000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.71199999999999997}]},{"osd":6,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.872},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575190,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53580,"kb_used_data":8516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318260,"statfs":{"total":96636764160,"available":96581898240,"internally_reserved":0,"allocated":8720384,"data_stored":8505123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.59099999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.69199999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57799999999999996,"5min":0.621,"15min":0.745},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.71899999999999997},"last":0.433}]},{"osd":2,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.77900000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29699999999999999},"max":{"1min":0.63700000000000001,"5min":0.68400000000000005,"15min":0.68500000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.82199999999999995},"last":0.498}]},{"osd":5,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44600000000000001,"15min":0.46999999999999997},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.318},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.47899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64200000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38400000000000001}]},{"osd":6,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46800000000000003,"15min":0.48799999999999999},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66300000000000003,"5min":0.76800000000000002,"15min":0.872},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.36599999999999999}]},{"osd":7,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575191,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78404,"kb_used_data":16700,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293436,"statfs":{"total":96636764160,"available":96556478464,"internally_reserved":0,"allocated":17100800,"data_stored":16894525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.29799999999999999,"15min":0.30199999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.47499999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"last":0.37},{"interface":"front","average":{"1min":0.318,"5min":0.309,"15min":0.311},"min":{"1min":0.223,"5min":0.223,"15min":0.21099999999999999},"max":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48799999999999999},"last":0.24199999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.19400000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.626,"5min":0.626,"15min":0.64600000000000002},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32100000000000001},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.79100000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.77000000000000002,"15min":0.77300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.75900000000000001,"15min":0.81899999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.85599999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.754,"15min":0.82499999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.79300000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.375},"max":{"1min":0.624,"5min":0.88,"15min":0.88},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8503353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.187,"15min":0.186},"max":{"1min":0.44700000000000001,"5min":0.59599999999999997,"15min":0.82899999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.19800000000000001},"max":{"1min":0.371,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.94299999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.33500000000000002,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.377,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.54100000000000004},"last":0.379},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":1.02},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.29199999999999998},"max":{"1min":0.63900000000000001,"5min":0.74199999999999999,"15min":1.577},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.78600000000000003,"15min":0.86399999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.62,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63400000000000001,"5min":0.77000000000000002,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.76900000000000002,"15min":1.177},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36699999999999999},"max":{"1min":0.64300000000000002,"5min":0.80200000000000005,"15min":0.82399999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834575190,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48560,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323280,"statfs":{"total":96636764160,"available":96587038720,"internally_reserved":0,"allocated":9281536,"data_stored":9094395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.69299999999999995},"last":0.252},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.40699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32100000000000001,"15min":0.311},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.504,"5min":0.622,"15min":0.622},"last":0.318},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.56599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.378,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.60799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.50900000000000001,"15min":0.81699999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.626},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.87,"15min":0.87},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.90700000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35699999999999998},"max":{"1min":0.63600000000000001,"5min":0.80800000000000005,"15min":0.81399999999999995},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66400000000000003,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71228,"kb_used_data":13684,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300612,"statfs":{"total":96636764160,"available":96563826688,"internally_reserved":0,"allocated":14012416,"data_stored":13811008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29299999999999998},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.52900000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.38900000000000001,"5min":0.55000000000000004,"15min":0.58399999999999996},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.45100000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.497,"5min":0.54600000000000004,"15min":0.624},"last":0.371}]},{"osd":3,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.42999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.252},"max":{"1min":0.53300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.73699999999999999,"15min":0.77100000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.78400000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.752},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.84699999999999998},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":0.71399999999999997,"15min":0.77200000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.61699999999999999,"5min":0.72499999999999998,"15min":0.78400000000000003},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":13697003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12820480,"data_stored":12794331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5515754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T13:25:57.356 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T13:25:57.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.490+0000 7f5230864640 1 Processor -- start 2024-02-17T13:25:57.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.490+0000 7f5230864640 1 -- start start 2024-02-17T13:25:57.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5230864640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c153f90 0x7f522c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5230864640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f522c15dd20 0x7f522c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5230864640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f522c06b420 0x7f522c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5230864640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c06c3b0 con 0x7f522c15dd20 2024-02-17T13:25:57.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5230864640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c15d280 con 0x7f522c06b420 2024-02-17T13:25:57.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5230864640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0cbc20 con 0x7f522c153f90 2024-02-17T13:25:57.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.491+0000 7f5229d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f522c15dd20 0x7f522c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.492+0000 7f522ad9d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f522c06b420 0x7f522c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.492+0000 7f522a59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c153f90 0x7f522c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.492+0000 7f5229d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f522c15dd20 0x7f522c0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40814/0 (socket says 172.21.15.136:40814) 2024-02-17T13:25:57.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.492+0000 7f5229d9b640 1 -- 172.21.15.136:0/2568400943 learned_addr learned my addr 172.21.15.136:0/2568400943 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:57.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.494+0000 7f5229d9b640 1 -- 172.21.15.136:0/2568400943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c153f90 msgr2=0x7f522c0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:57.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.494+0000 7f5229d9b640 1 --2- 172.21.15.136:0/2568400943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c153f90 0x7f522c0c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.494+0000 7f5229d9b640 1 -- 172.21.15.136:0/2568400943 >> v2:172.21.15.160:3300/0 conn(0x7f522c06b420 msgr2=0x7f522c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:57.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.494+0000 7f5229d9b640 1 --2- 172.21.15.136:0/2568400943 >> v2:172.21.15.160:3300/0 conn(0x7f522c06b420 0x7f522c0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.494+0000 7f5229d9b640 1 -- 172.21.15.136:0/2568400943 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c06bdf0 con 0x7f522c15dd20 2024-02-17T13:25:57.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.496+0000 7f5229d9b640 1 --2- 172.21.15.136:0/2568400943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c15dd20 0x7f522c0cb6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b2ee0 tx=0x7f522002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05681f19d82d5f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:57.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f522959a640 1 -- 172.21.15.136:0/2568400943 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220031870 con 0x7f522c15dd20 2024-02-17T13:25:57.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f522959a640 1 -- 172.21.15.136:0/2568400943 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52200319d0 con 0x7f522c15dd20 2024-02-17T13:25:57.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f522959a640 1 -- 172.21.15.136:0/2568400943 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220031d60 con 0x7f522c15dd20 2024-02-17T13:25:57.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 -- 172.21.15.136:0/2568400943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c15dd20 msgr2=0x7f522c0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:57.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 --2- 172.21.15.136:0/2568400943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c15dd20 0x7f522c0cb6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b2ee0 tx=0x7f522002b910 comp rx=0 tx=0).stop 2024-02-17T13:25:57.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 -- 172.21.15.136:0/2568400943 shutdown_connections 2024-02-17T13:25:57.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 --2- 172.21.15.136:0/2568400943 >> v2:172.21.15.160:3300/0 conn(0x7f522c06b420 0x7f522c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 --2- 172.21.15.136:0/2568400943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c15dd20 0x7f522c0cb6e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 --2- 172.21.15.136:0/2568400943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c153f90 0x7f522c0c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 -- 172.21.15.136:0/2568400943 >> 172.21.15.136:0/2568400943 conn(0x7f522c0723d0 msgr2=0x7f522c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:57.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 -- 172.21.15.136:0/2568400943 shutdown_connections 2024-02-17T13:25:57.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.500+0000 7f5230864640 1 -- 172.21.15.136:0/2568400943 wait complete. 2024-02-17T13:25:57.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.502+0000 7f5230864640 1 Processor -- start 2024-02-17T13:25:57.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.502+0000 7f5230864640 1 -- start start 2024-02-17T13:25:57.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.503+0000 7f5230864640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c06b420 0x7f522c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.503+0000 7f5230864640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f522c153f90 0x7f522c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.503+0000 7f5230864640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c15dd20 0x7f522c1f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.503+0000 7f5230864640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c157480 con 0x7f522c06b420 2024-02-17T13:25:57.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.503+0000 7f5230864640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c154580 con 0x7f522c153f90 2024-02-17T13:25:57.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.503+0000 7f5230864640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c158940 con 0x7f522c15dd20 2024-02-17T13:25:57.503 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.504+0000 7f522a59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c06b420 0x7f522c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.504+0000 7f522a59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c06b420 0x7f522c1529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40816/0 (socket says 172.21.15.136:40816) 2024-02-17T13:25:57.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.504+0000 7f522a59c640 1 -- 172.21.15.136:0/1658512178 learned_addr learned my addr 172.21.15.136:0/1658512178 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:57.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.504+0000 7f5229d9b640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f522c153f90 0x7f522c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.505+0000 7f522ad9d640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c15dd20 0x7f522c1f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.508+0000 7f5229d9b640 1 -- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c15dd20 msgr2=0x7f522c1f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:57.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.508+0000 7f5229d9b640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c15dd20 0x7f522c1f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.508+0000 7f5229d9b640 1 -- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c06b420 msgr2=0x7f522c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:57.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.508+0000 7f5229d9b640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c06b420 0x7f522c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:57.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.508+0000 7f5229d9b640 1 -- 172.21.15.136:0/1658512178 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200094d0 con 0x7f522c153f90 2024-02-17T13:25:57.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.511+0000 7f5229d9b640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f522c153f90 0x7f522c15a2b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f522c0ccf90 tx=0x7f52200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:57.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.513+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522003ac60 con 0x7f522c153f90 2024-02-17T13:25:57.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.514+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c156ff0 con 0x7f522c153f90 2024-02-17T13:25:57.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.514+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c1578a0 con 0x7f522c153f90 2024-02-17T13:25:57.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.514+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c157180 con 0x7f522c153f90 2024-02-17T13:25:57.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.515+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522003adc0 con 0x7f522c153f90 2024-02-17T13:25:57.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.515+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522004d5f0 con 0x7f522c153f90 2024-02-17T13:25:57.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.765+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f52200443f0 con 0x7f522c153f90 2024-02-17T13:25:57.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.765+0000 7f521affd640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f520c06b810 0x7f520c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:57.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.766+0000 7f522a59c640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f520c06b810 0x7f520c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:57.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.766+0000 7f522a59c640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f520c06b810 0x7f520c06dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f521c009a40 tx=0x7f521c00b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:57.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.769+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f522002d040 con 0x7f522c153f90 2024-02-17T13:25:57.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.780+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5220077850 con 0x7f522c153f90 2024-02-17T13:25:57.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:57.962+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f522c067e00 con 0x7f522c153f90 2024-02-17T13:25:58.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.077+0000 7f521affd640 1 -- 172.21.15.136:0/1658512178 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f5220035090 con 0x7f522c153f90 2024-02-17T13:25:58.077 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:25:58.077 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f520c06b810 msgr2=0x7f520c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f520c06b810 0x7f520c06dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f521c009a40 tx=0x7f521c00b040 comp rx=0 tx=0).stop 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f522c153f90 msgr2=0x7f522c15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f522c153f90 0x7f522c15a2b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f522c0ccf90 tx=0x7f52200046c0 comp rx=0 tx=0).stop 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 shutdown_connections 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f520c06b810 0x7f520c06dcd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f522c15dd20 0x7f522c1f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f522c153f90 0x7f522c15a2b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 --2- 172.21.15.136:0/1658512178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f522c06b420 0x7f522c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 >> 172.21.15.136:0/1658512178 conn(0x7f522c0723d0 msgr2=0x7f522c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 shutdown_connections 2024-02-17T13:25:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:58.079+0000 7f5230864640 1 -- 172.21.15.136:0/1658512178 wait complete. 2024-02-17T13:25:59.092 INFO:tasks.ceph:Scrubbing osd.0 2024-02-17T13:25:59.092 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:25:59.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.199+0000 7fedde86f640 1 Processor -- start 2024-02-17T13:25:59.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.199+0000 7fedde86f640 1 -- start start 2024-02-17T13:25:59.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedde86f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fedd8153df0 0x7fedd806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedde86f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd806c3e0 0x7fedd806c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedde86f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd815d090 con 0x7fedd80c7ce0 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedde86f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd806cd90 con 0x7fedd8153df0 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedde86f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8159ac0 con 0x7fedd806c3e0 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedd77fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fedd80c7ce0 0x7fedd815a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59758/0 (socket says 172.21.15.136:59758) 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7fedd77fe640 1 -- 172.21.15.136:0/3482480868 learned_addr learned my addr 172.21.15.136:0/3482480868 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.200+0000 7feddce0c640 1 --2- 172.21.15.136:0/3482480868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd806c3e0 0x7fedd806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.201+0000 7fedd7fff640 1 --2- 172.21.15.136:0/3482480868 >> v2:172.21.15.160:3300/0 conn(0x7fedd8153df0 0x7fedd806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.203+0000 7fedd6ffd640 1 -- 172.21.15.136:0/3482480868 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236467497 0 0) 0x7fedd815d090 con 0x7fedd80c7ce0 2024-02-17T13:25:59.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.203+0000 7fedd6ffd640 1 -- 172.21.15.136:0/3482480868 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc0003520 con 0x7fedd80c7ce0 2024-02-17T13:25:59.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.203+0000 7feddce0c640 1 -- 172.21.15.136:0/3482480868 >> v2:172.21.15.160:3300/0 conn(0x7fedd8153df0 msgr2=0x7fedd806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:59.203 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.203+0000 7feddce0c640 1 --2- 172.21.15.136:0/3482480868 >> v2:172.21.15.160:3300/0 conn(0x7fedd8153df0 0x7fedd806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.203 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.203+0000 7feddce0c640 1 -- 172.21.15.136:0/3482480868 >> v1:172.21.15.136:6789/0 conn(0x7fedd80c7ce0 legacy=0x7fedd815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.203 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.203+0000 7feddce0c640 1 -- 172.21.15.136:0/3482480868 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8159d60 con 0x7fedd806c3e0 2024-02-17T13:25:59.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.205+0000 7feddce0c640 1 --2- 172.21.15.136:0/3482480868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd806c3e0 0x7fedd806c850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009d90 tx=0x7fedd002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5b5211ab66058e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.208+0000 7fedd6ffd640 1 -- 172.21.15.136:0/3482480868 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd002cce0 con 0x7fedd806c3e0 2024-02-17T13:25:59.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedd6ffd640 1 -- 172.21.15.136:0/3482480868 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd002ce40 con 0x7fedd806c3e0 2024-02-17T13:25:59.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedd6ffd640 1 -- 172.21.15.136:0/3482480868 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0034660 con 0x7fedd806c3e0 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 -- 172.21.15.136:0/3482480868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd806c3e0 msgr2=0x7fedd806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 --2- 172.21.15.136:0/3482480868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd806c3e0 0x7fedd806c850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009d90 tx=0x7fedd002bf30 comp rx=0 tx=0).stop 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 -- 172.21.15.136:0/3482480868 shutdown_connections 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 --2- 172.21.15.136:0/3482480868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd806c3e0 0x7fedd806c850 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 --2- 172.21.15.136:0/3482480868 >> v2:172.21.15.160:3300/0 conn(0x7fedd8153df0 0x7fedd806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 -- 172.21.15.136:0/3482480868 >> 172.21.15.136:0/3482480868 conn(0x7fedd806e900 msgr2=0x7fedd806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 -- 172.21.15.136:0/3482480868 shutdown_connections 2024-02-17T13:25:59.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.209+0000 7fedde86f640 1 -- 172.21.15.136:0/3482480868 wait complete. 2024-02-17T13:25:59.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.210+0000 7fedde86f640 1 Processor -- start 2024-02-17T13:25:59.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 -- start start 2024-02-17T13:25:59.211 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedd806c3e0 0x7fedd80cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedd80c7ce0 0x7fedd81ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd8153df0 0x7fedd80cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81eed10 con 0x7fedd80c7ce0 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80cc8d0 con 0x7fedd806c3e0 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.211+0000 7fedde86f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81ef290 con 0x7fedd8153df0 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.212+0000 7fedd77fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedd80c7ce0 0x7fedd81ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.212+0000 7feddce0c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd8153df0 0x7fedd80cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.212+0000 7fedd7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedd806c3e0 0x7fedd80cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.212+0000 7fedd77fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedd80c7ce0 0x7fedd81ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40830/0 (socket says 172.21.15.136:40830) 2024-02-17T13:25:59.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.212+0000 7fedd77fe640 1 -- 172.21.15.136:0/506623856 learned_addr learned my addr 172.21.15.136:0/506623856 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:59.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.215+0000 7fedd77fe640 1 -- 172.21.15.136:0/506623856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd8153df0 msgr2=0x7fedd80cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.215+0000 7fedd77fe640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedd8153df0 0x7fedd80cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.215+0000 7fedd77fe640 1 -- 172.21.15.136:0/506623856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedd806c3e0 msgr2=0x7fedd80cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.215+0000 7fedd77fe640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedd806c3e0 0x7fedd80cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.215+0000 7fedd77fe640 1 -- 172.21.15.136:0/506623856 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0009a70 con 0x7fedd80c7ce0 2024-02-17T13:25:59.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.218+0000 7fedd77fe640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedd80c7ce0 0x7fedd81ef720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0010e0 tx=0x7fedcc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.221+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc005ce0 con 0x7fedd80c7ce0 2024-02-17T13:25:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.221+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc005e60 con 0x7fedd80c7ce0 2024-02-17T13:25:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.221+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd81efc60 con 0x7fedd80c7ce0 2024-02-17T13:25:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.221+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0072b0 con 0x7fedd80c7ce0 2024-02-17T13:25:59.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.221+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd80cb680 con 0x7fedd80c7ce0 2024-02-17T13:25:59.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.222+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fedd80c9410 con 0x7fedd80c7ce0 2024-02-17T13:25:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.241+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fedcc007410 con 0x7fedd80c7ce0 2024-02-17T13:25:59.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.241+0000 7fedd4ff9640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fedc406b890 0x7fedc406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.241+0000 7fedd7fff640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fedc406b890 0x7fedc406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.242+0000 7fedd7fff640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fedc406b890 0x7fedc406dd50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009aa0 tx=0x7fedc8009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.244+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fedcc058680 con 0x7fedd80c7ce0 2024-02-17T13:25:59.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.245+0000 7fedd4ff9640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fedc40750b0 0x7fedc4077550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.245+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 --> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedc4077c20 con 0x7fedc40750b0 2024-02-17T13:25:59.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.245+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedcc054920 con 0x7fedd80c7ce0 2024-02-17T13:25:59.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.245+0000 7feddce0c640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fedc40750b0 0x7fedc4077550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.245+0000 7feddce0c640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fedc40750b0 0x7fedc4077550 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.246+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== osd.0 v2:172.21.15.136:6816/3029567503 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fedc4077c20 con 0x7fedc40750b0 2024-02-17T13:25:59.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 --> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fedd806c110 con 0x7fedc40750b0 2024-02-17T13:25:59.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedd4ff9640 1 -- 172.21.15.136:0/506623856 <== osd.0 v2:172.21.15.136:6816/3029567503 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fedd0034440 con 0x7fedc40750b0 2024-02-17T13:25:59.259 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:25:59.259 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:25:59.259 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fedc40750b0 msgr2=0x7fedc4077550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6816/3029567503,v1:172.21.15.136:6817/3029567503] conn(0x7fedc40750b0 0x7fedc4077550 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fedc406b890 msgr2=0x7fedc406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fedc406b890 0x7fedc406dd50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009aa0 tx=0x7fedc8009190 comp rx=0 tx=0).stop 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedd80c7ce0 msgr2=0x7fedd81ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 --2- 172.21.15.136:0/506623856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fedd80c7ce0 0x7fedd81ef720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0010e0 tx=0x7fedcc00c960 comp rx=0 tx=0).stop 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7feddce0c640 1 -- 172.21.15.136:0/506623856 reap_dead start 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 shutdown_connections 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 >> 172.21.15.136:0/506623856 conn(0x7fedd806e900 msgr2=0x7fedd8158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:59.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 shutdown_connections 2024-02-17T13:25:59.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.259+0000 7fedde86f640 1 -- 172.21.15.136:0/506623856 wait complete. 2024-02-17T13:25:59.270 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-17T13:25:59.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.371+0000 7fcc6ce40640 1 Processor -- start 2024-02-17T13:25:59.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.371+0000 7fcc6ce40640 1 -- start start 2024-02-17T13:25:59.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.372+0000 7fcc6ce40640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcc6806cad0 0x7fcc68156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.372+0000 7fcc6ce40640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc680c5fa0 con 0x7fcc6814fca0 2024-02-17T13:25:59.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.372+0000 7fcc6ce40640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc68156fb0 con 0x7fcc680c7670 2024-02-17T13:25:59.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.372+0000 7fcc6ce40640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc681507e0 con 0x7fcc6806cad0 2024-02-17T13:25:59.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.373+0000 7fcc66d9d640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fcc6814fca0 0x7fcc681500d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59774/0 (socket says 172.21.15.136:59774) 2024-02-17T13:25:59.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.373+0000 7fcc66d9d640 1 -- 172.21.15.136:0/1130780156 learned_addr learned my addr 172.21.15.136:0/1130780156 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:25:59.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.373+0000 7fcc6659c640 1 --2- 172.21.15.136:0/1130780156 >> v2:172.21.15.160:3300/0 conn(0x7fcc6806cad0 0x7fcc68156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.375+0000 7fcc65d9b640 1 -- 172.21.15.136:0/1130780156 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447791159 0 0) 0x7fcc680c5fa0 con 0x7fcc6814fca0 2024-02-17T13:25:59.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.375+0000 7fcc65d9b640 1 -- 172.21.15.136:0/1130780156 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc54005730 con 0x7fcc6814fca0 2024-02-17T13:25:59.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.377+0000 7fcc6659c640 1 -- 172.21.15.136:0/1130780156 >> v1:172.21.15.160:6789/0 conn(0x7fcc680c7670 legacy=0x7fcc6806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.377+0000 7fcc6659c640 1 -- 172.21.15.136:0/1130780156 >> v1:172.21.15.136:6789/0 conn(0x7fcc6814fca0 legacy=0x7fcc681500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.377+0000 7fcc6659c640 1 -- 172.21.15.136:0/1130780156 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6806d5c0 con 0x7fcc6806cad0 2024-02-17T13:25:59.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.380+0000 7fcc6659c640 1 --2- 172.21.15.136:0/1130780156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6806cad0 0x7fcc68156a70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc580097a0 tx=0x7fcc5802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39348c02ecd6bfd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc65d9b640 1 -- 172.21.15.136:0/1130780156 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5802f810 con 0x7fcc6806cad0 2024-02-17T13:25:59.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc65d9b640 1 -- 172.21.15.136:0/1130780156 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5802f970 con 0x7fcc6806cad0 2024-02-17T13:25:59.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc65d9b640 1 -- 172.21.15.136:0/1130780156 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5802fd00 con 0x7fcc6806cad0 2024-02-17T13:25:59.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 -- 172.21.15.136:0/1130780156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6806cad0 msgr2=0x7fcc68156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/1130780156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6806cad0 0x7fcc68156a70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc580097a0 tx=0x7fcc5802b9f0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 -- 172.21.15.136:0/1130780156 shutdown_connections 2024-02-17T13:25:59.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/1130780156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6806cad0 0x7fcc68156a70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 -- 172.21.15.136:0/1130780156 >> 172.21.15.136:0/1130780156 conn(0x7fcc680c7e90 msgr2=0x7fcc680c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:59.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 -- 172.21.15.136:0/1130780156 shutdown_connections 2024-02-17T13:25:59.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.384+0000 7fcc6ce40640 1 -- 172.21.15.136:0/1130780156 wait complete. 2024-02-17T13:25:59.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 Processor -- start 2024-02-17T13:25:59.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 -- start start 2024-02-17T13:25:59.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc6806cad0 0x7fcc680c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 0x7fcc68150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6814fca0 0x7fcc6814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68152370 con 0x7fcc680c7670 2024-02-17T13:25:59.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68149770 con 0x7fcc6814fca0 2024-02-17T13:25:59.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.386+0000 7fcc6ce40640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680c98e0 con 0x7fcc6806cad0 2024-02-17T13:25:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.387+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 0x7fcc68150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.387+0000 7fcc66d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6814fca0 0x7fcc6814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.387+0000 7fcc6659c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc6806cad0 0x7fcc680c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.387+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 0x7fcc68150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40836/0 (socket says 172.21.15.136:40836) 2024-02-17T13:25:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.387+0000 7fcc5ffff640 1 -- 172.21.15.136:0/3853597982 learned_addr learned my addr 172.21.15.136:0/3853597982 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:59.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.390+0000 7fcc5ffff640 1 -- 172.21.15.136:0/3853597982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc6806cad0 msgr2=0x7fcc680c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.390+0000 7fcc5ffff640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc6806cad0 0x7fcc680c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.390+0000 7fcc5ffff640 1 -- 172.21.15.136:0/3853597982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6814fca0 msgr2=0x7fcc6814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.390+0000 7fcc5ffff640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6814fca0 0x7fcc6814a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.390+0000 7fcc5ffff640 1 -- 172.21.15.136:0/3853597982 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc58009400 con 0x7fcc680c7670 2024-02-17T13:25:59.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.393+0000 7fcc5ffff640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 0x7fcc68150b50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c480 tx=0x7fcc5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.396+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500052d0 con 0x7fcc680c7670 2024-02-17T13:25:59.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.396+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50005430 con 0x7fcc680c7670 2024-02-17T13:25:59.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.396+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50012870 con 0x7fcc680c7670 2024-02-17T13:25:59.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.396+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc681538e0 con 0x7fcc680c7670 2024-02-17T13:25:59.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.396+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6814ace0 con 0x7fcc680c7670 2024-02-17T13:25:59.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.397+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc68069b00 con 0x7fcc680c7670 2024-02-17T13:25:59.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.642+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcc500129d0 con 0x7fcc680c7670 2024-02-17T13:25:59.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.643+0000 7fcc5effd640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcc4806b810 0x7fcc4806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.643+0000 7fcc6659c640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcc4806b810 0x7fcc4806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.643+0000 7fcc6659c640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcc4806b810 0x7fcc4806dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc58036000 tx=0x7fcc58008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.656+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fcc50058fa0 con 0x7fcc680c7670 2024-02-17T13:25:59.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.656+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc50055240 con 0x7fcc680c7670 2024-02-17T13:25:59.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.830+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc680c6490 con 0x7fcc4806b810 2024-02-17T13:25:59.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.831+0000 7fcc5effd640 1 -- 172.21.15.136:0/3853597982 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcc5802fae0 con 0x7fcc4806b810 2024-02-17T13:25:59.830 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 0 to deep-scrub 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcc4806b810 msgr2=0x7fcc4806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcc4806b810 0x7fcc4806dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc58036000 tx=0x7fcc58008030 comp rx=0 tx=0).stop 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 msgr2=0x7fcc68150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 0x7fcc68150b50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c480 tx=0x7fcc5000c940 comp rx=0 tx=0).stop 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 shutdown_connections 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcc4806b810 0x7fcc4806dcd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc6814fca0 0x7fcc6814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc680c7670 0x7fcc68150b50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 --2- 172.21.15.136:0/3853597982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc6806cad0 0x7fcc680c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 >> 172.21.15.136:0/3853597982 conn(0x7fcc680c7e90 msgr2=0x7fcc680707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 shutdown_connections 2024-02-17T13:25:59.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.833+0000 7fcc6ce40640 1 -- 172.21.15.136:0/3853597982 wait complete. 2024-02-17T13:25:59.844 INFO:tasks.ceph:Scrubbing osd.1 2024-02-17T13:25:59.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:25:59.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.949+0000 7f3efd288640 1 Processor -- start 2024-02-17T13:25:59.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.949+0000 7f3efd288640 1 -- start start 2024-02-17T13:25:59.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.950+0000 7f3efd288640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3ef8151cf0 0x7f3ef81584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.950+0000 7f3efd288640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 0x7f3ef80c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.950+0000 7f3efd288640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8157a30 con 0x7f3ef80c5de0 2024-02-17T13:25:59.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.950+0000 7f3efd288640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef8158a30 con 0x7f3ef8151cf0 2024-02-17T13:25:59.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.950+0000 7f3efd288640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80c82e0 con 0x7f3ef815b000 2024-02-17T13:25:59.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.951+0000 7f3ef6ffd640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3ef8151cf0 0x7f3ef81584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.951+0000 7f3ef67fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 0x7f3ef80c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.951+0000 7f3ef67fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 0x7f3ef80c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60622/0 (socket says 172.21.15.136:60622) 2024-02-17T13:25:59.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.951+0000 7f3ef67fc640 1 -- 172.21.15.136:0/1425405273 learned_addr learned my addr 172.21.15.136:0/1425405273 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:59.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.954+0000 7f3ef67fc640 1 -- 172.21.15.136:0/1425405273 >> v2:172.21.15.160:3300/0 conn(0x7f3ef8151cf0 msgr2=0x7f3ef81584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:25:59.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.954+0000 7f3ef67fc640 1 --2- 172.21.15.136:0/1425405273 >> v2:172.21.15.160:3300/0 conn(0x7f3ef8151cf0 0x7f3ef81584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.954+0000 7f3ef67fc640 1 -- 172.21.15.136:0/1425405273 >> v1:172.21.15.160:6789/0 conn(0x7f3ef80c5de0 legacy=0x7f3ef806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.954+0000 7f3ef67fc640 1 -- 172.21.15.136:0/1425405273 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80c85c0 con 0x7f3ef815b000 2024-02-17T13:25:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.956+0000 7f3ef67fc640 1 --2- 172.21.15.136:0/1425405273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 0x7f3ef80c58a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c170a86495608 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3ef5ffb640 1 -- 172.21.15.136:0/1425405273 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec02f840 con 0x7f3ef815b000 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3ef5ffb640 1 -- 172.21.15.136:0/1425405273 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec02f9a0 con 0x7f3ef815b000 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3ef5ffb640 1 -- 172.21.15.136:0/1425405273 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec02fd30 con 0x7f3ef815b000 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 -- 172.21.15.136:0/1425405273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 msgr2=0x7f3ef80c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 --2- 172.21.15.136:0/1425405273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 0x7f3ef80c58a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec02ba20 comp rx=0 tx=0).stop 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 -- 172.21.15.136:0/1425405273 shutdown_connections 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 --2- 172.21.15.136:0/1425405273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef815b000 0x7f3ef80c58a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 --2- 172.21.15.136:0/1425405273 >> v2:172.21.15.160:3300/0 conn(0x7f3ef8151cf0 0x7f3ef81584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 -- 172.21.15.136:0/1425405273 >> 172.21.15.136:0/1425405273 conn(0x7f3ef8071960 msgr2=0x7f3ef8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:25:59.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 -- 172.21.15.136:0/1425405273 shutdown_connections 2024-02-17T13:25:59.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.961+0000 7f3efd288640 1 -- 172.21.15.136:0/1425405273 wait complete. 2024-02-17T13:25:59.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 Processor -- start 2024-02-17T13:25:59.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 -- start start 2024-02-17T13:25:59.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ef80c5de0 0x7f3ef814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef8151cf0 0x7f3ef8146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ef815b000 0x7f3ef8147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef81ee570 con 0x7f3ef80c5de0 2024-02-17T13:25:59.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef81ed710 con 0x7f3ef815b000 2024-02-17T13:25:59.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.963+0000 7f3efd288640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef81ed9f0 con 0x7f3ef8151cf0 2024-02-17T13:25:59.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.964+0000 7f3ef6ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ef80c5de0 0x7f3ef814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.964+0000 7f3ef67fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef8151cf0 0x7f3ef8146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.964+0000 7f3ef77fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ef815b000 0x7f3ef8147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.964+0000 7f3ef67fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef8151cf0 0x7f3ef8146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60626/0 (socket says 172.21.15.136:60626) 2024-02-17T13:25:59.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.964+0000 7f3ef67fc640 1 -- 172.21.15.136:0/3834627737 learned_addr learned my addr 172.21.15.136:0/3834627737 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:25:59.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.968+0000 7f3ef6ffd640 1 -- 172.21.15.136:0/3834627737 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef8151cf0 msgr2=0x7f3ef8146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.968+0000 7f3ef6ffd640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ef8151cf0 0x7f3ef8146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.968+0000 7f3ef6ffd640 1 -- 172.21.15.136:0/3834627737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ef815b000 msgr2=0x7f3ef8147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:25:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.968+0000 7f3ef6ffd640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ef815b000 0x7f3ef8147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:25:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.968+0000 7f3ef6ffd640 1 -- 172.21.15.136:0/3834627737 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0094d0 con 0x7f3ef80c5de0 2024-02-17T13:25:59.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.970+0000 7f3ef6ffd640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ef80c5de0 0x7f3ef814c450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800efc0 tx=0x7f3ee800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.974+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8014480 con 0x7f3ef80c5de0 2024-02-17T13:25:59.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.974+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800f040 con 0x7f3ef80c5de0 2024-02-17T13:25:59.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.974+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef81edcd0 con 0x7f3ef80c5de0 2024-02-17T13:25:59.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.974+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8014800 con 0x7f3ef80c5de0 2024-02-17T13:25:59.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.974+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef81ee290 con 0x7f3ef80c5de0 2024-02-17T13:25:59.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.975+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ef806be10 con 0x7f3ef80c5de0 2024-02-17T13:25:59.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.993+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3ee8014960 con 0x7f3ef80c5de0 2024-02-17T13:25:59.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.994+0000 7f3edf7fe640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3ee406b840 0x7f3ee406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.994+0000 7f3ef67fc640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3ee406b840 0x7f3ee406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.994+0000 7f3ef67fc640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3ee406b840 0x7f3ee406dd00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3eec02ba60 tx=0x7f3eec008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.996+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f3ee805a130 con 0x7f3ef80c5de0 2024-02-17T13:25:59.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.996+0000 7f3edf7fe640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7f3ee4074f60 0x7f3ee4077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:25:59.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.996+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 --> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ee4077ad0 con 0x7f3ee4074f60 2024-02-17T13:25:59.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.996+0000 7f3ef77fe640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7f3ee4074f60 0x7f3ee4077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:25:59.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.996+0000 7f3ef77fe640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7f3ee4074f60 0x7f3ee4077400 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:25:59.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.997+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ee80563d0 con 0x7f3ef80c5de0 2024-02-17T13:25:59.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:25:59.997+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== osd.1 v2:172.21.15.136:6800/2661143693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3ee4077ad0 con 0x7f3ee4074f60 2024-02-17T13:26:00.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.010+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 --> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3ef8157fd0 con 0x7f3ee4074f60 2024-02-17T13:26:00.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.010+0000 7f3edf7fe640 1 -- 172.21.15.136:0/3834627737 <== osd.1 v2:172.21.15.136:6800/2661143693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3ef0001830 con 0x7f3ee4074f60 2024-02-17T13:26:00.010 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:00.010 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:00.010 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:00.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7f3ee4074f60 msgr2=0x7f3ee4077400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6800/2661143693,v1:172.21.15.136:6801/2661143693] conn(0x7f3ee4074f60 0x7f3ee4077400 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3ee406b840 msgr2=0x7f3ee406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f3ee406b840 0x7f3ee406dd00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3eec02ba60 tx=0x7f3eec008030 comp rx=0 tx=0).stop 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ef80c5de0 msgr2=0x7f3ef814c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 --2- 172.21.15.136:0/3834627737 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ef80c5de0 0x7f3ef814c450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800efc0 tx=0x7f3ee800c490 comp rx=0 tx=0).stop 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3ef77fe640 1 -- 172.21.15.136:0/3834627737 reap_dead start 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 shutdown_connections 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 >> 172.21.15.136:0/3834627737 conn(0x7f3ef8071960 msgr2=0x7f3ef8157270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 shutdown_connections 2024-02-17T13:26:00.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.011+0000 7f3efd288640 1 -- 172.21.15.136:0/3834627737 wait complete. 2024-02-17T13:26:00.021 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-17T13:26:00.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.124+0000 7f22c96d4640 1 Processor -- start 2024-02-17T13:26:00.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.124+0000 7f22c96d4640 1 -- start start 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22c96d4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f22c40ca4e0 0x7f22c40cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22c96d4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c406b3e0 con 0x7f22c40cc520 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22c96d4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c40cb470 con 0x7f22c40cbc00 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22c96d4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40cc940 con 0x7f22c40ca4e0 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22c37fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f22c40cc520 0x7f22c41644e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59790/0 (socket says 172.21.15.136:59790) 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22c37fe640 1 -- 172.21.15.136:0/46324577 learned_addr learned my addr 172.21.15.136:0/46324577 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:00.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.125+0000 7f22bbfff640 1 --2- 172.21.15.136:0/46324577 >> v2:172.21.15.160:3300/0 conn(0x7f22c40ca4e0 0x7f22c40cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.128+0000 7f22c27fc640 1 -- 172.21.15.136:0/46324577 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054806404 0 0) 0x7f22c406b3e0 con 0x7f22c40cc520 2024-02-17T13:26:00.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.128+0000 7f22c27fc640 1 -- 172.21.15.136:0/46324577 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b0003520 con 0x7f22c40cc520 2024-02-17T13:26:00.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.129+0000 7f22bbfff640 1 -- 172.21.15.136:0/46324577 >> v1:172.21.15.160:6789/0 conn(0x7f22c40cbc00 legacy=0x7f22c406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:00.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.129+0000 7f22bbfff640 1 -- 172.21.15.136:0/46324577 >> v1:172.21.15.136:6789/0 conn(0x7f22c40cc520 legacy=0x7f22c41644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.129+0000 7f22bbfff640 1 -- 172.21.15.136:0/46324577 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c40cb750 con 0x7f22c40ca4e0 2024-02-17T13:26:00.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.133+0000 7f22bbfff640 1 --2- 172.21.15.136:0/46324577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40ca4e0 0x7f22c40cbfe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009790 tx=0x7f22ac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a73babc9e04b93 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.137+0000 7f22c27fc640 1 -- 172.21.15.136:0/46324577 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac031830 con 0x7f22c40ca4e0 2024-02-17T13:26:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.137+0000 7f22c27fc640 1 -- 172.21.15.136:0/46324577 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac031990 con 0x7f22c40ca4e0 2024-02-17T13:26:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.137+0000 7f22c27fc640 1 -- 172.21.15.136:0/46324577 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac031d20 con 0x7f22c40ca4e0 2024-02-17T13:26:00.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.137+0000 7f22c96d4640 1 -- 172.21.15.136:0/46324577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40ca4e0 msgr2=0x7f22c40cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.137+0000 7f22c96d4640 1 --2- 172.21.15.136:0/46324577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40ca4e0 0x7f22c40cbfe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009790 tx=0x7f22ac02b8d0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.138+0000 7f22c96d4640 1 -- 172.21.15.136:0/46324577 shutdown_connections 2024-02-17T13:26:00.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.138+0000 7f22c96d4640 1 --2- 172.21.15.136:0/46324577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40ca4e0 0x7f22c40cbfe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.138+0000 7f22c96d4640 1 -- 172.21.15.136:0/46324577 >> 172.21.15.136:0/46324577 conn(0x7f22c40721f0 msgr2=0x7f22c40725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:00.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.138+0000 7f22c96d4640 1 -- 172.21.15.136:0/46324577 shutdown_connections 2024-02-17T13:26:00.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.138+0000 7f22c96d4640 1 -- 172.21.15.136:0/46324577 wait complete. 2024-02-17T13:26:00.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.139+0000 7f22c96d4640 1 Processor -- start 2024-02-17T13:26:00.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.139+0000 7f22c96d4640 1 -- start start 2024-02-17T13:26:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.139+0000 7f22c96d4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 0x7f22c415c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c96d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40cbc00 0x7f22c4154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c96d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22c40cc520 0x7f22c4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c96d4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4154450 con 0x7f22c40ca4e0 2024-02-17T13:26:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c96d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41552f0 con 0x7f22c40cbc00 2024-02-17T13:26:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c96d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41570b0 con 0x7f22c40cc520 2024-02-17T13:26:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 0x7f22c415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40cbc00 0x7f22c4154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 0x7f22c415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40842/0 (socket says 172.21.15.136:40842) 2024-02-17T13:26:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c2ffd640 1 -- 172.21.15.136:0/373722938 learned_addr learned my addr 172.21.15.136:0/373722938 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:00.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.140+0000 7f22c37fe640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22c40cc520 0x7f22c4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.143+0000 7f22c2ffd640 1 -- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22c40cc520 msgr2=0x7f22c4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.143+0000 7f22c2ffd640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22c40cc520 0x7f22c4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.143+0000 7f22c2ffd640 1 -- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40cbc00 msgr2=0x7f22c4154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.143+0000 7f22c2ffd640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40cbc00 0x7f22c4154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.143+0000 7f22c2ffd640 1 -- 172.21.15.136:0/373722938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0093a0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.146+0000 7f22c2ffd640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 0x7f22c415c070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c430 tx=0x7f22b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.149+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011790 con 0x7f22c40ca4e0 2024-02-17T13:26:00.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.149+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b40118f0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.149+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c41f05d0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.149 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.149+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011ca0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.149+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c4156dd0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.150+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c41546c0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.395+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f22b401c460 con 0x7f22c40ca4e0 2024-02-17T13:26:00.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.395+0000 7f22bb7fe640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f22a406b860 0x7f22a406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.395+0000 7f22bbfff640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f22a406b860 0x7f22a406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.396+0000 7f22bbfff640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f22a406b860 0x7f22a406dd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22ac036000 tx=0x7f22ac03d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.423+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f22b4059350 con 0x7f22c40ca4e0 2024-02-17T13:26:00.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.424+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22b40555f0 con 0x7f22c40ca4e0 2024-02-17T13:26:00.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.600+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f22c415d7b0 con 0x7f22a406b860 2024-02-17T13:26:00.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.601+0000 7f22bb7fe640 1 -- 172.21.15.136:0/373722938 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22ac031c00 con 0x7f22a406b860 2024-02-17T13:26:00.601 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 1 to deep-scrub 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f22a406b860 msgr2=0x7f22a406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f22a406b860 0x7f22a406dd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22ac036000 tx=0x7f22ac03d040 comp rx=0 tx=0).stop 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 msgr2=0x7f22c415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 0x7f22c415c070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c430 tx=0x7f22b400c8f0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 shutdown_connections 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f22a406b860 0x7f22a406dd20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22c40cc520 0x7f22c4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22c40cbc00 0x7f22c4154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 --2- 172.21.15.136:0/373722938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22c40ca4e0 0x7f22c415c070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 >> 172.21.15.136:0/373722938 conn(0x7f22c40721f0 msgr2=0x7f22c41534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:00.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 shutdown_connections 2024-02-17T13:26:00.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.603+0000 7f22c96d4640 1 -- 172.21.15.136:0/373722938 wait complete. 2024-02-17T13:26:00.615 INFO:tasks.ceph:Scrubbing osd.2 2024-02-17T13:26:00.615 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:26:00.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.721+0000 7f9112249640 1 Processor -- start 2024-02-17T13:26:00.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.721+0000 7f9112249640 1 -- start start 2024-02-17T13:26:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.722+0000 7f9112249640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c0c6850 0x7f910c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.722+0000 7f9112249640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0c71e0 con 0x7f910c0cb550 2024-02-17T13:26:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.722+0000 7f9112249640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c15dbd0 con 0x7f910c154120 2024-02-17T13:26:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.722+0000 7f9112249640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0c7ba0 con 0x7f910c0c6850 2024-02-17T13:26:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.722+0000 7f910bfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f910c0cb550 0x7f910c0ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:59798/0 (socket says 172.21.15.136:59798) 2024-02-17T13:26:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.722+0000 7f910bfff640 1 -- 172.21.15.136:0/2574588299 learned_addr learned my addr 172.21.15.136:0/2574588299 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:00.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.723+0000 7f910affd640 1 --2- 172.21.15.136:0/2574588299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c0c6850 0x7f910c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393016086 0 0) 0x7f910c0c71e0 con 0x7f910c0cb550 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f4003520 con 0x7f910c0cb550 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422877003 0 0) 0x7f910c15dbd0 con 0x7f910c154120 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f910c0c71e0 con 0x7f910c154120 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910affd640 1 -- 172.21.15.136:0/2574588299 >> v1:172.21.15.160:6789/0 conn(0x7f910c154120 legacy=0x7f910c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910affd640 1 -- 172.21.15.136:0/2574588299 >> v1:172.21.15.136:6789/0 conn(0x7f910c0cb550 legacy=0x7f910c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.725+0000 7f910affd640 1 -- 172.21.15.136:0/2574588299 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0c6c70 con 0x7f910c0c6850 2024-02-17T13:26:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.727+0000 7f910affd640 1 --2- 172.21.15.136:0/2574588299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c0c6850 0x7f910c0cb010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91000097c0 tx=0x7f910002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37cc05fb0809e816 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100031890 con 0x7f910c0c6850 2024-02-17T13:26:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91000319f0 con 0x7f910c0c6850 2024-02-17T13:26:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f910a7fc640 1 -- 172.21.15.136:0/2574588299 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100031d80 con 0x7f910c0c6850 2024-02-17T13:26:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 -- 172.21.15.136:0/2574588299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c0c6850 msgr2=0x7f910c0cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 --2- 172.21.15.136:0/2574588299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c0c6850 0x7f910c0cb010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91000097c0 tx=0x7f910002b930 comp rx=0 tx=0).stop 2024-02-17T13:26:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 -- 172.21.15.136:0/2574588299 shutdown_connections 2024-02-17T13:26:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 --2- 172.21.15.136:0/2574588299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c0c6850 0x7f910c0cb010 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 -- 172.21.15.136:0/2574588299 >> 172.21.15.136:0/2574588299 conn(0x7f910c06d450 msgr2=0x7f910c06b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:00.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 -- 172.21.15.136:0/2574588299 shutdown_connections 2024-02-17T13:26:00.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.731+0000 7f9112249640 1 -- 172.21.15.136:0/2574588299 wait complete. 2024-02-17T13:26:00.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 Processor -- start 2024-02-17T13:26:00.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 -- start start 2024-02-17T13:26:00.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910c0c6850 0x7f910c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f910c0cb550 0x7f910c1f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c154120 0x7f910c1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0c4bd0 con 0x7f910c0c6850 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0c5c90 con 0x7f910c0cb550 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.733+0000 7f9112249640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1e5d70 con 0x7f910c154120 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.734+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910c0c6850 0x7f910c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.734+0000 7f910bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c154120 0x7f910c1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.734+0000 7f910affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f910c0cb550 0x7f910c1f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.734+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910c0c6850 0x7f910c15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40856/0 (socket says 172.21.15.136:40856) 2024-02-17T13:26:00.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.734+0000 7f910b7fe640 1 -- 172.21.15.136:0/3547268495 learned_addr learned my addr 172.21.15.136:0/3547268495 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:00.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.737+0000 7f910bfff640 1 -- 172.21.15.136:0/3547268495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f910c0cb550 msgr2=0x7f910c1f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.738+0000 7f910bfff640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f910c0cb550 0x7f910c1f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.738+0000 7f910bfff640 1 -- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910c0c6850 msgr2=0x7f910c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.738+0000 7f910bfff640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910c0c6850 0x7f910c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.738+0000 7f910bfff640 1 -- 172.21.15.136:0/3547268495 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000093a0 con 0x7f910c154120 2024-02-17T13:26:00.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.740+0000 7f910bfff640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c154120 0x7f910c1f30d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f910400ca70 tx=0x7f910400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.743+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400abd0 con 0x7f910c154120 2024-02-17T13:26:00.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.743+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400ad30 con 0x7f910c154120 2024-02-17T13:26:00.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.743+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400aea0 con 0x7f910c154120 2024-02-17T13:26:00.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.743+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c0c37c0 con 0x7f910c154120 2024-02-17T13:26:00.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.743+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c1e56d0 con 0x7f910c154120 2024-02-17T13:26:00.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.744+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f910c15d580 con 0x7f910c154120 2024-02-17T13:26:00.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.763+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9104007070 con 0x7f910c154120 2024-02-17T13:26:00.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.764+0000 7f90f3fff640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f90f806b890 0x7f90f806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.764+0000 7f910b7fe640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f90f806b890 0x7f90f806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.764+0000 7f910b7fe640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f90f806b890 0x7f90f806dd50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90fc007fd0 tx=0x7f90fc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.766+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f9104058fe0 con 0x7f910c154120 2024-02-17T13:26:00.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.766+0000 7f90f3fff640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7f90f8075030 0x7f90f80774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.766+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 --> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90f8077ba0 con 0x7f90f8075030 2024-02-17T13:26:00.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.766+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9104055280 con 0x7f910c154120 2024-02-17T13:26:00.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.767+0000 7f910affd640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7f90f8075030 0x7f90f80774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.767+0000 7f910affd640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7f90f8075030 0x7f90f80774d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.767+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== osd.2 v2:172.21.15.136:6808/1843608595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f90f8077ba0 con 0x7f90f8075030 2024-02-17T13:26:00.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.780+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 --> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f910c15d2a0 con 0x7f90f8075030 2024-02-17T13:26:00.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f90f3fff640 1 -- 172.21.15.136:0/3547268495 <== osd.2 v2:172.21.15.136:6808/1843608595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9100031b60 con 0x7f90f8075030 2024-02-17T13:26:00.780 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:00.781 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:00.781 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7f90f8075030 msgr2=0x7f90f80774d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6808/1843608595,v1:172.21.15.136:6809/1843608595] conn(0x7f90f8075030 0x7f90f80774d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f90f806b890 msgr2=0x7f90f806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f90f806b890 0x7f90f806dd50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90fc007fd0 tx=0x7f90fc009040 comp rx=0 tx=0).stop 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c154120 msgr2=0x7f910c1f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 --2- 172.21.15.136:0/3547268495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f910c154120 0x7f910c1f30d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f910400ca70 tx=0x7f910400cf30 comp rx=0 tx=0).stop 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f910bfff640 1 -- 172.21.15.136:0/3547268495 reap_dead start 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 shutdown_connections 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 >> 172.21.15.136:0/3547268495 conn(0x7f910c06d450 msgr2=0x7f910c0cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 shutdown_connections 2024-02-17T13:26:00.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.781+0000 7f9112249640 1 -- 172.21.15.136:0/3547268495 wait complete. 2024-02-17T13:26:00.792 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-17T13:26:00.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.894+0000 7f937773a640 1 Processor -- start 2024-02-17T13:26:00.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.894+0000 7f937773a640 1 -- start start 2024-02-17T13:26:00.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.895+0000 7f937773a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 0x7f9370159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.895+0000 7f937773a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93700723e0 0x7f9370072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.895+0000 7f937773a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93700c65a0 con 0x7f937015a250 2024-02-17T13:26:00.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.895+0000 7f937773a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9370072d90 con 0x7f93700723e0 2024-02-17T13:26:00.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.895+0000 7f937773a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937006af20 con 0x7f9370153fb0 2024-02-17T13:26:00.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.896+0000 7f93754d6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 0x7f9370159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.896+0000 7f93754d6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 0x7f9370159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:60652/0 (socket says 172.21.15.136:60652) 2024-02-17T13:26:00.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.896+0000 7f93754d6640 1 -- 172.21.15.136:0/498319437 learned_addr learned my addr 172.21.15.136:0/498319437 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:00.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.896+0000 7f9375cd7640 1 --2- 172.21.15.136:0/498319437 >> v2:172.21.15.136:3300/0 conn(0x7f93700723e0 0x7f9370072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.898+0000 7f93754d6640 1 -- 172.21.15.136:0/498319437 >> v2:172.21.15.136:3300/0 conn(0x7f93700723e0 msgr2=0x7f9370072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:00.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.898+0000 7f93754d6640 1 --2- 172.21.15.136:0/498319437 >> v2:172.21.15.136:3300/0 conn(0x7f93700723e0 0x7f9370072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.898+0000 7f93754d6640 1 -- 172.21.15.136:0/498319437 >> v1:172.21.15.136:6789/0 conn(0x7f937015a250 legacy=0x7f937006f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.898+0000 7f93754d6640 1 -- 172.21.15.136:0/498319437 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937006b1c0 con 0x7f9370153fb0 2024-02-17T13:26:00.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.900+0000 7f93754d6640 1 --2- 172.21.15.136:0/498319437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 0x7f9370159d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f936c009e50 tx=0x7f936c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f4af316c6106195 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.904+0000 7f9367fff640 1 -- 172.21.15.136:0/498319437 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c02cb00 con 0x7f9370153fb0 2024-02-17T13:26:00.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.904+0000 7f9367fff640 1 -- 172.21.15.136:0/498319437 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c02cc60 con 0x7f9370153fb0 2024-02-17T13:26:00.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.904+0000 7f9367fff640 1 -- 172.21.15.136:0/498319437 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0343f0 con 0x7f9370153fb0 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.904+0000 7f937773a640 1 -- 172.21.15.136:0/498319437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 msgr2=0x7f9370159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.904+0000 7f937773a640 1 --2- 172.21.15.136:0/498319437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 0x7f9370159d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f936c009e50 tx=0x7f936c02bf60 comp rx=0 tx=0).stop 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.905+0000 7f937773a640 1 -- 172.21.15.136:0/498319437 shutdown_connections 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.905+0000 7f937773a640 1 --2- 172.21.15.136:0/498319437 >> v2:172.21.15.136:3300/0 conn(0x7f93700723e0 0x7f9370072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.905+0000 7f937773a640 1 --2- 172.21.15.136:0/498319437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9370153fb0 0x7f9370159d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.905+0000 7f937773a640 1 -- 172.21.15.136:0/498319437 >> 172.21.15.136:0/498319437 conn(0x7f937006bbd0 msgr2=0x7f937006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.905+0000 7f937773a640 1 -- 172.21.15.136:0/498319437 shutdown_connections 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.905+0000 7f937773a640 1 -- 172.21.15.136:0/498319437 wait complete. 2024-02-17T13:26:00.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.906+0000 7f937773a640 1 Processor -- start 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.906+0000 7f937773a640 1 -- start start 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.906+0000 7f937773a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93700723e0 0x7f9370145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.906+0000 7f937773a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 0x7f93701581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f937773a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f937015a250 0x7f9370158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f937773a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9370157d40 con 0x7f9370153fb0 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f937773a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9370159980 con 0x7f937015a250 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f937773a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9370157a10 con 0x7f93700723e0 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f9374cd5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 0x7f93701581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f93754d6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93700723e0 0x7f9370145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f9374cd5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 0x7f93701581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40880/0 (socket says 172.21.15.136:40880) 2024-02-17T13:26:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f9374cd5640 1 -- 172.21.15.136:0/4235709537 learned_addr learned my addr 172.21.15.136:0/4235709537 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:00.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.907+0000 7f9375cd7640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f937015a250 0x7f9370158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.911+0000 7f9374cd5640 1 -- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93700723e0 msgr2=0x7f9370145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.911+0000 7f9374cd5640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93700723e0 0x7f9370145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.911+0000 7f9374cd5640 1 -- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f937015a250 msgr2=0x7f9370158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:00.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.911+0000 7f9374cd5640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f937015a250 0x7f9370158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:00.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.911+0000 7f9374cd5640 1 -- 172.21.15.136:0/4235709537 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c009b30 con 0x7f9370153fb0 2024-02-17T13:26:00.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.913+0000 7f9374cd5640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 0x7f93701581d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f936000c440 tx=0x7f936000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.917+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600052d0 con 0x7f9370153fb0 2024-02-17T13:26:00.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.917+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360005430 con 0x7f9370153fb0 2024-02-17T13:26:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.917+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360007260 con 0x7f9370153fb0 2024-02-17T13:26:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.917+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9370155380 con 0x7f9370153fb0 2024-02-17T13:26:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.917+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9370159bf0 con 0x7f9370153fb0 2024-02-17T13:26:00.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.918+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9370157ef0 con 0x7f9370153fb0 2024-02-17T13:26:00.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.936+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f93600073c0 con 0x7f9370153fb0 2024-02-17T13:26:00.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.937+0000 7f9365ffb640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f935406b860 0x7f935406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:00.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.937+0000 7f93754d6640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f935406b860 0x7f935406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:00.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.937+0000 7f93754d6640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f935406b860 0x7f935406dd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f936c035000 tx=0x7f936c030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:00.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:00.939+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f9360058360 con 0x7f9370153fb0 2024-02-17T13:26:01.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.177+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9360054600 con 0x7f9370153fb0 2024-02-17T13:26:01.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.351+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f93700caff0 con 0x7f935406b860 2024-02-17T13:26:01.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.351+0000 7f9365ffb640 1 -- 172.21.15.136:0/4235709537 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f936c009510 con 0x7f935406b860 2024-02-17T13:26:01.351 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 2 to deep-scrub 2024-02-17T13:26:01.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.353+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f935406b860 msgr2=0x7f935406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.353+0000 7f937773a640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f935406b860 0x7f935406dd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f936c035000 tx=0x7f936c030000 comp rx=0 tx=0).stop 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.353+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 msgr2=0x7f93701581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.353+0000 7f937773a640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 0x7f93701581d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f936000c440 tx=0x7f936000c900 comp rx=0 tx=0).stop 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 shutdown_connections 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f935406b860 0x7f935406dd20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f937015a250 0x7f9370158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9370153fb0 0x7f93701581d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 --2- 172.21.15.136:0/4235709537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93700723e0 0x7f9370145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 >> 172.21.15.136:0/4235709537 conn(0x7f937006bbd0 msgr2=0x7f9370151030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 shutdown_connections 2024-02-17T13:26:01.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.354+0000 7f937773a640 1 -- 172.21.15.136:0/4235709537 wait complete. 2024-02-17T13:26:01.365 INFO:tasks.ceph:Scrubbing osd.3 2024-02-17T13:26:01.365 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:26:01.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.471+0000 7f098a73e640 1 Processor -- start 2024-02-17T13:26:01.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.471+0000 7f098a73e640 1 -- start start 2024-02-17T13:26:01.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.471+0000 7f098a73e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0984153df0 0x7f098406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.471+0000 7f098a73e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098415d090 con 0x7f09840c7ce0 2024-02-17T13:26:01.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.472+0000 7f098a73e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0984159d60 con 0x7f098406c3e0 2024-02-17T13:26:01.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.472+0000 7f098a73e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0984159ac0 con 0x7f0984153df0 2024-02-17T13:26:01.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.472+0000 7f0988cdb640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f098406c3e0 0x7f098415d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:54338/0 (socket says 172.21.15.136:54338) 2024-02-17T13:26:01.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.472+0000 7f0988cdb640 1 -- 172.21.15.136:0/4250178523 learned_addr learned my addr 172.21.15.136:0/4250178523 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:01.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.472+0000 7f0983fff640 1 --2- 172.21.15.136:0/4250178523 >> v2:172.21.15.136:3300/0 conn(0x7f0984153df0 0x7f098406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.474 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.475+0000 7f0982ffd640 1 -- 172.21.15.136:0/4250178523 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062753082 0 0) 0x7f0984159d60 con 0x7f098406c3e0 2024-02-17T13:26:01.474 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.475+0000 7f0982ffd640 1 -- 172.21.15.136:0/4250178523 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f096c003520 con 0x7f098406c3e0 2024-02-17T13:26:01.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.476+0000 7f0983fff640 1 -- 172.21.15.136:0/4250178523 >> v1:172.21.15.160:6789/0 conn(0x7f098406c3e0 legacy=0x7f098415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.476+0000 7f0983fff640 1 -- 172.21.15.136:0/4250178523 >> v1:172.21.15.136:6789/0 conn(0x7f09840c7ce0 legacy=0x7f098415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.476+0000 7f0983fff640 1 -- 172.21.15.136:0/4250178523 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098406c110 con 0x7f0984153df0 2024-02-17T13:26:01.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.480+0000 7f0983fff640 1 --2- 172.21.15.136:0/4250178523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0984153df0 0x7f098406bbd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09740097a0 tx=0x7f097402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0543e66144c0423 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.484+0000 7f0982ffd640 1 -- 172.21.15.136:0/4250178523 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097402f810 con 0x7f0984153df0 2024-02-17T13:26:01.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.484+0000 7f0982ffd640 1 -- 172.21.15.136:0/4250178523 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097402f970 con 0x7f0984153df0 2024-02-17T13:26:01.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.484+0000 7f0982ffd640 1 -- 172.21.15.136:0/4250178523 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097402fd00 con 0x7f0984153df0 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 -- 172.21.15.136:0/4250178523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0984153df0 msgr2=0x7f098406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 --2- 172.21.15.136:0/4250178523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0984153df0 0x7f098406bbd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09740097a0 tx=0x7f097402b9f0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 -- 172.21.15.136:0/4250178523 shutdown_connections 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 --2- 172.21.15.136:0/4250178523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0984153df0 0x7f098406bbd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 -- 172.21.15.136:0/4250178523 >> 172.21.15.136:0/4250178523 conn(0x7f098406e900 msgr2=0x7f098406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 -- 172.21.15.136:0/4250178523 shutdown_connections 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.485+0000 7f098a73e640 1 -- 172.21.15.136:0/4250178523 wait complete. 2024-02-17T13:26:01.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.486+0000 7f098a73e640 1 Processor -- start 2024-02-17T13:26:01.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.486+0000 7f098a73e640 1 -- start start 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.487+0000 7f098a73e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f098406c3e0 0x7f098415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.487+0000 7f098a73e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09840c7ce0 0x7f098414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.487+0000 7f098a73e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0984153df0 0x7f098414c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.487+0000 7f098a73e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09841ef5b0 con 0x7f09840c7ce0 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.487+0000 7f098a73e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840cb740 con 0x7f0984153df0 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.487+0000 7f098a73e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09841f34c0 con 0x7f098406c3e0 2024-02-17T13:26:01.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.488+0000 7f09837fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09840c7ce0 0x7f098414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.488+0000 7f0988cdb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0984153df0 0x7f098414c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.488+0000 7f09837fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09840c7ce0 0x7f098414c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46368/0 (socket says 172.21.15.136:46368) 2024-02-17T13:26:01.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.488+0000 7f09837fe640 1 -- 172.21.15.136:0/361078512 learned_addr learned my addr 172.21.15.136:0/361078512 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:01.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.488+0000 7f0983fff640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f098406c3e0 0x7f098415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.491+0000 7f09837fe640 1 -- 172.21.15.136:0/361078512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f098406c3e0 msgr2=0x7f098415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.491+0000 7f09837fe640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f098406c3e0 0x7f098415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.491+0000 7f09837fe640 1 -- 172.21.15.136:0/361078512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0984153df0 msgr2=0x7f098414c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.491+0000 7f09837fe640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0984153df0 0x7f098414c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.491+0000 7f09837fe640 1 -- 172.21.15.136:0/361078512 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974009400 con 0x7f09840c7ce0 2024-02-17T13:26:01.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.494+0000 7f09837fe640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09840c7ce0 0x7f098414c290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f097800c450 tx=0x7f097800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.497+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780052d0 con 0x7f09840c7ce0 2024-02-17T13:26:01.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.497+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978005430 con 0x7f09840c7ce0 2024-02-17T13:26:01.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.497+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09840cb180 con 0x7f09840c7ce0 2024-02-17T13:26:01.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.497+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978012870 con 0x7f09840c7ce0 2024-02-17T13:26:01.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.497+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09841f37a0 con 0x7f09840c7ce0 2024-02-17T13:26:01.497 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.498+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09841ef410 con 0x7f09840c7ce0 2024-02-17T13:26:01.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.517+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f09780129d0 con 0x7f09840c7ce0 2024-02-17T13:26:01.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.517+0000 7f0980ff9640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f097006b860 0x7f097006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.518+0000 7f0983fff640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f097006b860 0x7f097006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.518+0000 7f0983fff640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f097006b860 0x7f097006dd20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0974036000 tx=0x7f0974008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.521+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0978058e50 con 0x7f09840c7ce0 2024-02-17T13:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.521+0000 7f0980ff9640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f0970075080 0x7f0970077520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.521+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 --> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0970077bf0 con 0x7f0970075080 2024-02-17T13:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.521+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09780011e0 con 0x7f09840c7ce0 2024-02-17T13:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.521+0000 7f0988cdb640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f0970075080 0x7f0970077520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.521+0000 7f0988cdb640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f0970075080 0x7f0970077520 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.522+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== osd.3 v2:172.21.15.136:6824/918147356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0970077bf0 con 0x7f0970075080 2024-02-17T13:26:01.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.535+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 --> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09840c96f0 con 0x7f0970075080 2024-02-17T13:26:01.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.535+0000 7f0980ff9640 1 -- 172.21.15.136:0/361078512 <== osd.3 v2:172.21.15.136:6824/918147356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f097c002010 con 0x7f0970075080 2024-02-17T13:26:01.535 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:01.535 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:01.535 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:01.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.535+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f0970075080 msgr2=0x7f0970077520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6824/918147356,v1:172.21.15.136:6825/918147356] conn(0x7f0970075080 0x7f0970077520 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f097006b860 msgr2=0x7f097006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f097006b860 0x7f097006dd20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0974036000 tx=0x7f0974008030 comp rx=0 tx=0).stop 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09840c7ce0 msgr2=0x7f098414c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 --2- 172.21.15.136:0/361078512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09840c7ce0 0x7f098414c290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f097800c450 tx=0x7f097800c910 comp rx=0 tx=0).stop 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f0988cdb640 1 -- 172.21.15.136:0/361078512 reap_dead start 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 shutdown_connections 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 >> 172.21.15.136:0/361078512 conn(0x7f098406e900 msgr2=0x7f0984157930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 shutdown_connections 2024-02-17T13:26:01.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.536+0000 7f098a73e640 1 -- 172.21.15.136:0/361078512 wait complete. 2024-02-17T13:26:01.546 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-17T13:26:01.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.652+0000 7f1edcbc9640 1 Processor -- start 2024-02-17T13:26:01.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.652+0000 7f1edcbc9640 1 -- start start 2024-02-17T13:26:01.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.653+0000 7f1edcbc9640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ed80cbc00 0x7f1ed806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.653+0000 7f1edcbc9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80cb470 con 0x7f1ed80ca4e0 2024-02-17T13:26:01.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.653+0000 7f1edcbc9640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80cb750 con 0x7f1ed81624d0 2024-02-17T13:26:01.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.653+0000 7f1edcbc9640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed815d1f0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.654+0000 7f1ed659c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ed80cbc00 0x7f1ed806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.654+0000 7f1ed659c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ed80cbc00 0x7f1ed806acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:59308/0 (socket says 172.21.15.136:59308) 2024-02-17T13:26:01.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.654+0000 7f1ed659c640 1 -- 172.21.15.136:0/3438215107 learned_addr learned my addr 172.21.15.136:0/3438215107 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:01.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.658+0000 7f1ed659c640 1 -- 172.21.15.136:0/3438215107 >> v1:172.21.15.160:6789/0 conn(0x7f1ed81624d0 legacy=0x7f1ed81648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.658+0000 7f1ed659c640 1 -- 172.21.15.136:0/3438215107 >> v1:172.21.15.136:6789/0 conn(0x7f1ed80ca4e0 legacy=0x7f1ed80cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.658+0000 7f1ed659c640 1 -- 172.21.15.136:0/3438215107 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed815d4d0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.661+0000 7f1ed659c640 1 --2- 172.21.15.136:0/3438215107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed80cbc00 0x7f1ed806acd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6f34e9803a1cff server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.669+0000 7f1ed559a640 1 -- 172.21.15.136:0/3438215107 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec802f840 con 0x7f1ed80cbc00 2024-02-17T13:26:01.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.669+0000 7f1ed559a640 1 -- 172.21.15.136:0/3438215107 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec802f9a0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.669+0000 7f1ed559a640 1 -- 172.21.15.136:0/3438215107 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec802fd30 con 0x7f1ed80cbc00 2024-02-17T13:26:01.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.669+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3438215107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed80cbc00 msgr2=0x7f1ed806acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.669+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3438215107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed80cbc00 0x7f1ed806acd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec802ba20 comp rx=0 tx=0).stop 2024-02-17T13:26:01.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.670+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3438215107 shutdown_connections 2024-02-17T13:26:01.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.670+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3438215107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed80cbc00 0x7f1ed806acd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.670+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3438215107 >> 172.21.15.136:0/3438215107 conn(0x7f1ed80721f0 msgr2=0x7f1ed80725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:01.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.670+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3438215107 shutdown_connections 2024-02-17T13:26:01.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.670+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3438215107 wait complete. 2024-02-17T13:26:01.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.671+0000 7f1edcbc9640 1 Processor -- start 2024-02-17T13:26:01.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.671+0000 7f1edcbc9640 1 -- start start 2024-02-17T13:26:01.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1edcbc9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ed80ca4e0 0x7f1ed8159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1edcbc9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 0x7f1ed81569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1edcbc9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed81624d0 0x7f1ed815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1edcbc9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8155c50 con 0x7f1ed80cbc00 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1edcbc9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed81efdb0 con 0x7f1ed81624d0 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1edcbc9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed81f0050 con 0x7f1ed80ca4e0 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1ed5d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 0x7f1ed81569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1ed659c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ed80ca4e0 0x7f1ed8159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1ed6d9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed81624d0 0x7f1ed815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1ed5d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 0x7f1ed81569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46370/0 (socket says 172.21.15.136:46370) 2024-02-17T13:26:01.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.672+0000 7f1ed5d9b640 1 -- 172.21.15.136:0/3407786160 learned_addr learned my addr 172.21.15.136:0/3407786160 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:01.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.676+0000 7f1ed5d9b640 1 -- 172.21.15.136:0/3407786160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ed80ca4e0 msgr2=0x7f1ed8159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.676+0000 7f1ed5d9b640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ed80ca4e0 0x7f1ed8159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.676+0000 7f1ed5d9b640 1 -- 172.21.15.136:0/3407786160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed81624d0 msgr2=0x7f1ed815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:01.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.676+0000 7f1ed5d9b640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed81624d0 0x7f1ed815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:01.675 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.676+0000 7f1ed5d9b640 1 -- 172.21.15.136:0/3407786160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80094d0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.678+0000 7f1ed5d9b640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 0x7f1ed81569c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c400 tx=0x7f1ecc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.681+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0035f0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.681+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc003750 con 0x7f1ed80cbc00 2024-02-17T13:26:01.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.681+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc003ac0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.681+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed81f0330 con 0x7f1ed80cbc00 2024-02-17T13:26:01.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.681+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed81f08f0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.682+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed80c2cc0 con 0x7f1ed80cbc00 2024-02-17T13:26:01.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.700+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1ecc003c20 con 0x7f1ed80cbc00 2024-02-17T13:26:01.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.700+0000 7f1ec6ffd640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1eb806b860 0x7f1eb806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:01.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.701+0000 7f1ed659c640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1eb806b860 0x7f1eb806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:01.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.701+0000 7f1ed659c640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1eb806b860 0x7f1eb806dd20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8036000 tx=0x7f1ec8008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:01.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.704+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f1ecc058780 con 0x7f1ed80cbc00 2024-02-17T13:26:01.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:01.947+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ecc054a20 con 0x7f1ed80cbc00 2024-02-17T13:26:02.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.131+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ed81f01c0 con 0x7f1eb806b860 2024-02-17T13:26:02.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.131+0000 7f1ec6ffd640 1 -- 172.21.15.136:0/3407786160 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ed81f01c0 con 0x7f1eb806b860 2024-02-17T13:26:02.131 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 3 to deep-scrub 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1eb806b860 msgr2=0x7f1eb806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1eb806b860 0x7f1eb806dd20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8036000 tx=0x7f1ec8008030 comp rx=0 tx=0).stop 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 msgr2=0x7f1ed81569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 0x7f1ed81569c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c400 tx=0x7f1ecc00c8c0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 shutdown_connections 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f1eb806b860 0x7f1eb806dd20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ed81624d0 0x7f1ed815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ed80cbc00 0x7f1ed81569c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 --2- 172.21.15.136:0/3407786160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ed80ca4e0 0x7f1ed8159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 >> 172.21.15.136:0/3407786160 conn(0x7f1ed80721f0 msgr2=0x7f1ed8152790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:02.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 shutdown_connections 2024-02-17T13:26:02.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.134+0000 7f1edcbc9640 1 -- 172.21.15.136:0/3407786160 wait complete. 2024-02-17T13:26:02.146 INFO:tasks.ceph:Scrubbing osd.4 2024-02-17T13:26:02.146 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:26:02.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 Processor -- start 2024-02-17T13:26:02.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 -- start start 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd8540cf4c0 0x7fd85415a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540b2900 0x7fd8540cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd8540ca6c0 0x7fd8540caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540ccea0 con 0x7fd8540ca6c0 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540b4d90 con 0x7fd8540cf4c0 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.251+0000 7fd859f5c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8540cfde0 con 0x7fd8540b2900 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.252+0000 7fd853fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd8540ca6c0 0x7fd8540caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.252+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540b2900 0x7fd8540cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.252+0000 7fd8537fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd8540cf4c0 0x7fd85415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.252+0000 7fd853fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd8540ca6c0 0x7fd8540caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46376/0 (socket says 172.21.15.136:46376) 2024-02-17T13:26:02.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.252+0000 7fd853fff640 1 -- 172.21.15.136:0/1936351513 learned_addr learned my addr 172.21.15.136:0/1936351513 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:02.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.254+0000 7fd853fff640 1 -- 172.21.15.136:0/1936351513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540b2900 msgr2=0x7fd8540cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:02.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.254+0000 7fd853fff640 1 --2- 172.21.15.136:0/1936351513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540b2900 0x7fd8540cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.254+0000 7fd853fff640 1 -- 172.21.15.136:0/1936351513 >> v2:172.21.15.160:3300/0 conn(0x7fd8540cf4c0 msgr2=0x7fd85415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:02.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.254+0000 7fd853fff640 1 --2- 172.21.15.136:0/1936351513 >> v2:172.21.15.160:3300/0 conn(0x7fd8540cf4c0 0x7fd85415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.254+0000 7fd853fff640 1 -- 172.21.15.136:0/1936351513 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540cbc80 con 0x7fd8540ca6c0 2024-02-17T13:26:02.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.256+0000 7fd853fff640 1 --2- 172.21.15.136:0/1936351513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540ca6c0 0x7fd8540caad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd8540cbe70 tx=0x7fd84c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ef199faf50c1b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.260+0000 7fd8527fc640 1 -- 172.21.15.136:0/1936351513 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c02c9e0 con 0x7fd8540ca6c0 2024-02-17T13:26:02.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.260+0000 7fd8527fc640 1 -- 172.21.15.136:0/1936351513 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c02cb40 con 0x7fd8540ca6c0 2024-02-17T13:26:02.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.260+0000 7fd8527fc640 1 -- 172.21.15.136:0/1936351513 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0343f0 con 0x7fd8540ca6c0 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 -- 172.21.15.136:0/1936351513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540ca6c0 msgr2=0x7fd8540caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 --2- 172.21.15.136:0/1936351513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540ca6c0 0x7fd8540caad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd8540cbe70 tx=0x7fd84c02be40 comp rx=0 tx=0).stop 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 -- 172.21.15.136:0/1936351513 shutdown_connections 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 --2- 172.21.15.136:0/1936351513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540ca6c0 0x7fd8540caad0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 --2- 172.21.15.136:0/1936351513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540b2900 0x7fd8540cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 --2- 172.21.15.136:0/1936351513 >> v2:172.21.15.160:3300/0 conn(0x7fd8540cf4c0 0x7fd85415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 -- 172.21.15.136:0/1936351513 >> 172.21.15.136:0/1936351513 conn(0x7fd85406d4c0 msgr2=0x7fd85406b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 -- 172.21.15.136:0/1936351513 shutdown_connections 2024-02-17T13:26:02.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.261+0000 7fd859f5c640 1 -- 172.21.15.136:0/1936351513 wait complete. 2024-02-17T13:26:02.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.262+0000 7fd859f5c640 1 Processor -- start 2024-02-17T13:26:02.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.262+0000 7fd859f5c640 1 -- start start 2024-02-17T13:26:02.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.263+0000 7fd859f5c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8540b2900 0x7fd8540b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.263+0000 7fd859f5c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540ca6c0 0x7fd854156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.263+0000 7fd859f5c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540cf4c0 0x7fd854155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.263+0000 7fd859f5c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8541546f0 con 0x7fd8540cf4c0 2024-02-17T13:26:02.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.263+0000 7fd859f5c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd854154f90 con 0x7fd8540b2900 2024-02-17T13:26:02.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.263+0000 7fd859f5c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8541f0590 con 0x7fd8540ca6c0 2024-02-17T13:26:02.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.264+0000 7fd853fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540cf4c0 0x7fd854155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.264+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540ca6c0 0x7fd854156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.264+0000 7fd853fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540cf4c0 0x7fd854155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46382/0 (socket says 172.21.15.136:46382) 2024-02-17T13:26:02.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.264+0000 7fd853fff640 1 -- 172.21.15.136:0/707752930 learned_addr learned my addr 172.21.15.136:0/707752930 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:02.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.264+0000 7fd8537fe640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8540b2900 0x7fd8540b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.268+0000 7fd853fff640 1 -- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540ca6c0 msgr2=0x7fd854156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.268+0000 7fd853fff640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8540ca6c0 0x7fd854156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.268+0000 7fd853fff640 1 -- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8540b2900 msgr2=0x7fd8540b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.268+0000 7fd853fff640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8540b2900 0x7fd8540b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.268+0000 7fd853fff640 1 -- 172.21.15.136:0/707752930 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c009b30 con 0x7fd8540cf4c0 2024-02-17T13:26:02.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.270+0000 7fd853fff640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540cf4c0 0x7fd854155420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd84c02c450 tx=0x7fd84c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.273+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c007ea0 con 0x7fd8540cf4c0 2024-02-17T13:26:02.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.273+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c03e450 con 0x7fd8540cf4c0 2024-02-17T13:26:02.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.273+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c03e800 con 0x7fd8540cf4c0 2024-02-17T13:26:02.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.273+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8541f0800 con 0x7fd8540cf4c0 2024-02-17T13:26:02.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.273+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd854154c20 con 0x7fd8540cf4c0 2024-02-17T13:26:02.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.274+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8540ce330 con 0x7fd8540cf4c0 2024-02-17T13:26:02.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.293+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd84c03e960 con 0x7fd8540cf4c0 2024-02-17T13:26:02.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.293+0000 7fd83bfff640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd84006b810 0x7fd84006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.293+0000 7fd8537fe640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd84006b810 0x7fd84006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.293+0000 7fd8537fe640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd84006b810 0x7fd84006dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd844009aa0 tx=0x7fd844009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.297+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fd84c07ba30 con 0x7fd8540cf4c0 2024-02-17T13:26:02.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.297+0000 7fd83bfff640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7fd840074f20 0x7fd8400773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.297+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 --> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd840077a90 con 0x7fd840074f20 2024-02-17T13:26:02.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.298+0000 7fd852ffd640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7fd840074f20 0x7fd8400773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.298+0000 7fd852ffd640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7fd840074f20 0x7fd8400773c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.299+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd84c077cd0 con 0x7fd8540cf4c0 2024-02-17T13:26:02.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.299+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== osd.4 v2:172.21.15.160:6800/2188049654 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd840077a90 con 0x7fd840074f20 2024-02-17T13:26:02.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.312+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 --> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd8540c7750 con 0x7fd840074f20 2024-02-17T13:26:02.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.312+0000 7fd83bfff640 1 -- 172.21.15.136:0/707752930 <== osd.4 v2:172.21.15.160:6800/2188049654 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd8540c7750 con 0x7fd840074f20 2024-02-17T13:26:02.312 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:02.312 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:02.312 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:02.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.312+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7fd840074f20 msgr2=0x7fd8400773c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.160:6800/2188049654,v1:172.21.15.160:6801/2188049654] conn(0x7fd840074f20 0x7fd8400773c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd84006b810 msgr2=0x7fd84006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd84006b810 0x7fd84006dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd844009aa0 tx=0x7fd844009190 comp rx=0 tx=0).stop 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540cf4c0 msgr2=0x7fd854155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 --2- 172.21.15.136:0/707752930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8540cf4c0 0x7fd854155420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd84c02c450 tx=0x7fd84c004a40 comp rx=0 tx=0).stop 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd853fff640 1 -- 172.21.15.136:0/707752930 reap_dead start 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 shutdown_connections 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 >> 172.21.15.136:0/707752930 conn(0x7fd85406d4c0 msgr2=0x7fd8540cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 shutdown_connections 2024-02-17T13:26:02.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.313+0000 7fd859f5c640 1 -- 172.21.15.136:0/707752930 wait complete. 2024-02-17T13:26:02.323 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-17T13:26:02.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.426+0000 7f0adbfe2640 1 Processor -- start 2024-02-17T13:26:02.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.427+0000 7f0adbfe2640 1 -- start start 2024-02-17T13:26:02.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.427+0000 7f0adbfe2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0ad4154250 0x7f0ad406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.427+0000 7f0adbfe2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad40c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.427+0000 7f0adbfe2640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad40c8e60 con 0x7f0ad4070720 2024-02-17T13:26:02.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.427+0000 7f0adbfe2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad406c260 con 0x7f0ad4154250 2024-02-17T13:26:02.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.427+0000 7f0adbfe2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad406c540 con 0x7f0ad40c94f0 2024-02-17T13:26:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.428+0000 7f0ad9d7e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0ad4154250 0x7f0ad406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.428+0000 7f0ad957d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad40c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.428+0000 7f0ada57f640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f0ad4070720 0x7f0ad415d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:54370/0 (socket says 172.21.15.136:54370) 2024-02-17T13:26:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.428+0000 7f0ada57f640 1 -- 172.21.15.136:0/3654716691 learned_addr learned my addr 172.21.15.136:0/3654716691 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:02.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.430+0000 7f0ad9d7e640 1 -- 172.21.15.136:0/3654716691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 msgr2=0x7f0ad40c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:02.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.430+0000 7f0ad9d7e640 1 --2- 172.21.15.136:0/3654716691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad40c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.430+0000 7f0ad9d7e640 1 -- 172.21.15.136:0/3654716691 >> v1:172.21.15.160:6789/0 conn(0x7f0ad4070720 legacy=0x7f0ad415d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.430+0000 7f0ad9d7e640 1 -- 172.21.15.136:0/3654716691 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40c8530 con 0x7f0ad4154250 2024-02-17T13:26:02.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.432+0000 7f0ad9d7e640 1 --2- 172.21.15.136:0/3654716691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad406bbd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7652c5e28f5a611 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.436+0000 7f0ad8d7c640 1 -- 172.21.15.136:0/3654716691 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc02cce0 con 0x7f0ad4154250 2024-02-17T13:26:02.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.436+0000 7f0ad8d7c640 1 -- 172.21.15.136:0/3654716691 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc02ce40 con 0x7f0ad4154250 2024-02-17T13:26:02.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.436+0000 7f0ad8d7c640 1 -- 172.21.15.136:0/3654716691 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc034660 con 0x7f0ad4154250 2024-02-17T13:26:02.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.436+0000 7f0adbfe2640 1 -- 172.21.15.136:0/3654716691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 msgr2=0x7f0ad406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.436+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/3654716691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad406bbd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc02bf30 comp rx=0 tx=0).stop 2024-02-17T13:26:02.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.437+0000 7f0adbfe2640 1 -- 172.21.15.136:0/3654716691 shutdown_connections 2024-02-17T13:26:02.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.437+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/3654716691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad40c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.437+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/3654716691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad406bbd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.437+0000 7f0adbfe2640 1 -- 172.21.15.136:0/3654716691 >> 172.21.15.136:0/3654716691 conn(0x7f0ad406fe80 msgr2=0x7f0ad406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:02.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.437+0000 7f0adbfe2640 1 -- 172.21.15.136:0/3654716691 shutdown_connections 2024-02-17T13:26:02.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.437+0000 7f0adbfe2640 1 -- 172.21.15.136:0/3654716691 wait complete. 2024-02-17T13:26:02.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.438+0000 7f0adbfe2640 1 Processor -- start 2024-02-17T13:26:02.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.438+0000 7f0adbfe2640 1 -- start start 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0adbfe2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ad4070720 0x7f0ad41f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0adbfe2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad41f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0adbfe2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0adbfe2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41f3360 con 0x7f0ad4154250 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0adbfe2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41f3030 con 0x7f0ad4070720 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0adbfe2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41e3100 con 0x7f0ad40c94f0 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0ada57f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0ad957d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad41f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0ada57f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad414f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46400/0 (socket says 172.21.15.136:46400) 2024-02-17T13:26:02.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0ada57f640 1 -- 172.21.15.136:0/1647886250 learned_addr learned my addr 172.21.15.136:0/1647886250 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:02.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.439+0000 7f0ad9d7e640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ad4070720 0x7f0ad41f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.443+0000 7f0ada57f640 1 -- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 msgr2=0x7f0ad41f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.443+0000 7f0ada57f640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad41f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.443+0000 7f0ada57f640 1 -- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ad4070720 msgr2=0x7f0ad41f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.443+0000 7f0ada57f640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ad4070720 0x7f0ad41f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.443+0000 7f0ada57f640 1 -- 172.21.15.136:0/1647886250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009a70 con 0x7f0ad4154250 2024-02-17T13:26:02.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.445+0000 7f0ada57f640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad414f730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c3c0 tx=0x7f0ad000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.448+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0005ce0 con 0x7f0ad4154250 2024-02-17T13:26:02.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.448+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0005e40 con 0x7f0ad4154250 2024-02-17T13:26:02.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.448+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad41e33e0 con 0x7f0ad4154250 2024-02-17T13:26:02.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.448+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00072f0 con 0x7f0ad4154250 2024-02-17T13:26:02.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.448+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad41e39a0 con 0x7f0ad4154250 2024-02-17T13:26:02.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.449+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad41f3510 con 0x7f0ad4154250 2024-02-17T13:26:02.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.468+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0ad0007510 con 0x7f0ad4154250 2024-02-17T13:26:02.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.468+0000 7f0aca7fc640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ab806b860 0x7f0ab806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:02.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.469+0000 7f0ad9d7e640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ab806b860 0x7f0ab806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:02.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.469+0000 7f0ad9d7e640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ab806b860 0x7f0ab806dd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0acc036000 tx=0x7f0acc030000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:02.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.709+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0ad00581d0 con 0x7f0ad4154250 2024-02-17T13:26:02.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.709+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ad0054470 con 0x7f0ad4154250 2024-02-17T13:26:02.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.950+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad4154630 con 0x7f0ab806b860 2024-02-17T13:26:02.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.951+0000 7f0aca7fc640 1 -- 172.21.15.136:0/1647886250 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0acc042070 con 0x7f0ab806b860 2024-02-17T13:26:02.951 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 4 to deep-scrub 2024-02-17T13:26:02.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ab806b860 msgr2=0x7f0ab806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ab806b860 0x7f0ab806dd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0acc036000 tx=0x7f0acc030000 comp rx=0 tx=0).stop 2024-02-17T13:26:02.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 msgr2=0x7f0ad414f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:02.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad414f730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c3c0 tx=0x7f0ad000c880 comp rx=0 tx=0).stop 2024-02-17T13:26:02.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 shutdown_connections 2024-02-17T13:26:02.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0ab806b860 0x7f0ab806dd20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ad4154250 0x7f0ad414f730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ad40c94f0 0x7f0ad41f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 --2- 172.21.15.136:0/1647886250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ad4070720 0x7f0ad41f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:02.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 >> 172.21.15.136:0/1647886250 conn(0x7f0ad406fe80 msgr2=0x7f0ad406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:02.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 shutdown_connections 2024-02-17T13:26:02.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:02.953+0000 7f0adbfe2640 1 -- 172.21.15.136:0/1647886250 wait complete. 2024-02-17T13:26:02.965 INFO:tasks.ceph:Scrubbing osd.5 2024-02-17T13:26:02.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:26:03.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.069+0000 7fe1c7a23640 1 Processor -- start 2024-02-17T13:26:03.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.070+0000 7fe1c7a23640 1 -- start start 2024-02-17T13:26:03.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.070+0000 7fe1c7a23640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe1c00cf4c0 0x7fe1c015a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.070+0000 7fe1c7a23640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe1c00cadd0 0x7fe1c00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.070+0000 7fe1c7a23640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00cbc80 con 0x7fe1c00b2900 2024-02-17T13:26:03.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.070+0000 7fe1c7a23640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00ccea0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.070+0000 7fe1c7a23640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00b4d90 con 0x7fe1c00cf4c0 2024-02-17T13:26:03.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.071+0000 7fe1c5fc0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe1c00cadd0 0x7fe1c00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.071+0000 7fe1c57bf640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe1c00cf4c0 0x7fe1c015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.071+0000 7fe1c5fc0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe1c00cadd0 0x7fe1c00cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46406/0 (socket says 172.21.15.136:46406) 2024-02-17T13:26:03.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.071+0000 7fe1c5fc0640 1 -- 172.21.15.136:0/121464594 learned_addr learned my addr 172.21.15.136:0/121464594 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:03.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.074+0000 7fe1c5fc0640 1 -- 172.21.15.136:0/121464594 >> v2:172.21.15.160:3300/0 conn(0x7fe1c00cf4c0 msgr2=0x7fe1c015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:03.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.074+0000 7fe1c5fc0640 1 --2- 172.21.15.136:0/121464594 >> v2:172.21.15.160:3300/0 conn(0x7fe1c00cf4c0 0x7fe1c015a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.074+0000 7fe1c5fc0640 1 -- 172.21.15.136:0/121464594 >> v1:172.21.15.160:6789/0 conn(0x7fe1c00b2900 legacy=0x7fe1c00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.074+0000 7fe1c5fc0640 1 -- 172.21.15.136:0/121464594 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00cbf40 con 0x7fe1c00cadd0 2024-02-17T13:26:03.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.076+0000 7fe1c5fc0640 1 --2- 172.21.15.136:0/121464594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c00cf8a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1c006beb0 tx=0x7fe1b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d0ec788b67c77a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.079+0000 7fe1b7fff640 1 -- 172.21.15.136:0/121464594 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b802ca80 con 0x7fe1c00cadd0 2024-02-17T13:26:03.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.079+0000 7fe1b7fff640 1 -- 172.21.15.136:0/121464594 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b802cbe0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.079+0000 7fe1b7fff640 1 -- 172.21.15.136:0/121464594 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80343f0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 -- 172.21.15.136:0/121464594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 msgr2=0x7fe1c00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 --2- 172.21.15.136:0/121464594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c00cf8a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1c006beb0 tx=0x7fe1b802bee0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 -- 172.21.15.136:0/121464594 shutdown_connections 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 --2- 172.21.15.136:0/121464594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c00cf8a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 --2- 172.21.15.136:0/121464594 >> v2:172.21.15.160:3300/0 conn(0x7fe1c00cf4c0 0x7fe1c015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 -- 172.21.15.136:0/121464594 >> 172.21.15.136:0/121464594 conn(0x7fe1c006d4c0 msgr2=0x7fe1c006b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:03.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 -- 172.21.15.136:0/121464594 shutdown_connections 2024-02-17T13:26:03.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.080+0000 7fe1c7a23640 1 -- 172.21.15.136:0/121464594 wait complete. 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.081+0000 7fe1c7a23640 1 Processor -- start 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.081+0000 7fe1c7a23640 1 -- start start 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c7a23640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c00b2900 0x7fe1c0152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c7a23640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c01efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c7a23640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c00cf4c0 0x7fe1c00c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c7a23640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c51d0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c7a23640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c4f60 con 0x7fe1c00cf4c0 2024-02-17T13:26:03.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c7a23640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c54a0 con 0x7fe1c00b2900 2024-02-17T13:26:03.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c4fbe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c01efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c4fbe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c01efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46418/0 (socket says 172.21.15.136:46418) 2024-02-17T13:26:03.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.082+0000 7fe1c4fbe640 1 -- 172.21.15.136:0/2423662251 learned_addr learned my addr 172.21.15.136:0/2423662251 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:03.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.083+0000 7fe1c57bf640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c00b2900 0x7fe1c0152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.083 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.083+0000 7fe1c5fc0640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c00cf4c0 0x7fe1c00c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.086+0000 7fe1c4fbe640 1 -- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c00b2900 msgr2=0x7fe1c0152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.086+0000 7fe1c4fbe640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c00b2900 0x7fe1c0152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.086+0000 7fe1c4fbe640 1 -- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c00cf4c0 msgr2=0x7fe1c00c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.086+0000 7fe1c4fbe640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c00cf4c0 0x7fe1c00c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.086+0000 7fe1c4fbe640 1 -- 172.21.15.136:0/2423662251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009b30 con 0x7fe1c00cadd0 2024-02-17T13:26:03.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.088+0000 7fe1c4fbe640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c01efe20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c400 tx=0x7fe1b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.092+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00052d0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.092+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0005450 con 0x7fe1c00cadd0 2024-02-17T13:26:03.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.092+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c00c5780 con 0x7fe1c00cadd0 2024-02-17T13:26:03.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.092+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0007260 con 0x7fe1c00cadd0 2024-02-17T13:26:03.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.092+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00c5d40 con 0x7fe1c00cadd0 2024-02-17T13:26:03.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.093+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1c00cc7e0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.110 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.111+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe1b00073c0 con 0x7fe1c00cadd0 2024-02-17T13:26:03.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.111+0000 7fe1b5ffb640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe1a406b860 0x7fe1a406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.112+0000 7fe1c57bf640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe1a406b860 0x7fe1a406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.111 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.112+0000 7fe1c57bf640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe1a406b860 0x7fe1a406dd20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009aa0 tx=0x7fe1bc009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.115+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fe1b0007670 con 0x7fe1c00cadd0 2024-02-17T13:26:03.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.115+0000 7fe1b5ffb640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7fe1a4074ff0 0x7fe1a4077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.115+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 --> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1a4077b60 con 0x7fe1a4074ff0 2024-02-17T13:26:03.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.115+0000 7fe1c5fc0640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7fe1a4074ff0 0x7fe1a4077490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.115+0000 7fe1c5fc0640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7fe1a4074ff0 0x7fe1a4077490 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.115 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.116+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1b0054b70 con 0x7fe1c00cadd0 2024-02-17T13:26:03.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.116+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== osd.5 v2:172.21.15.160:6808/2660831410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe1a4077b60 con 0x7fe1a4074ff0 2024-02-17T13:26:03.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.129+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 --> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe1c00cc500 con 0x7fe1a4074ff0 2024-02-17T13:26:03.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1b5ffb640 1 -- 172.21.15.136:0/2423662251 <== osd.5 v2:172.21.15.160:6808/2660831410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe1b802c9e0 con 0x7fe1a4074ff0 2024-02-17T13:26:03.129 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:03.130 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7fe1a4074ff0 msgr2=0x7fe1a4077490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.160:6808/2660831410,v1:172.21.15.160:6809/2660831410] conn(0x7fe1a4074ff0 0x7fe1a4077490 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe1a406b860 msgr2=0x7fe1a406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe1a406b860 0x7fe1a406dd20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009aa0 tx=0x7fe1bc009190 comp rx=0 tx=0).stop 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 msgr2=0x7fe1c01efe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 --2- 172.21.15.136:0/2423662251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1c00cadd0 0x7fe1c01efe20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c400 tx=0x7fe1b000c8c0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c5fc0640 1 -- 172.21.15.136:0/2423662251 reap_dead start 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 shutdown_connections 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 >> 172.21.15.136:0/2423662251 conn(0x7fe1c006d4c0 msgr2=0x7fe1c00c82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 shutdown_connections 2024-02-17T13:26:03.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.130+0000 7fe1c7a23640 1 -- 172.21.15.136:0/2423662251 wait complete. 2024-02-17T13:26:03.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-17T13:26:03.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.244+0000 7fbd591d7640 1 Processor -- start 2024-02-17T13:26:03.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.244+0000 7fbd591d7640 1 -- start start 2024-02-17T13:26:03.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.245+0000 7fbd591d7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbd54150b50 0x7fbd5406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.245+0000 7fbd591d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd540c4e80 0x7fbd540c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.245+0000 7fbd591d7640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540c2dd0 con 0x7fbd5406aac0 2024-02-17T13:26:03.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.245+0000 7fbd591d7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540c64d0 con 0x7fbd54150b50 2024-02-17T13:26:03.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.245+0000 7fbd591d7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54150f30 con 0x7fbd540c4e80 2024-02-17T13:26:03.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.245+0000 7fbd5259c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd540c4e80 0x7fbd540c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.246+0000 7fbd52d9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbd54150b50 0x7fbd5406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.246+0000 7fbd5359e640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fbd5406aac0 0x7fbd540c7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54298/0 (socket says 172.21.15.136:54298) 2024-02-17T13:26:03.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.246+0000 7fbd5359e640 1 -- 172.21.15.136:0/990643280 learned_addr learned my addr 172.21.15.136:0/990643280 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:03.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.248+0000 7fbd5259c640 1 -- 172.21.15.136:0/990643280 >> v2:172.21.15.136:3300/0 conn(0x7fbd54150b50 msgr2=0x7fbd5406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:03.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.248+0000 7fbd5259c640 1 --2- 172.21.15.136:0/990643280 >> v2:172.21.15.136:3300/0 conn(0x7fbd54150b50 0x7fbd5406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.248+0000 7fbd5259c640 1 -- 172.21.15.136:0/990643280 >> v1:172.21.15.136:6789/0 conn(0x7fbd5406aac0 legacy=0x7fbd540c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.248+0000 7fbd5259c640 1 -- 172.21.15.136:0/990643280 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540c5f10 con 0x7fbd540c4e80 2024-02-17T13:26:03.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.250+0000 7fbd5259c640 1 --2- 172.21.15.136:0/990643280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd540c4e80 0x7fbd540c2890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097a0 tx=0x7fbd4802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678e3f74b998a7a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.254+0000 7fbd51d9b640 1 -- 172.21.15.136:0/990643280 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48031830 con 0x7fbd540c4e80 2024-02-17T13:26:03.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.254+0000 7fbd51d9b640 1 -- 172.21.15.136:0/990643280 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48031990 con 0x7fbd540c4e80 2024-02-17T13:26:03.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.254+0000 7fbd51d9b640 1 -- 172.21.15.136:0/990643280 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48031d20 con 0x7fbd540c4e80 2024-02-17T13:26:03.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.254+0000 7fbd591d7640 1 -- 172.21.15.136:0/990643280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd540c4e80 msgr2=0x7fbd540c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.254+0000 7fbd591d7640 1 --2- 172.21.15.136:0/990643280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd540c4e80 0x7fbd540c2890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd480097a0 tx=0x7fbd4802b8d0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.254+0000 7fbd591d7640 1 -- 172.21.15.136:0/990643280 shutdown_connections 2024-02-17T13:26:03.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.255+0000 7fbd591d7640 1 --2- 172.21.15.136:0/990643280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd540c4e80 0x7fbd540c2890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.255+0000 7fbd591d7640 1 --2- 172.21.15.136:0/990643280 >> v2:172.21.15.136:3300/0 conn(0x7fbd54150b50 0x7fbd5406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.255+0000 7fbd591d7640 1 -- 172.21.15.136:0/990643280 >> 172.21.15.136:0/990643280 conn(0x7fbd540c7e90 msgr2=0x7fbd540c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:03.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.255+0000 7fbd591d7640 1 -- 172.21.15.136:0/990643280 shutdown_connections 2024-02-17T13:26:03.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.255+0000 7fbd591d7640 1 -- 172.21.15.136:0/990643280 wait complete. 2024-02-17T13:26:03.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.256+0000 7fbd591d7640 1 Processor -- start 2024-02-17T13:26:03.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.256+0000 7fbd591d7640 1 -- start start 2024-02-17T13:26:03.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd591d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd5406aac0 0x7fbd54144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd591d7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 0x7fbd54154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd591d7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd54150b50 0x7fbd54145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd591d7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540cadc0 con 0x7fbd540c4e80 2024-02-17T13:26:03.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd591d7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541ed650 con 0x7fbd54150b50 2024-02-17T13:26:03.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd591d7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541ecd60 con 0x7fbd5406aac0 2024-02-17T13:26:03.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd5259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 0x7fbd54154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.257+0000 7fbd52d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd5406aac0 0x7fbd54144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.258+0000 7fbd5359e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd54150b50 0x7fbd54145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.258+0000 7fbd5259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 0x7fbd54154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46436/0 (socket says 172.21.15.136:46436) 2024-02-17T13:26:03.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.258+0000 7fbd5259c640 1 -- 172.21.15.136:0/1021144072 learned_addr learned my addr 172.21.15.136:0/1021144072 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:03.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.261+0000 7fbd5259c640 1 -- 172.21.15.136:0/1021144072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd5406aac0 msgr2=0x7fbd54144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.261+0000 7fbd5259c640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd5406aac0 0x7fbd54144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.261+0000 7fbd5259c640 1 -- 172.21.15.136:0/1021144072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd54150b50 msgr2=0x7fbd54145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.261+0000 7fbd5259c640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd54150b50 0x7fbd54145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.261+0000 7fbd5259c640 1 -- 172.21.15.136:0/1021144072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48009400 con 0x7fbd540c4e80 2024-02-17T13:26:03.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.263+0000 7fbd5259c640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 0x7fbd54154fc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009890 tx=0x7fbd480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.267+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4803b980 con 0x7fbd540c4e80 2024-02-17T13:26:03.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.267+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4803bb00 con 0x7fbd540c4e80 2024-02-17T13:26:03.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.267+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48045400 con 0x7fbd540c4e80 2024-02-17T13:26:03.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.267+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd54146640 con 0x7fbd540c4e80 2024-02-17T13:26:03.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.267+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd541ed2e0 con 0x7fbd540c4e80 2024-02-17T13:26:03.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.268+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd541ed4a0 con 0x7fbd540c4e80 2024-02-17T13:26:03.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.287+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbd4804e440 con 0x7fbd540c4e80 2024-02-17T13:26:03.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.288+0000 7fbd3b7fe640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbd4006b860 0x7fbd4006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.288+0000 7fbd52d9d640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbd4006b860 0x7fbd4006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.288+0000 7fbd52d9d640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbd4006b860 0x7fbd4006dd20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd440113e0 tx=0x7fbd4400b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.532+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fbd4807adb0 con 0x7fbd540c4e80 2024-02-17T13:26:03.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.532+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd48077050 con 0x7fbd540c4e80 2024-02-17T13:26:03.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.702+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd540c4960 con 0x7fbd4006b860 2024-02-17T13:26:03.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.702+0000 7fbd3b7fe640 1 -- 172.21.15.136:0/1021144072 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd4400f040 con 0x7fbd4006b860 2024-02-17T13:26:03.702 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 5 to deep-scrub 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbd4006b860 msgr2=0x7fbd4006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbd4006b860 0x7fbd4006dd20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd440113e0 tx=0x7fbd4400b040 comp rx=0 tx=0).stop 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 msgr2=0x7fbd54154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 0x7fbd54154fc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009890 tx=0x7fbd480046c0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 shutdown_connections 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbd4006b860 0x7fbd4006dd20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd54150b50 0x7fbd54145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd540c4e80 0x7fbd54154fc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 --2- 172.21.15.136:0/1021144072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd5406aac0 0x7fbd54144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 >> 172.21.15.136:0/1021144072 conn(0x7fbd540c7e90 msgr2=0x7fbd5406af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:03.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 shutdown_connections 2024-02-17T13:26:03.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.704+0000 7fbd591d7640 1 -- 172.21.15.136:0/1021144072 wait complete. 2024-02-17T13:26:03.715 INFO:tasks.ceph:Scrubbing osd.6 2024-02-17T13:26:03.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:26:03.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.838+0000 7f2baed72640 1 Processor -- start 2024-02-17T13:26:03.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.839+0000 7f2baed72640 1 -- start start 2024-02-17T13:26:03.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.839+0000 7f2baed72640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba81579f0 0x7f2ba80c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.839+0000 7f2baed72640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba806aac0 con 0x7f2ba80c2cc0 2024-02-17T13:26:03.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.839+0000 7f2baed72640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba80c35d0 con 0x7f2ba8151b00 2024-02-17T13:26:03.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.839+0000 7f2baed72640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8151ee0 con 0x7f2ba81579f0 2024-02-17T13:26:03.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.840+0000 7f2ba7fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba81579f0 0x7f2ba80c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.840+0000 7f2bacb0e640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f2ba8151b00 0x7f2ba80c3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:54390/0 (socket says 172.21.15.136:54390) 2024-02-17T13:26:03.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.840+0000 7f2bacb0e640 1 -- 172.21.15.136:0/2480026637 learned_addr learned my addr 172.21.15.136:0/2480026637 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:03.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.843+0000 7f2ba77fe640 1 -- 172.21.15.136:0/2480026637 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427500966 0 0) 0x7f2ba80c35d0 con 0x7f2ba8151b00 2024-02-17T13:26:03.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.843+0000 7f2ba77fe640 1 -- 172.21.15.136:0/2480026637 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b98003520 con 0x7f2ba8151b00 2024-02-17T13:26:03.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.843+0000 7f2ba7fff640 1 -- 172.21.15.136:0/2480026637 >> v1:172.21.15.160:6789/0 conn(0x7f2ba8151b00 legacy=0x7f2ba80c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.843+0000 7f2ba7fff640 1 -- 172.21.15.136:0/2480026637 >> v1:172.21.15.136:6789/0 conn(0x7f2ba80c2cc0 legacy=0x7f2ba8162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:03.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.843+0000 7f2ba7fff640 1 -- 172.21.15.136:0/2480026637 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80c38b0 con 0x7f2ba81579f0 2024-02-17T13:26:03.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.846+0000 7f2ba7fff640 1 --2- 172.21.15.136:0/2480026637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba81579f0 0x7f2ba80c61c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2b940097d0 tx=0x7f2b9402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2379ae66056b432c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.849+0000 7f2ba77fe640 1 -- 172.21.15.136:0/2480026637 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94031770 con 0x7f2ba81579f0 2024-02-17T13:26:03.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.849+0000 7f2ba77fe640 1 -- 172.21.15.136:0/2480026637 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940318d0 con 0x7f2ba81579f0 2024-02-17T13:26:03.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.849+0000 7f2ba77fe640 1 -- 172.21.15.136:0/2480026637 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94031c60 con 0x7f2ba81579f0 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 -- 172.21.15.136:0/2480026637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba81579f0 msgr2=0x7f2ba80c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 --2- 172.21.15.136:0/2480026637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba81579f0 0x7f2ba80c61c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2b940097d0 tx=0x7f2b9402b810 comp rx=0 tx=0).stop 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 -- 172.21.15.136:0/2480026637 shutdown_connections 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 --2- 172.21.15.136:0/2480026637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba81579f0 0x7f2ba80c61c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 -- 172.21.15.136:0/2480026637 >> 172.21.15.136:0/2480026637 conn(0x7f2ba806e960 msgr2=0x7f2ba806ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 -- 172.21.15.136:0/2480026637 shutdown_connections 2024-02-17T13:26:03.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.850+0000 7f2baed72640 1 -- 172.21.15.136:0/2480026637 wait complete. 2024-02-17T13:26:03.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.851+0000 7f2baed72640 1 Processor -- start 2024-02-17T13:26:03.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.851+0000 7f2baed72640 1 -- start start 2024-02-17T13:26:03.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.852+0000 7f2baed72640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba80c2cc0 0x7f2ba81e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.852+0000 7f2baed72640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba8151b00 0x7f2ba8154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.852+0000 7f2baed72640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ba81579f0 0x7f2ba8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.852+0000 7f2baed72640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba8152a50 con 0x7f2ba81579f0 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.852+0000 7f2baed72640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81538e0 con 0x7f2ba8151b00 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.852+0000 7f2baed72640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81543b0 con 0x7f2ba80c2cc0 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.853+0000 7f2bad30f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ba81579f0 0x7f2ba8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.853+0000 7f2ba7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba8151b00 0x7f2ba8154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.853+0000 7f2bad30f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ba81579f0 0x7f2ba8154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46440/0 (socket says 172.21.15.136:46440) 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.853+0000 7f2bad30f640 1 -- 172.21.15.136:0/3417589381 learned_addr learned my addr 172.21.15.136:0/3417589381 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:03.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.854+0000 7f2bacb0e640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba80c2cc0 0x7f2ba81e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.856+0000 7f2bad30f640 1 -- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba80c2cc0 msgr2=0x7f2ba81e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.856+0000 7f2bad30f640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba80c2cc0 0x7f2ba81e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.856+0000 7f2bad30f640 1 -- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba8151b00 msgr2=0x7f2ba8154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.856+0000 7f2bad30f640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba8151b00 0x7f2ba8154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.856+0000 7f2bad30f640 1 -- 172.21.15.136:0/3417589381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009400 con 0x7f2ba81579f0 2024-02-17T13:26:03.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.858+0000 7f2bad30f640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ba81579f0 0x7f2ba8154d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b9e0 tx=0x7f2ba000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.862+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000cb20 con 0x7f2ba81579f0 2024-02-17T13:26:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.862+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000cc80 con 0x7f2ba81579f0 2024-02-17T13:26:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.862+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0014680 con 0x7f2ba81579f0 2024-02-17T13:26:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.862+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba81e4730 con 0x7f2ba81579f0 2024-02-17T13:26:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.862+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba8147d30 con 0x7f2ba81579f0 2024-02-17T13:26:03.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.863+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ba8158460 con 0x7f2ba81579f0 2024-02-17T13:26:03.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.882+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2ba001d3b0 con 0x7f2ba81579f0 2024-02-17T13:26:03.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.882+0000 7f2ba57fa640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b8c06b860 0x7f2b8c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.882+0000 7f2bacb0e640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b8c06b860 0x7f2b8c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.883+0000 7f2bacb0e640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b8c06b860 0x7f2b8c06dd20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c005880 tx=0x7f2b9c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.891+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f2ba000ce30 con 0x7f2ba81579f0 2024-02-17T13:26:03.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.892+0000 7f2ba57fa640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f2b8c075070 0x7f2b8c077510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:03.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.892+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 --> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8c077be0 con 0x7f2b8c075070 2024-02-17T13:26:03.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.892+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ba00552b0 con 0x7f2ba81579f0 2024-02-17T13:26:03.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.892+0000 7f2ba7fff640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f2b8c075070 0x7f2b8c077510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:03.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.892+0000 7f2ba7fff640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f2b8c075070 0x7f2b8c077510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:03.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.893+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== osd.6 v2:172.21.15.160:6824/2024415336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2b8c077be0 con 0x7f2b8c075070 2024-02-17T13:26:03.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.907+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 --> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ba8158180 con 0x7f2b8c075070 2024-02-17T13:26:03.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2ba57fa640 1 -- 172.21.15.136:0/3417589381 <== osd.6 v2:172.21.15.160:6824/2024415336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2b94031a40 con 0x7f2b8c075070 2024-02-17T13:26:03.908 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:03.908 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:03.908 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f2b8c075070 msgr2=0x7f2b8c077510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.160:6824/2024415336,v1:172.21.15.160:6825/2024415336] conn(0x7f2b8c075070 0x7f2b8c077510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b8c06b860 msgr2=0x7f2b8c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b8c06b860 0x7f2b8c06dd20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c005880 tx=0x7f2b9c009040 comp rx=0 tx=0).stop 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ba81579f0 msgr2=0x7f2ba8154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 --2- 172.21.15.136:0/3417589381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ba81579f0 0x7f2ba8154d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b9e0 tx=0x7f2ba000bea0 comp rx=0 tx=0).stop 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2bad30f640 1 -- 172.21.15.136:0/3417589381 reap_dead start 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 shutdown_connections 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.908+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 >> 172.21.15.136:0/3417589381 conn(0x7f2ba806e960 msgr2=0x7f2ba80c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:03.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.909+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 shutdown_connections 2024-02-17T13:26:03.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:03.909+0000 7f2baed72640 1 -- 172.21.15.136:0/3417589381 wait complete. 2024-02-17T13:26:03.919 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-17T13:26:04.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.022+0000 7f19b6af4640 1 Processor -- start 2024-02-17T13:26:04.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.022+0000 7f19b6af4640 1 -- start start 2024-02-17T13:26:04.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.023+0000 7f19b6af4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f19b00c9730 0x7f19b00cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.023+0000 7f19b6af4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b00c8b60 con 0x7f19b0157690 2024-02-17T13:26:04.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.023+0000 7f19b6af4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b015a030 con 0x7f19b01572b0 2024-02-17T13:26:04.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.023+0000 7f19b6af4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b0159e40 con 0x7f19b00c9730 2024-02-17T13:26:04.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.024+0000 7f19b4890640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f19b01572b0 0x7f19b006afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:54392/0 (socket says 172.21.15.136:54392) 2024-02-17T13:26:04.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.024+0000 7f19b4890640 1 -- 172.21.15.136:0/2550404944 learned_addr learned my addr 172.21.15.136:0/2550404944 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:04.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.024+0000 7f19b5091640 1 --2- 172.21.15.136:0/2550404944 >> v2:172.21.15.136:3300/0 conn(0x7f19b00c9730 0x7f19b00cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.026+0000 7f19af7fe640 1 -- 172.21.15.136:0/2550404944 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605833073 0 0) 0x7f19b015a030 con 0x7f19b01572b0 2024-02-17T13:26:04.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.026+0000 7f19af7fe640 1 -- 172.21.15.136:0/2550404944 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1998003520 con 0x7f19b01572b0 2024-02-17T13:26:04.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.028+0000 7f19b5091640 1 -- 172.21.15.136:0/2550404944 >> v1:172.21.15.160:6789/0 conn(0x7f19b01572b0 legacy=0x7f19b006afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.028+0000 7f19b5091640 1 -- 172.21.15.136:0/2550404944 >> v1:172.21.15.136:6789/0 conn(0x7f19b0157690 legacy=0x7f19b00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.028+0000 7f19b5091640 1 -- 172.21.15.136:0/2550404944 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b015a310 con 0x7f19b00c9730 2024-02-17T13:26:04.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.032+0000 7f19b5091640 1 --2- 172.21.15.136:0/2550404944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00cc260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009d90 tx=0x7f19a802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc32bf52de95953a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19af7fe640 1 -- 172.21.15.136:0/2550404944 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a802cd00 con 0x7f19b00c9730 2024-02-17T13:26:04.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19af7fe640 1 -- 172.21.15.136:0/2550404944 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a802ce60 con 0x7f19b00c9730 2024-02-17T13:26:04.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19af7fe640 1 -- 172.21.15.136:0/2550404944 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8034660 con 0x7f19b00c9730 2024-02-17T13:26:04.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 -- 172.21.15.136:0/2550404944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 msgr2=0x7f19b00cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2550404944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00cc260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009d90 tx=0x7f19a802bf50 comp rx=0 tx=0).stop 2024-02-17T13:26:04.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 -- 172.21.15.136:0/2550404944 shutdown_connections 2024-02-17T13:26:04.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2550404944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00cc260 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 -- 172.21.15.136:0/2550404944 >> 172.21.15.136:0/2550404944 conn(0x7f19b006bbd0 msgr2=0x7f19b006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:04.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 -- 172.21.15.136:0/2550404944 shutdown_connections 2024-02-17T13:26:04.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.036+0000 7f19b6af4640 1 -- 172.21.15.136:0/2550404944 wait complete. 2024-02-17T13:26:04.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 Processor -- start 2024-02-17T13:26:04.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 -- start start 2024-02-17T13:26:04.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b01572b0 0x7f19b01587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b0157690 0x7f19b00cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00cb030 con 0x7f19b00c9730 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01f35d0 con 0x7f19b01572b0 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.038+0000 7f19b6af4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00cc230 con 0x7f19b0157690 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.039+0000 7f19b4890640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.039+0000 7f19affff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b01572b0 0x7f19b01587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.039+0000 7f19b5091640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b0157690 0x7f19b00cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.039+0000 7f19b4890640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46452/0 (socket says 172.21.15.136:46452) 2024-02-17T13:26:04.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.039+0000 7f19b4890640 1 -- 172.21.15.136:0/2372638380 learned_addr learned my addr 172.21.15.136:0/2372638380 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:04.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.042+0000 7f19affff640 1 -- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b0157690 msgr2=0x7f19b00cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.042+0000 7f19affff640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b0157690 0x7f19b00cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.042+0000 7f19affff640 1 -- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 msgr2=0x7f19b00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.042+0000 7f19affff640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.042+0000 7f19affff640 1 -- 172.21.15.136:0/2372638380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8009a70 con 0x7f19b01572b0 2024-02-17T13:26:04.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.045+0000 7f19affff640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b01572b0 0x7f19b01587c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c390 tx=0x7f19a400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.048+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40052d0 con 0x7f19b01572b0 2024-02-17T13:26:04.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.048+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005450 con 0x7f19b01572b0 2024-02-17T13:26:04.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.048+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4007260 con 0x7f19b01572b0 2024-02-17T13:26:04.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.048+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b0159850 con 0x7f19b01572b0 2024-02-17T13:26:04.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.048+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b01f2f80 con 0x7f19b01572b0 2024-02-17T13:26:04.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.049+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b01f3780 con 0x7f19b01572b0 2024-02-17T13:26:04.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.068+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f19a40073c0 con 0x7f19b01572b0 2024-02-17T13:26:04.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.069+0000 7f19ad7fa640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f199c06b890 0x7f199c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.069+0000 7f19b4890640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f199c06b890 0x7f199c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.069+0000 7f19b4890640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f199c06b890 0x7f199c06dd50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19a00011e0 tx=0x7f19a0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.071+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f19a4058270 con 0x7f19b01572b0 2024-02-17T13:26:04.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.307+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19a4054510 con 0x7f19b01572b0 2024-02-17T13:26:04.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.482+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b015a8d0 con 0x7f199c06b890 2024-02-17T13:26:04.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.483+0000 7f19ad7fa640 1 -- 172.21.15.136:0/2372638380 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19a000f820 con 0x7f199c06b890 2024-02-17T13:26:04.483 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 6 to deep-scrub 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f199c06b890 msgr2=0x7f199c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f199c06b890 0x7f199c06dd50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19a00011e0 tx=0x7f19a0009040 comp rx=0 tx=0).stop 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b01572b0 msgr2=0x7f19b01587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b01572b0 0x7f19b01587c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c390 tx=0x7f19a400c850 comp rx=0 tx=0).stop 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 shutdown_connections 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f199c06b890 0x7f199c06dd50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b0157690 0x7f19b00cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b01572b0 0x7f19b01587c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 --2- 172.21.15.136:0/2372638380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19b00c9730 0x7f19b00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 >> 172.21.15.136:0/2372638380 conn(0x7f19b006bbd0 msgr2=0x7f19b00c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 shutdown_connections 2024-02-17T13:26:04.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.485+0000 7f19b6af4640 1 -- 172.21.15.136:0/2372638380 wait complete. 2024-02-17T13:26:04.496 INFO:tasks.ceph:Scrubbing osd.7 2024-02-17T13:26:04.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-17T13:26:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.600+0000 7f2bb650f640 1 Processor -- start 2024-02-17T13:26:04.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.600+0000 7f2bb650f640 1 -- start start 2024-02-17T13:26:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.601+0000 7f2bb650f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb0154120 0x7f2bb00c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.601+0000 7f2bb650f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2bb00c7490 0x7f2bb00cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.601+0000 7f2bb650f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb00c71e0 con 0x7f2bb00c78b0 2024-02-17T13:26:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.601+0000 7f2bb650f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb015dbd0 con 0x7f2bb00c7490 2024-02-17T13:26:04.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.601+0000 7f2bb650f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c6f00 con 0x7f2bb0154120 2024-02-17T13:26:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.602+0000 7f2bb4aac640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2bb00c78b0 0x7f2bb00ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54318/0 (socket says 172.21.15.136:54318) 2024-02-17T13:26:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.602+0000 7f2bb4aac640 1 -- 172.21.15.136:0/854557438 learned_addr learned my addr 172.21.15.136:0/854557438 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.602+0000 7f2baffff640 1 --2- 172.21.15.136:0/854557438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb0154120 0x7f2bb00c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.602+0000 7f2baf7fe640 1 --2- 172.21.15.136:0/854557438 >> v2:172.21.15.160:3300/0 conn(0x7f2bb00c7490 0x7f2bb00cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.604+0000 7f2baeffd640 1 -- 172.21.15.136:0/854557438 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503574765 0 0) 0x7f2bb00c71e0 con 0x7f2bb00c78b0 2024-02-17T13:26:04.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.604+0000 7f2baeffd640 1 -- 172.21.15.136:0/854557438 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b98003520 con 0x7f2bb00c78b0 2024-02-17T13:26:04.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.605+0000 7f2baffff640 1 -- 172.21.15.136:0/854557438 >> v2:172.21.15.160:3300/0 conn(0x7f2bb00c7490 msgr2=0x7f2bb00cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:04.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.605+0000 7f2baffff640 1 --2- 172.21.15.136:0/854557438 >> v2:172.21.15.160:3300/0 conn(0x7f2bb00c7490 0x7f2bb00cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.605+0000 7f2baffff640 1 -- 172.21.15.136:0/854557438 >> v1:172.21.15.136:6789/0 conn(0x7f2bb00c78b0 legacy=0x7f2bb00ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.605+0000 7f2baffff640 1 -- 172.21.15.136:0/854557438 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb015d2a0 con 0x7f2bb0154120 2024-02-17T13:26:04.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.607+0000 7f2baffff640 1 --2- 172.21.15.136:0/854557438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb0154120 0x7f2bb00c6850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00097a0 tx=0x7f2ba002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365ded20c77f299b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2baeffd640 1 -- 172.21.15.136:0/854557438 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0031830 con 0x7f2bb0154120 2024-02-17T13:26:04.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2baeffd640 1 -- 172.21.15.136:0/854557438 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0031990 con 0x7f2bb0154120 2024-02-17T13:26:04.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2baeffd640 1 -- 172.21.15.136:0/854557438 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0031d20 con 0x7f2bb0154120 2024-02-17T13:26:04.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 -- 172.21.15.136:0/854557438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb0154120 msgr2=0x7f2bb00c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 --2- 172.21.15.136:0/854557438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb0154120 0x7f2bb00c6850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00097a0 tx=0x7f2ba002b8d0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 -- 172.21.15.136:0/854557438 shutdown_connections 2024-02-17T13:26:04.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 --2- 172.21.15.136:0/854557438 >> v2:172.21.15.160:3300/0 conn(0x7f2bb00c7490 0x7f2bb00cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 --2- 172.21.15.136:0/854557438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb0154120 0x7f2bb00c6850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 -- 172.21.15.136:0/854557438 >> 172.21.15.136:0/854557438 conn(0x7f2bb006d450 msgr2=0x7f2bb006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:04.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 -- 172.21.15.136:0/854557438 shutdown_connections 2024-02-17T13:26:04.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.611+0000 7f2bb650f640 1 -- 172.21.15.136:0/854557438 wait complete. 2024-02-17T13:26:04.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 Processor -- start 2024-02-17T13:26:04.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 -- start start 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb00c7490 0x7f2bb00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb00c78b0 0x7f2bb01596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bb0154120 0x7f2bb01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00cf8f0 con 0x7f2bb00c78b0 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00cdfd0 con 0x7f2bb0154120 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.613+0000 7f2bb650f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00cd890 con 0x7f2bb00c7490 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.614+0000 7f2baf7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb00c78b0 0x7f2bb01596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.614+0000 7f2baffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb00c7490 0x7f2bb00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.614+0000 7f2bb4aac640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bb0154120 0x7f2bb01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.614+0000 7f2baf7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb00c78b0 0x7f2bb01596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46466/0 (socket says 172.21.15.136:46466) 2024-02-17T13:26:04.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.614+0000 7f2baf7fe640 1 -- 172.21.15.136:0/1113570794 learned_addr learned my addr 172.21.15.136:0/1113570794 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:04.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.618+0000 7f2baf7fe640 1 -- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb00c7490 msgr2=0x7f2bb00ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.618+0000 7f2baf7fe640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bb00c7490 0x7f2bb00ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.618+0000 7f2baf7fe640 1 -- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bb0154120 msgr2=0x7f2bb01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.618+0000 7f2baf7fe640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bb0154120 0x7f2bb01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.618+0000 7f2baf7fe640 1 -- 172.21.15.136:0/1113570794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009400 con 0x7f2bb00c78b0 2024-02-17T13:26:04.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.620+0000 7f2baf7fe640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb00c78b0 0x7f2bb01596f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400e900 tx=0x7f2ba400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.623+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4009660 con 0x7f2bb00c78b0 2024-02-17T13:26:04.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.623+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400ca00 con 0x7f2bb00c78b0 2024-02-17T13:26:04.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.623+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400cd70 con 0x7f2bb00c78b0 2024-02-17T13:26:04.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.623+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb00cf330 con 0x7f2bb00c78b0 2024-02-17T13:26:04.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.624+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb00cd550 con 0x7f2bb00c78b0 2024-02-17T13:26:04.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.624+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bb015e060 con 0x7f2bb00c78b0 2024-02-17T13:26:04.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.642+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2ba4013470 con 0x7f2bb00c78b0 2024-02-17T13:26:04.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.642+0000 7f2bacff9640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b9c06b860 0x7f2b9c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.643+0000 7f2baffff640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b9c06b860 0x7f2b9c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.643+0000 7f2baffff640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b9c06b860 0x7f2b9c06dd20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0036000 tx=0x7f2ba003c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.646+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f2ba4059500 con 0x7f2bb00c78b0 2024-02-17T13:26:04.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.646+0000 7f2bacff9640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f2b9c075070 0x7f2b9c077510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.646+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 --> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b9c077be0 con 0x7f2b9c075070 2024-02-17T13:26:04.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.646+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ba40557a0 con 0x7f2bb00c78b0 2024-02-17T13:26:04.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.647+0000 7f2bb4aac640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f2b9c075070 0x7f2b9c077510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.647+0000 7f2bb4aac640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f2b9c075070 0x7f2b9c077510 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.648+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== osd.7 v2:172.21.15.160:6814/2434888201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2b9c077be0 con 0x7f2b9c075070 2024-02-17T13:26:04.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.661+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 --> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2bb015d860 con 0x7f2b9c075070 2024-02-17T13:26:04.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bacff9640 1 -- 172.21.15.136:0/1113570794 <== osd.7 v2:172.21.15.160:6814/2434888201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ba8002010 con 0x7f2b9c075070 2024-02-17T13:26:04.662 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-02-17T13:26:04.662 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T13:26:04.662 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f2b9c075070 msgr2=0x7f2b9c077510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.160:6814/2434888201,v1:172.21.15.160:6816/2434888201] conn(0x7f2b9c075070 0x7f2b9c077510 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b9c06b860 msgr2=0x7f2b9c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f2b9c06b860 0x7f2b9c06dd20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0036000 tx=0x7f2ba003c040 comp rx=0 tx=0).stop 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb00c78b0 msgr2=0x7f2bb01596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 --2- 172.21.15.136:0/1113570794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb00c78b0 0x7f2bb01596f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400e900 tx=0x7f2ba400edc0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb4aac640 1 -- 172.21.15.136:0/1113570794 reap_dead start 2024-02-17T13:26:04.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 shutdown_connections 2024-02-17T13:26:04.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.662+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 >> 172.21.15.136:0/1113570794 conn(0x7f2bb006d450 msgr2=0x7f2bb006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:04.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.663+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 shutdown_connections 2024-02-17T13:26:04.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.663+0000 7f2bb650f640 1 -- 172.21.15.136:0/1113570794 wait complete. 2024-02-17T13:26:04.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-17T13:26:04.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.781+0000 7f8c11156640 1 Processor -- start 2024-02-17T13:26:04.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.781+0000 7f8c11156640 1 -- start start 2024-02-17T13:26:04.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c11156640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8c0c06f4f0 0x7f8c0c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c11156640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c06c260 con 0x7f8c0c0aff30 2024-02-17T13:26:04.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c11156640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c15a1a0 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c11156640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c06dbe0 con 0x7f8c0c06f4f0 2024-02-17T13:26:04.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c0b59e640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f8c0c0aff30 0x7f8c0c070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54328/0 (socket says 172.21.15.136:54328) 2024-02-17T13:26:04.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c0b59e640 1 -- 172.21.15.136:0/2847284932 learned_addr learned my addr 172.21.15.136:0/2847284932 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:04.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.782+0000 7f8c0ad9d640 1 --2- 172.21.15.136:0/2847284932 >> v2:172.21.15.160:3300/0 conn(0x7f8c0c06f4f0 0x7f8c0c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.785+0000 7f8c0a59c640 1 -- 172.21.15.136:0/2847284932 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267519471 0 0) 0x7f8c0c06c260 con 0x7f8c0c0aff30 2024-02-17T13:26:04.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.785+0000 7f8c0a59c640 1 -- 172.21.15.136:0/2847284932 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf8003520 con 0x7f8c0c0aff30 2024-02-17T13:26:04.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.786+0000 7f8c0ad9d640 1 -- 172.21.15.136:0/2847284932 >> v1:172.21.15.160:6789/0 conn(0x7f8c0c06f8d0 legacy=0x7f8c0c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.786+0000 7f8c0ad9d640 1 -- 172.21.15.136:0/2847284932 >> v1:172.21.15.136:6789/0 conn(0x7f8c0c0aff30 legacy=0x7f8c0c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.786+0000 7f8c0ad9d640 1 -- 172.21.15.136:0/2847284932 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c15a480 con 0x7f8c0c06f4f0 2024-02-17T13:26:04.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.789+0000 7f8c0ad9d640 1 --2- 172.21.15.136:0/2847284932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c06bbd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0097a0 tx=0x7f8bfc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f49e781f4d4aa4a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.793+0000 7f8c0a59c640 1 -- 172.21.15.136:0/2847284932 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc02f810 con 0x7f8c0c06f4f0 2024-02-17T13:26:04.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.793+0000 7f8c0a59c640 1 -- 172.21.15.136:0/2847284932 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc02f970 con 0x7f8c0c06f4f0 2024-02-17T13:26:04.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.793+0000 7f8c0a59c640 1 -- 172.21.15.136:0/2847284932 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc02fd00 con 0x7f8c0c06f4f0 2024-02-17T13:26:04.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 -- 172.21.15.136:0/2847284932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 msgr2=0x7f8c0c06bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 --2- 172.21.15.136:0/2847284932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c06bbd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0097a0 tx=0x7f8bfc02b9f0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 -- 172.21.15.136:0/2847284932 shutdown_connections 2024-02-17T13:26:04.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 --2- 172.21.15.136:0/2847284932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c06bbd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 -- 172.21.15.136:0/2847284932 >> 172.21.15.136:0/2847284932 conn(0x7f8c0c06b0f0 msgr2=0x7f8c0c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:04.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 -- 172.21.15.136:0/2847284932 shutdown_connections 2024-02-17T13:26:04.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.794+0000 7f8c11156640 1 -- 172.21.15.136:0/2847284932 wait complete. 2024-02-17T13:26:04.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.795+0000 7f8c11156640 1 Processor -- start 2024-02-17T13:26:04.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.795+0000 7f8c11156640 1 -- start start 2024-02-17T13:26:04.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.796+0000 7f8c11156640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.796+0000 7f8c11156640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 0x7f8c0c144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.796+0000 7f8c11156640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c0c0aff30 0x7f8c0c1451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.796+0000 7f8c11156640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0c6610 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.796+0000 7f8c11156640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1ef840 con 0x7f8c0c06f4f0 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.796+0000 7f8c11156640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1efb20 con 0x7f8c0c0aff30 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.797+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 0x7f8c0c144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.797+0000 7f8c0ad9d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.797+0000 7f8c0b59e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c0c0aff30 0x7f8c0c1451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.797+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 0x7f8c0c144ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46480/0 (socket says 172.21.15.136:46480) 2024-02-17T13:26:04.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.797+0000 7f8c03fff640 1 -- 172.21.15.136:0/604305383 learned_addr learned my addr 172.21.15.136:0/604305383 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:04.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.800+0000 7f8c03fff640 1 -- 172.21.15.136:0/604305383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c0c0aff30 msgr2=0x7f8c0c1451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.800+0000 7f8c03fff640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c0c0aff30 0x7f8c0c1451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.800+0000 7f8c03fff640 1 -- 172.21.15.136:0/604305383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 msgr2=0x7f8c0c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:04.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.800+0000 7f8c03fff640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c0c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:04.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.800+0000 7f8c03fff640 1 -- 172.21.15.136:0/604305383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009400 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.803+0000 7f8c03fff640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 0x7f8c0c144ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c400 tx=0x7f8bf400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:04.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.807+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40052d0 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.807+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4005450 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.807+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c1efe00 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.807+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4007260 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.807+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c1f03c0 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.808+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c1f0580 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.828+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8bf40073c0 con 0x7f8c0c06f8d0 2024-02-17T13:26:04.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.828+0000 7f8c037fe640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f8bec06b860 0x7f8bec06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.828+0000 7f8c0ad9d640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f8bec06b860 0x7f8bec06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:04.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:04.829+0000 7f8c0ad9d640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f8bec06b860 0x7f8bec06dd20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc036000 tx=0x7f8bfc008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:05.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.071+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f8bf4007670 con 0x7f8c0c06f8d0 2024-02-17T13:26:05.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.071+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8bf40548d0 con 0x7f8c0c06f8d0 2024-02-17T13:26:05.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.259+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c0c15aa40 con 0x7f8bec06b860 2024-02-17T13:26:05.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.260+0000 7f8c037fe640 1 -- 172.21.15.136:0/604305383 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8bfc02fb60 con 0x7f8bec06b860 2024-02-17T13:26:05.260 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 7 to deep-scrub 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f8bec06b860 msgr2=0x7f8bec06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f8bec06b860 0x7f8bec06dd20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc036000 tx=0x7f8bfc008030 comp rx=0 tx=0).stop 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 msgr2=0x7f8c0c144ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 0x7f8c0c144ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c400 tx=0x7f8bf400c8c0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 shutdown_connections 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f8bec06b860 0x7f8bec06dd20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c0c0aff30 0x7f8c0c1451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c0c06f8d0 0x7f8c0c144ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 --2- 172.21.15.136:0/604305383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c0c06f4f0 0x7f8c0c0c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 >> 172.21.15.136:0/604305383 conn(0x7f8c0c06b0f0 msgr2=0x7f8c0c070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:05.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 shutdown_connections 2024-02-17T13:26:05.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.262+0000 7f8c11156640 1 -- 172.21.15.136:0/604305383 wait complete. 2024-02-17T13:26:05.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T13:26:05.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.375+0000 7f59997e9640 1 Processor -- start 2024-02-17T13:26:05.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.375+0000 7f59997e9640 1 -- start start 2024-02-17T13:26:05.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.376+0000 7f59997e9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f599406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:05.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.376+0000 7f59997e9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f59941624d0 0x7f59941648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:05.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.376+0000 7f59997e9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59940cb470 con 0x7f59940ca4e0 2024-02-17T13:26:05.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.376+0000 7f59997e9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59940cb750 con 0x7f59941624d0 2024-02-17T13:26:05.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.376+0000 7f59997e9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599415d1f0 con 0x7f59940cbc00 2024-02-17T13:26:05.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.376+0000 7f5992ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f599406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:05.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.377+0000 7f59937fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f59941624d0 0x7f59941648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:05.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.377+0000 7f598a7fc640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f59940ca4e0 0x7f59940cbfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54336/0 (socket says 172.21.15.136:54336) 2024-02-17T13:26:05.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.377+0000 7f598a7fc640 1 -- 172.21.15.136:0/3942583079 learned_addr learned my addr 172.21.15.136:0/3942583079 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:05.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.379+0000 7f5992ffd640 1 -- 172.21.15.136:0/3942583079 >> v2:172.21.15.136:3300/0 conn(0x7f59941624d0 msgr2=0x7f59941648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:05.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.379+0000 7f5992ffd640 1 --2- 172.21.15.136:0/3942583079 >> v2:172.21.15.136:3300/0 conn(0x7f59941624d0 0x7f59941648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.379+0000 7f5992ffd640 1 -- 172.21.15.136:0/3942583079 >> v1:172.21.15.136:6789/0 conn(0x7f59940ca4e0 legacy=0x7f59940cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.379+0000 7f5992ffd640 1 -- 172.21.15.136:0/3942583079 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599415d4d0 con 0x7f59940cbc00 2024-02-17T13:26:05.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.381+0000 7f5992ffd640 1 --2- 172.21.15.136:0/3942583079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f599406acd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f59840097a0 tx=0x7f598402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2252cfde4d1f0e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:05.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.385+0000 7f59927fc640 1 -- 172.21.15.136:0/3942583079 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984030610 con 0x7f59940cbc00 2024-02-17T13:26:05.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.385+0000 7f59927fc640 1 -- 172.21.15.136:0/3942583079 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984030770 con 0x7f59940cbc00 2024-02-17T13:26:05.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.385+0000 7f59927fc640 1 -- 172.21.15.136:0/3942583079 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984030b00 con 0x7f59940cbc00 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 -- 172.21.15.136:0/3942583079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 msgr2=0x7f599406acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 --2- 172.21.15.136:0/3942583079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f599406acd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f59840097a0 tx=0x7f598402b960 comp rx=0 tx=0).stop 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 -- 172.21.15.136:0/3942583079 shutdown_connections 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 --2- 172.21.15.136:0/3942583079 >> v2:172.21.15.136:3300/0 conn(0x7f59941624d0 0x7f59941648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 --2- 172.21.15.136:0/3942583079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f599406acd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 -- 172.21.15.136:0/3942583079 >> 172.21.15.136:0/3942583079 conn(0x7f59940721f0 msgr2=0x7f59940725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:05.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 -- 172.21.15.136:0/3942583079 shutdown_connections 2024-02-17T13:26:05.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.386+0000 7f59997e9640 1 -- 172.21.15.136:0/3942583079 wait complete. 2024-02-17T13:26:05.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.387+0000 7f59997e9640 1 Processor -- start 2024-02-17T13:26:05.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.387+0000 7f59997e9640 1 -- start start 2024-02-17T13:26:05.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.388+0000 7f59997e9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59940ca4e0 0x7f59940c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:05.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.388+0000 7f59997e9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f5994160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:05.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.388+0000 7f59997e9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59941624d0 0x7f5994161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:05.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.388+0000 7f59997e9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59941522f0 con 0x7f59941624d0 2024-02-17T13:26:05.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.388+0000 7f59997e9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5994154550 con 0x7f59940ca4e0 2024-02-17T13:26:05.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.388+0000 7f59997e9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5994154810 con 0x7f59940cbc00 2024-02-17T13:26:05.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.389+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f5994160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:05.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.389+0000 7f5992ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59940ca4e0 0x7f59940c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:05.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.389+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f5994160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.136:53806/0 (socket says 172.21.15.136:53806) 2024-02-17T13:26:05.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.389+0000 7f598a7fc640 1 -- 172.21.15.136:0/3481537592 learned_addr learned my addr 172.21.15.136:0/3481537592 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:05.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.389+0000 7f59937fe640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59941624d0 0x7f5994161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:05.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.392+0000 7f598a7fc640 1 -- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59940ca4e0 msgr2=0x7f59940c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.392+0000 7f598a7fc640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59940ca4e0 0x7f59940c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.392+0000 7f598a7fc640 1 -- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59941624d0 msgr2=0x7f5994161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.392+0000 7f598a7fc640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59941624d0 0x7f5994161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.392+0000 7f598a7fc640 1 -- 172.21.15.136:0/3481537592 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984009400 con 0x7f59940cbc00 2024-02-17T13:26:05.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.395+0000 7f598a7fc640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f5994160e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c400 tx=0x7f597c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:05.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.399+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0074e0 con 0x7f59940cbc00 2024-02-17T13:26:05.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.399+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c007640 con 0x7f59940cbc00 2024-02-17T13:26:05.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.399+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5994154af0 con 0x7f59940cbc00 2024-02-17T13:26:05.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.399+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0059a0 con 0x7f59940cbc00 2024-02-17T13:26:05.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.399+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59941550b0 con 0x7f59940cbc00 2024-02-17T13:26:05.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.400+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599404efc0 con 0x7f59940cbc00 2024-02-17T13:26:05.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.651+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f597c005b00 con 0x7f59940cbc00 2024-02-17T13:26:05.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.651+0000 7f598bfff640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f597406b810 0x7f597406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:05.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.651+0000 7f5992ffd640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f597406b810 0x7f597406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:05.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.652+0000 7f5992ffd640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f597406b810 0x7f597406dcd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5984036000 tx=0x7f5984008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:05.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.654+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f597c058720 con 0x7f59940cbc00 2024-02-17T13:26:05.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.664+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f597c0549c0 con 0x7f59940cbc00 2024-02-17T13:26:05.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.840+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5994160c30 con 0x7f597406b810 2024-02-17T13:26:05.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.849+0000 7f598bfff640 1 -- 172.21.15.136:0/3481537592 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368731 (secure 0 0 0) 0x7f5994160c30 con 0x7f597406b810 2024-02-17T13:26:05.853 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:26:05.856 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T13:26:05.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f597406b810 msgr2=0x7f597406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f597406b810 0x7f597406dcd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5984036000 tx=0x7f5984008030 comp rx=0 tx=0).stop 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 msgr2=0x7f5994160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f5994160e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c400 tx=0x7f597c00c8c0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 shutdown_connections 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f597406b810 0x7f597406dcd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59941624d0 0x7f5994161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59940cbc00 0x7f5994160e30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 --2- 172.21.15.136:0/3481537592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59940ca4e0 0x7f59940c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 >> 172.21.15.136:0/3481537592 conn(0x7f59940721f0 msgr2=0x7f599414ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 shutdown_connections 2024-02-17T13:26:05.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:05.854+0000 7f59997e9640 1 -- 172.21.15.136:0/3481537592 wait complete. 2024-02-17T13:26:05.865 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":870,"stamp":"2024-02-17T13:26:04.354461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39668340,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1020,"num_read_kb":1067,"num_write":15160,"num_write_kb":353160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16004,"ondisk_log_size":16004,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":465312,"kb_used_data":79904,"kb_used_omap":12,"kb_used_meta":385331,"kb_avail":754509408,"statfs":{"total":773094113280,"available":772617633792,"internally_reserved":0,"allocated":81821696,"data_stored":80248720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":394579504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1271,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002897"},"pg_stats":[{"pgid":"2.1f","version":"26'629","reported_seq":668,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:31.514596+0000","last_change":"2024-02-17T12:57:56.648064+0000","last_active":"2024-02-17T13:25:31.514596+0000","last_peered":"2024-02-17T13:25:31.514596+0000","last_clean":"2024-02-17T13:25:31.514596+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T13:25:31.514596+0000","last_undegraded":"2024-02-17T13:25:31.514596+0000","last_fullsized":"2024-02-17T13:25:31.514596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"26'28","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.381213+0000","last_change":"2024-02-17T12:57:57.802099+0000","last_active":"2024-02-17T13:25:49.381213+0000","last_peered":"2024-02-17T13:25:49.381213+0000","last_clean":"2024-02-17T13:25:49.381213+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T13:25:49.381213+0000","last_undegraded":"2024-02-17T13:25:49.381213+0000","last_fullsized":"2024-02-17T13:25:49.381213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:57:55.986030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'137","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.525946+0000","last_change":"2024-02-17T12:58:02.536134+0000","last_active":"2024-02-17T13:25:19.525946+0000","last_peered":"2024-02-17T13:25:19.525946+0000","last_clean":"2024-02-17T13:25:19.525946+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T13:25:19.525946+0000","last_undegraded":"2024-02-17T13:25:19.525946+0000","last_fullsized":"2024-02-17T13:25:19.525946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:08.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'680","reported_seq":720,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.460699+0000","last_change":"2024-02-17T12:57:56.658594+0000","last_active":"2024-02-17T13:25:28.460699+0000","last_peered":"2024-02-17T13:25:28.460699+0000","last_clean":"2024-02-17T13:25:28.460699+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T13:25:28.460699+0000","last_undegraded":"2024-02-17T13:25:28.460699+0000","last_fullsized":"2024-02-17T13:25:28.460699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":4495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.384035+0000","last_change":"2024-02-17T12:57:57.804196+0000","last_active":"2024-02-17T13:25:49.384035+0000","last_peered":"2024-02-17T13:25:49.384035+0000","last_clean":"2024-02-17T13:25:49.384035+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T13:25:49.384035+0000","last_undegraded":"2024-02-17T13:25:49.384035+0000","last_fullsized":"2024-02-17T13:25:49.384035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:03.355860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"26'131","reported_seq":161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.202080+0000","last_change":"2024-02-17T12:58:02.532386+0000","last_active":"2024-02-17T13:25:21.202080+0000","last_peered":"2024-02-17T13:25:21.202080+0000","last_clean":"2024-02-17T13:25:21.202080+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T13:25:21.202080+0000","last_undegraded":"2024-02-17T13:25:21.202080+0000","last_fullsized":"2024-02-17T13:25:21.202080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'1331","reported_seq":1369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:40.834671+0000","last_change":"2024-02-17T12:57:56.649652+0000","last_active":"2024-02-17T13:25:40.834671+0000","last_peered":"2024-02-17T13:25:40.834671+0000","last_clean":"2024-02-17T13:25:40.834671+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T13:25:40.834671+0000","last_undegraded":"2024-02-17T13:25:40.834671+0000","last_fullsized":"2024-02-17T13:25:40.834671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1331,"log_dups_size":0,"ondisk_log_size":1331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"26'31","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464994+0000","last_change":"2024-02-17T12:57:57.774178+0000","last_active":"2024-02-17T13:25:49.464994+0000","last_peered":"2024-02-17T13:25:49.464994+0000","last_clean":"2024-02-17T13:25:49.464994+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T13:25:49.464994+0000","last_undegraded":"2024-02-17T13:25:49.464994+0000","last_fullsized":"2024-02-17T13:25:49.464994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'136","reported_seq":173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:32.651683+0000","last_change":"2024-02-17T12:58:37.887403+0000","last_active":"2024-02-17T13:25:32.651683+0000","last_peered":"2024-02-17T13:25:32.651683+0000","last_clean":"2024-02-17T13:25:32.651683+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T13:25:32.651683+0000","last_undegraded":"2024-02-17T13:25:32.651683+0000","last_fullsized":"2024-02-17T13:25:32.651683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":9317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:31.538548+0000","last_change":"2024-02-17T12:57:56.651650+0000","last_active":"2024-02-17T13:25:31.538548+0000","last_peered":"2024-02-17T13:25:31.538548+0000","last_clean":"2024-02-17T13:25:31.538548+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T13:25:31.538548+0000","last_undegraded":"2024-02-17T13:25:31.538548+0000","last_fullsized":"2024-02-17T13:25:31.538548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"26'47","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.457707+0000","last_change":"2024-02-17T12:57:57.799947+0000","last_active":"2024-02-17T13:25:49.457707+0000","last_peered":"2024-02-17T13:25:49.457707+0000","last_clean":"2024-02-17T13:25:49.457707+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T13:25:49.457707+0000","last_undegraded":"2024-02-17T13:25:49.457707+0000","last_fullsized":"2024-02-17T13:25:49.457707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"26'132","reported_seq":162,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:32.651643+0000","last_change":"2024-02-17T12:58:02.533645+0000","last_active":"2024-02-17T13:25:32.651643+0000","last_peered":"2024-02-17T13:25:32.651643+0000","last_clean":"2024-02-17T13:25:32.651643+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T13:25:32.651643+0000","last_undegraded":"2024-02-17T13:25:32.651643+0000","last_fullsized":"2024-02-17T13:25:32.651643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":5852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.462972+0000","last_change":"2024-02-17T12:57:57.798827+0000","last_active":"2024-02-17T13:25:49.462972+0000","last_peered":"2024-02-17T13:25:49.462972+0000","last_clean":"2024-02-17T13:25:49.462972+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T13:25:49.462972+0000","last_undegraded":"2024-02-17T13:25:49.462972+0000","last_fullsized":"2024-02-17T13:25:49.462972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'621","reported_seq":660,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:40.856726+0000","last_change":"2024-02-17T12:57:56.651358+0000","last_active":"2024-02-17T13:25:40.856726+0000","last_peered":"2024-02-17T13:25:40.856726+0000","last_clean":"2024-02-17T13:25:40.856726+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T13:25:40.856726+0000","last_undegraded":"2024-02-17T13:25:40.856726+0000","last_fullsized":"2024-02-17T13:25:40.856726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'112","reported_seq":143,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.193581+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T13:25:21.193581+0000","last_peered":"2024-02-17T13:25:21.193581+0000","last_clean":"2024-02-17T13:25:21.193581+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T13:25:21.193581+0000","last_undegraded":"2024-02-17T13:25:21.193581+0000","last_fullsized":"2024-02-17T13:25:21.193581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.388118+0000","last_change":"2024-02-17T12:57:57.798620+0000","last_active":"2024-02-17T13:25:49.388118+0000","last_peered":"2024-02-17T13:25:49.388118+0000","last_clean":"2024-02-17T13:25:49.388118+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T13:25:49.388118+0000","last_undegraded":"2024-02-17T13:25:49.388118+0000","last_fullsized":"2024-02-17T13:25:49.388118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:57.411243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.261469+0000","last_change":"2024-02-17T12:57:56.653400+0000","last_active":"2024-02-17T13:25:45.261469+0000","last_peered":"2024-02-17T13:25:45.261469+0000","last_clean":"2024-02-17T13:25:45.261469+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T13:25:45.261469+0000","last_undegraded":"2024-02-17T13:25:45.261469+0000","last_fullsized":"2024-02-17T13:25:45.261469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"26'166","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.501603+0000","last_change":"2024-02-17T12:58:02.482945+0000","last_active":"2024-02-17T13:25:19.501603+0000","last_peered":"2024-02-17T13:25:19.501603+0000","last_clean":"2024-02-17T13:25:19.501603+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T13:25:19.501603+0000","last_undegraded":"2024-02-17T13:25:19.501603+0000","last_fullsized":"2024-02-17T13:25:19.501603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":14575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.503807+0000","last_change":"2024-02-17T12:57:57.795572+0000","last_active":"2024-02-17T13:25:49.503807+0000","last_peered":"2024-02-17T13:25:49.503807+0000","last_clean":"2024-02-17T13:25:49.503807+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T13:25:49.503807+0000","last_undegraded":"2024-02-17T13:25:49.503807+0000","last_fullsized":"2024-02-17T13:25:49.503807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'9","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:28.456048+0000","last_change":"2024-02-17T12:57:56.644467+0000","last_active":"2024-02-17T13:25:28.456048+0000","last_peered":"2024-02-17T13:25:28.456048+0000","last_clean":"2024-02-17T13:25:28.456048+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T13:25:28.456048+0000","last_undegraded":"2024-02-17T13:25:28.456048+0000","last_fullsized":"2024-02-17T13:25:28.456048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.486786+0000","last_change":"2024-02-17T12:58:02.540729+0000","last_active":"2024-02-17T13:25:19.486786+0000","last_peered":"2024-02-17T13:25:19.486786+0000","last_clean":"2024-02-17T13:25:19.486786+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T13:25:19.486786+0000","last_undegraded":"2024-02-17T13:25:19.486786+0000","last_fullsized":"2024-02-17T13:25:19.486786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:54.659936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'33","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.443326+0000","last_change":"2024-02-17T12:57:57.803683+0000","last_active":"2024-02-17T13:25:49.443326+0000","last_peered":"2024-02-17T13:25:49.443326+0000","last_clean":"2024-02-17T13:25:49.443326+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T13:25:49.443326+0000","last_undegraded":"2024-02-17T13:25:49.443326+0000","last_fullsized":"2024-02-17T13:25:49.443326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'7","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.774422+0000","last_change":"2024-02-17T12:57:56.649176+0000","last_active":"2024-02-17T13:25:37.774422+0000","last_peered":"2024-02-17T13:25:37.774422+0000","last_clean":"2024-02-17T13:25:37.774422+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T13:25:37.774422+0000","last_undegraded":"2024-02-17T13:25:37.774422+0000","last_fullsized":"2024-02-17T13:25:37.774422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'126","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.268504+0000","last_change":"2024-02-17T12:58:02.533940+0000","last_active":"2024-02-17T13:25:20.268504+0000","last_peered":"2024-02-17T13:25:20.268504+0000","last_clean":"2024-02-17T13:25:20.268504+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T13:25:20.268504+0000","last_undegraded":"2024-02-17T13:25:20.268504+0000","last_fullsized":"2024-02-17T13:25:20.268504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.526892+0000","last_change":"2024-02-17T12:57:57.796186+0000","last_active":"2024-02-17T13:25:49.526892+0000","last_peered":"2024-02-17T13:25:49.526892+0000","last_clean":"2024-02-17T13:25:49.526892+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T13:25:49.526892+0000","last_undegraded":"2024-02-17T13:25:49.526892+0000","last_fullsized":"2024-02-17T13:25:49.526892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'16","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:43.819558+0000","last_change":"2024-02-17T12:57:56.647416+0000","last_active":"2024-02-17T13:25:43.819558+0000","last_peered":"2024-02-17T13:25:43.819558+0000","last_clean":"2024-02-17T13:25:43.819558+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T13:25:43.819558+0000","last_undegraded":"2024-02-17T13:25:43.819558+0000","last_fullsized":"2024-02-17T13:25:43.819558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"26'146","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.369377+0000","last_change":"2024-02-17T12:58:02.530892+0000","last_active":"2024-02-17T13:25:20.369377+0000","last_peered":"2024-02-17T13:25:20.369377+0000","last_clean":"2024-02-17T13:25:20.369377+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T13:25:20.369377+0000","last_undegraded":"2024-02-17T13:25:20.369377+0000","last_fullsized":"2024-02-17T13:25:20.369377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"26'34","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564016+0000","last_change":"2024-02-17T12:57:57.760528+0000","last_active":"2024-02-17T13:25:49.564016+0000","last_peered":"2024-02-17T13:25:49.564016+0000","last_clean":"2024-02-17T13:25:49.564016+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T13:25:49.564016+0000","last_undegraded":"2024-02-17T13:25:49.564016+0000","last_fullsized":"2024-02-17T13:25:49.564016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1339","reported_seq":1377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:45.528155+0000","last_change":"2024-02-17T12:57:56.645760+0000","last_active":"2024-02-17T13:25:45.528155+0000","last_peered":"2024-02-17T13:25:45.528155+0000","last_clean":"2024-02-17T13:25:45.528155+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T13:25:45.528155+0000","last_undegraded":"2024-02-17T13:25:45.528155+0000","last_fullsized":"2024-02-17T13:25:45.528155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:55.165892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":1198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'135","reported_seq":166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.343283+0000","last_change":"2024-02-17T12:58:02.478680+0000","last_active":"2024-02-17T13:25:20.343283+0000","last_peered":"2024-02-17T13:25:20.343283+0000","last_clean":"2024-02-17T13:25:20.343283+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T13:25:20.343283+0000","last_undegraded":"2024-02-17T13:25:20.343283+0000","last_fullsized":"2024-02-17T13:25:20.343283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:22.456308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365217+0000","last_change":"2024-02-17T12:57:57.804657+0000","last_active":"2024-02-17T13:25:49.365217+0000","last_peered":"2024-02-17T13:25:49.365217+0000","last_clean":"2024-02-17T13:25:49.365217+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T13:25:49.365217+0000","last_undegraded":"2024-02-17T13:25:49.365217+0000","last_fullsized":"2024-02-17T13:25:49.365217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'6","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.838772+0000","last_change":"2024-02-17T12:57:56.647866+0000","last_active":"2024-02-17T13:25:42.838772+0000","last_peered":"2024-02-17T13:25:42.838772+0000","last_clean":"2024-02-17T13:25:42.838772+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T13:25:42.838772+0000","last_undegraded":"2024-02-17T13:25:42.838772+0000","last_fullsized":"2024-02-17T13:25:42.838772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"26'127","reported_seq":158,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.938919+0000","last_change":"2024-02-17T12:58:02.536977+0000","last_active":"2024-02-17T13:25:18.938919+0000","last_peered":"2024-02-17T13:25:18.938919+0000","last_clean":"2024-02-17T13:25:18.938919+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T13:25:18.938919+0000","last_undegraded":"2024-02-17T13:25:18.938919+0000","last_fullsized":"2024-02-17T13:25:18.938919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:17.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"26'34","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.488440+0000","last_change":"2024-02-17T12:57:57.760729+0000","last_active":"2024-02-17T13:25:49.488440+0000","last_peered":"2024-02-17T13:25:49.488440+0000","last_clean":"2024-02-17T13:25:49.488440+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T13:25:49.488440+0000","last_undegraded":"2024-02-17T13:25:49.488440+0000","last_fullsized":"2024-02-17T13:25:49.488440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'3","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:38.803465+0000","last_change":"2024-02-17T12:57:56.652397+0000","last_active":"2024-02-17T13:25:38.803465+0000","last_peered":"2024-02-17T13:25:38.803465+0000","last_clean":"2024-02-17T13:25:38.803465+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T13:25:38.803465+0000","last_undegraded":"2024-02-17T13:25:38.803465+0000","last_fullsized":"2024-02-17T13:25:38.803465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:22:05.619984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"26'191","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.087918+0000","last_change":"2024-02-17T12:58:02.537134+0000","last_active":"2024-02-17T13:25:19.087918+0000","last_peered":"2024-02-17T13:25:19.087918+0000","last_clean":"2024-02-17T13:25:19.087918+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T13:25:19.087918+0000","last_undegraded":"2024-02-17T13:25:19.087918+0000","last_fullsized":"2024-02-17T13:25:19.087918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:20.697505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"26'34","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.489670+0000","last_change":"2024-02-17T12:57:57.772984+0000","last_active":"2024-02-17T13:25:49.489670+0000","last_peered":"2024-02-17T13:25:49.489670+0000","last_clean":"2024-02-17T13:25:49.489670+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T13:25:49.489670+0000","last_undegraded":"2024-02-17T13:25:49.489670+0000","last_fullsized":"2024-02-17T13:25:49.489670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'11","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:40.856131+0000","last_change":"2024-02-17T12:57:56.646997+0000","last_active":"2024-02-17T13:25:40.856131+0000","last_peered":"2024-02-17T13:25:40.856131+0000","last_clean":"2024-02-17T13:25:40.856131+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T13:25:40.856131+0000","last_undegraded":"2024-02-17T13:25:40.856131+0000","last_fullsized":"2024-02-17T13:25:40.856131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'113","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.208163+0000","last_change":"2024-02-17T12:58:02.537306+0000","last_active":"2024-02-17T13:25:19.208163+0000","last_peered":"2024-02-17T13:25:19.208163+0000","last_clean":"2024-02-17T13:25:19.208163+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T13:25:19.208163+0000","last_undegraded":"2024-02-17T13:25:19.208163+0000","last_fullsized":"2024-02-17T13:25:19.208163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:01:08.156454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"26'31","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.383427+0000","last_change":"2024-02-17T12:57:57.801869+0000","last_active":"2024-02-17T13:25:49.383427+0000","last_peered":"2024-02-17T13:25:49.383427+0000","last_clean":"2024-02-17T13:25:49.383427+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T13:25:49.383427+0000","last_undegraded":"2024-02-17T13:25:49.383427+0000","last_fullsized":"2024-02-17T13:25:49.383427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:38.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'915","reported_seq":1858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:47.836576+0000","last_change":"2024-02-17T12:57:56.658819+0000","last_active":"2024-02-17T13:25:47.836576+0000","last_peered":"2024-02-17T13:25:47.836576+0000","last_clean":"2024-02-17T13:25:47.836576+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T13:25:47.836576+0000","last_undegraded":"2024-02-17T13:25:47.836576+0000","last_fullsized":"2024-02-17T13:25:47.836576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:34.677820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210123,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":913,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'127","reported_seq":157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.471424+0000","last_change":"2024-02-17T12:58:02.531216+0000","last_active":"2024-02-17T13:25:19.471424+0000","last_peered":"2024-02-17T13:25:19.471424+0000","last_clean":"2024-02-17T13:25:19.471424+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T13:25:19.471424+0000","last_undegraded":"2024-02-17T13:25:19.471424+0000","last_fullsized":"2024-02-17T13:25:19.471424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:00.786624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"26'29","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.365373+0000","last_change":"2024-02-17T12:57:57.760678+0000","last_active":"2024-02-17T13:25:49.365373+0000","last_peered":"2024-02-17T13:25:49.365373+0000","last_clean":"2024-02-17T13:25:49.365373+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T13:25:49.365373+0000","last_undegraded":"2024-02-17T13:25:49.365373+0000","last_fullsized":"2024-02-17T13:25:49.365373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:24.901472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'489","reported_seq":530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.132863+0000","last_change":"2024-02-17T12:57:56.653493+0000","last_active":"2024-02-17T13:26:02.132863+0000","last_peered":"2024-02-17T13:26:02.132863+0000","last_clean":"2024-02-17T13:26:02.132863+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T13:26:02.132863+0000","last_undegraded":"2024-02-17T13:26:02.132863+0000","last_fullsized":"2024-02-17T13:26:02.132863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'120","reported_seq":150,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.298901+0000","last_change":"2024-02-17T12:58:02.532562+0000","last_active":"2024-02-17T13:25:20.298901+0000","last_peered":"2024-02-17T13:25:20.298901+0000","last_clean":"2024-02-17T13:25:20.298901+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T13:25:20.298901+0000","last_undegraded":"2024-02-17T13:25:20.298901+0000","last_fullsized":"2024-02-17T13:25:20.298901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:10.904829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'33","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.497629+0000","last_change":"2024-02-17T12:57:57.721585+0000","last_active":"2024-02-17T13:25:49.497629+0000","last_peered":"2024-02-17T13:25:49.497629+0000","last_clean":"2024-02-17T13:25:49.497629+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T13:25:49.497629+0000","last_undegraded":"2024-02-17T13:25:49.497629+0000","last_fullsized":"2024-02-17T13:25:49.497629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:39.012810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'8","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:26.357486+0000","last_change":"2024-02-17T12:57:56.650608+0000","last_active":"2024-02-17T13:25:26.357486+0000","last_peered":"2024-02-17T13:25:26.357486+0000","last_clean":"2024-02-17T13:25:26.357486+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T13:25:26.357486+0000","last_undegraded":"2024-02-17T13:25:26.357486+0000","last_fullsized":"2024-02-17T13:25:26.357486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.289604+0000","last_change":"2024-02-17T13:26:01.289633+0000","last_active":"2024-02-17T13:26:01.289604+0000","last_peered":"2024-02-17T13:26:01.289604+0000","last_clean":"2024-02-17T13:26:01.289604+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T13:26:01.289604+0000","last_undegraded":"2024-02-17T13:26:01.289604+0000","last_fullsized":"2024-02-17T13:26:01.289604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-02-17T13:26:01.289538+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-02-17T13:26:01.289538+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.289538+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:40:19.512484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"26'170","reported_seq":202,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.859385+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T13:25:18.859385+0000","last_peered":"2024-02-17T13:25:18.859385+0000","last_clean":"2024-02-17T13:25:18.859385+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T13:25:18.859385+0000","last_undegraded":"2024-02-17T13:25:18.859385+0000","last_fullsized":"2024-02-17T13:25:18.859385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":8669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463292+0000","last_change":"2024-02-17T12:57:57.800160+0000","last_active":"2024-02-17T13:25:49.463292+0000","last_peered":"2024-02-17T13:25:49.463292+0000","last_clean":"2024-02-17T13:25:49.463292+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T13:25:49.463292+0000","last_undegraded":"2024-02-17T13:25:49.463292+0000","last_fullsized":"2024-02-17T13:25:49.463292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832570+0000","last_change":"2024-02-17T12:57:56.645132+0000","last_active":"2024-02-17T13:25:39.832570+0000","last_peered":"2024-02-17T13:25:39.832570+0000","last_clean":"2024-02-17T13:25:39.832570+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T13:25:39.832570+0000","last_undegraded":"2024-02-17T13:25:39.832570+0000","last_fullsized":"2024-02-17T13:25:39.832570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'141","reported_seq":172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.323116+0000","last_change":"2024-02-17T12:58:02.533924+0000","last_active":"2024-02-17T13:25:20.323116+0000","last_peered":"2024-02-17T13:25:20.323116+0000","last_clean":"2024-02-17T13:25:20.323116+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T13:25:20.323116+0000","last_undegraded":"2024-02-17T13:25:20.323116+0000","last_fullsized":"2024-02-17T13:25:20.323116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'39","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.488617+0000","last_change":"2024-02-17T12:57:57.795309+0000","last_active":"2024-02-17T13:25:49.488617+0000","last_peered":"2024-02-17T13:25:49.488617+0000","last_clean":"2024-02-17T13:25:49.488617+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T13:25:49.488617+0000","last_undegraded":"2024-02-17T13:25:49.488617+0000","last_fullsized":"2024-02-17T13:25:49.488617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.826449+0000","last_change":"2024-02-17T12:57:56.652082+0000","last_active":"2024-02-17T13:25:39.826449+0000","last_peered":"2024-02-17T13:25:39.826449+0000","last_clean":"2024-02-17T13:25:39.826449+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T13:25:39.826449+0000","last_undegraded":"2024-02-17T13:25:39.826449+0000","last_fullsized":"2024-02-17T13:25:39.826449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'175","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.735811+0000","last_change":"2024-02-17T12:58:02.529021+0000","last_active":"2024-02-17T13:25:18.735811+0000","last_peered":"2024-02-17T13:25:18.735811+0000","last_clean":"2024-02-17T13:25:18.735811+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T13:25:18.735811+0000","last_undegraded":"2024-02-17T13:25:18.735811+0000","last_fullsized":"2024-02-17T13:25:18.735811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:20.314967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:00.721503+0000","last_change":"2024-02-17T13:26:00.721524+0000","last_active":"2024-02-17T13:26:00.721503+0000","last_peered":"2024-02-17T13:26:00.721503+0000","last_clean":"2024-02-17T13:26:00.721503+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T13:26:00.721503+0000","last_undegraded":"2024-02-17T13:26:00.721503+0000","last_fullsized":"2024-02-17T13:26:00.721503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:00.721437+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:00.721437+0000","last_clean_scrub_stamp":"2024-02-17T13:26:00.721437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:45.827792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'6","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:24:56.868466+0000","last_change":"2024-02-17T12:57:56.653627+0000","last_active":"2024-02-17T13:24:56.868466+0000","last_peered":"2024-02-17T13:24:56.868466+0000","last_clean":"2024-02-17T13:24:56.868466+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T13:24:56.868466+0000","last_undegraded":"2024-02-17T13:24:56.868466+0000","last_fullsized":"2024-02-17T13:24:56.868466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"26'122","reported_seq":153,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.824132+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T13:25:18.824132+0000","last_peered":"2024-02-17T13:25:18.824132+0000","last_clean":"2024-02-17T13:25:18.824132+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T13:25:18.824132+0000","last_undegraded":"2024-02-17T13:25:18.824132+0000","last_fullsized":"2024-02-17T13:25:18.824132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'21","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.495225+0000","last_change":"2024-02-17T12:57:57.774439+0000","last_active":"2024-02-17T13:25:49.495225+0000","last_peered":"2024-02-17T13:25:49.495225+0000","last_clean":"2024-02-17T13:25:49.495225+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T13:25:49.495225+0000","last_undegraded":"2024-02-17T13:25:49.495225+0000","last_fullsized":"2024-02-17T13:25:49.495225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:39.832683+0000","last_change":"2024-02-17T12:57:56.652256+0000","last_active":"2024-02-17T13:25:39.832683+0000","last_peered":"2024-02-17T13:25:39.832683+0000","last_clean":"2024-02-17T13:25:39.832683+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T13:25:39.832683+0000","last_undegraded":"2024-02-17T13:25:39.832683+0000","last_fullsized":"2024-02-17T13:25:39.832683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"26'161","reported_seq":192,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.364711+0000","last_change":"2024-02-17T12:58:02.525730+0000","last_active":"2024-02-17T13:25:20.364711+0000","last_peered":"2024-02-17T13:25:20.364711+0000","last_clean":"2024-02-17T13:25:20.364711+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T13:25:20.364711+0000","last_undegraded":"2024-02-17T13:25:20.364711+0000","last_fullsized":"2024-02-17T13:25:20.364711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:57.685892+0000","last_change":"2024-02-17T12:57:57.799296+0000","last_active":"2024-02-17T13:25:57.685892+0000","last_peered":"2024-02-17T13:25:57.685892+0000","last_clean":"2024-02-17T13:25:57.685892+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T13:25:57.685892+0000","last_undegraded":"2024-02-17T13:25:57.685892+0000","last_fullsized":"2024-02-17T13:25:57.685892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'20","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:47.840418+0000","last_change":"2024-02-17T12:57:56.658501+0000","last_active":"2024-02-17T13:25:47.840418+0000","last_peered":"2024-02-17T13:25:47.840418+0000","last_clean":"2024-02-17T13:25:47.840418+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T13:25:47.840418+0000","last_undegraded":"2024-02-17T13:25:47.840418+0000","last_fullsized":"2024-02-17T13:25:47.840418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"26'138","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.173860+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T13:25:19.173860+0000","last_peered":"2024-02-17T13:25:19.173860+0000","last_clean":"2024-02-17T13:25:19.173860+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T13:25:19.173860+0000","last_undegraded":"2024-02-17T13:25:19.173860+0000","last_fullsized":"2024-02-17T13:25:19.173860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:28.629932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'30","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:57.681473+0000","last_change":"2024-02-17T12:57:57.804576+0000","last_active":"2024-02-17T13:25:57.681473+0000","last_peered":"2024-02-17T13:25:57.681473+0000","last_clean":"2024-02-17T13:25:57.681473+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T13:25:57.681473+0000","last_undegraded":"2024-02-17T13:25:57.681473+0000","last_fullsized":"2024-02-17T13:25:57.681473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'11","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.733932+0000","last_change":"2024-02-17T13:26:01.733958+0000","last_active":"2024-02-17T13:26:01.733932+0000","last_peered":"2024-02-17T13:26:01.733932+0000","last_clean":"2024-02-17T13:26:01.733932+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T13:26:01.733932+0000","last_undegraded":"2024-02-17T13:26:01.733932+0000","last_fullsized":"2024-02-17T13:26:01.733932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-02-17T13:26:01.733870+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-02-17T13:26:01.733870+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.733870+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:09.001282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"26'136","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.534811+0000","last_change":"2024-02-17T12:58:02.529954+0000","last_active":"2024-02-17T13:25:19.534811+0000","last_peered":"2024-02-17T13:25:19.534811+0000","last_clean":"2024-02-17T13:25:19.534811+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T13:25:19.534811+0000","last_undegraded":"2024-02-17T13:25:19.534811+0000","last_fullsized":"2024-02-17T13:25:19.534811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:21.292561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'47","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:57.685917+0000","last_change":"2024-02-17T12:57:57.798949+0000","last_active":"2024-02-17T13:25:57.685917+0000","last_peered":"2024-02-17T13:25:57.685917+0000","last_clean":"2024-02-17T13:25:57.685917+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T13:25:57.685917+0000","last_undegraded":"2024-02-17T13:25:57.685917+0000","last_fullsized":"2024-02-17T13:25:57.685917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'15","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:57.685908+0000","last_change":"2024-02-17T12:57:56.658260+0000","last_active":"2024-02-17T13:25:57.685908+0000","last_peered":"2024-02-17T13:25:57.685908+0000","last_clean":"2024-02-17T13:25:57.685908+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T13:25:57.685908+0000","last_undegraded":"2024-02-17T13:25:57.685908+0000","last_fullsized":"2024-02-17T13:25:57.685908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.308506+0000","last_change":"2024-02-17T12:58:02.537892+0000","last_active":"2024-02-17T13:25:20.308506+0000","last_peered":"2024-02-17T13:25:20.308506+0000","last_clean":"2024-02-17T13:25:20.308506+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T13:25:20.308506+0000","last_undegraded":"2024-02-17T13:25:20.308506+0000","last_fullsized":"2024-02-17T13:25:20.308506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:29.227187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"26'39","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.366067+0000","last_change":"2024-02-17T12:57:57.799540+0000","last_active":"2024-02-17T13:25:49.366067+0000","last_peered":"2024-02-17T13:25:49.366067+0000","last_clean":"2024-02-17T13:25:49.366067+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T13:25:49.366067+0000","last_undegraded":"2024-02-17T13:25:49.366067+0000","last_fullsized":"2024-02-17T13:25:49.366067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:26.468984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'131","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.662432+0000","last_change":"2024-02-17T12:57:56.658515+0000","last_active":"2024-02-17T13:25:49.662432+0000","last_peered":"2024-02-17T13:25:49.662432+0000","last_clean":"2024-02-17T13:25:49.662432+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T13:25:49.662432+0000","last_undegraded":"2024-02-17T13:25:49.662432+0000","last_fullsized":"2024-02-17T13:25:49.662432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:24:19.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110453,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'131","reported_seq":161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.288364+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T13:25:20.288364+0000","last_peered":"2024-02-17T13:25:20.288364+0000","last_clean":"2024-02-17T13:25:20.288364+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T13:25:20.288364+0000","last_undegraded":"2024-02-17T13:25:20.288364+0000","last_fullsized":"2024-02-17T13:25:20.288364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'37","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493205+0000","last_change":"2024-02-17T12:57:57.773609+0000","last_active":"2024-02-17T13:25:49.493205+0000","last_peered":"2024-02-17T13:25:49.493205+0000","last_clean":"2024-02-17T13:25:49.493205+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T13:25:49.493205+0000","last_undegraded":"2024-02-17T13:25:49.493205+0000","last_fullsized":"2024-02-17T13:25:49.493205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'827","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.819108+0000","last_change":"2024-02-17T13:26:01.819108+0000","last_active":"2024-02-17T13:26:01.819108+0000","last_peered":"2024-02-17T13:26:01.819108+0000","last_clean":"2024-02-17T13:26:01.819108+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T13:26:01.819108+0000","last_undegraded":"2024-02-17T13:26:01.819108+0000","last_fullsized":"2024-02-17T13:26:01.819108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'827","last_scrub_stamp":"2024-02-17T13:26:01.818949+0000","last_deep_scrub":"26'827","last_deep_scrub_stamp":"2024-02-17T13:26:01.818949+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.818949+0000","objects_scrubbed":6,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:56.846026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"26'125","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.524335+0000","last_change":"2024-02-17T12:58:02.521574+0000","last_active":"2024-02-17T13:25:19.524335+0000","last_peered":"2024-02-17T13:25:19.524335+0000","last_clean":"2024-02-17T13:25:19.524335+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T13:25:19.524335+0000","last_undegraded":"2024-02-17T13:25:19.524335+0000","last_fullsized":"2024-02-17T13:25:19.524335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:45.857607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'32","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.133084+0000","last_change":"2024-02-17T12:57:57.798887+0000","last_active":"2024-02-17T13:26:02.133084+0000","last_peered":"2024-02-17T13:26:02.133084+0000","last_clean":"2024-02-17T13:26:02.133084+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T13:26:02.133084+0000","last_undegraded":"2024-02-17T13:26:02.133084+0000","last_fullsized":"2024-02-17T13:26:02.133084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'655","reported_seq":692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:43.826125+0000","last_change":"2024-02-17T12:57:56.659943+0000","last_active":"2024-02-17T13:25:43.826125+0000","last_peered":"2024-02-17T13:25:43.826125+0000","last_clean":"2024-02-17T13:25:43.826125+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T13:25:43.826125+0000","last_undegraded":"2024-02-17T13:25:43.826125+0000","last_fullsized":"2024-02-17T13:25:43.826125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"26'151","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.353066+0000","last_change":"2024-02-17T12:58:02.534028+0000","last_active":"2024-02-17T13:26:01.353066+0000","last_peered":"2024-02-17T13:26:01.353066+0000","last_clean":"2024-02-17T13:26:01.353066+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T13:26:01.353066+0000","last_undegraded":"2024-02-17T13:26:01.353066+0000","last_fullsized":"2024-02-17T13:26:01.353066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":23394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372478+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.372478+0000","last_peered":"2024-02-17T13:25:49.372478+0000","last_clean":"2024-02-17T13:25:49.372478+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T13:25:49.372478+0000","last_undegraded":"2024-02-17T13:25:49.372478+0000","last_fullsized":"2024-02-17T13:25:49.372478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:17.655714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'5","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:25.324343+0000","last_change":"2024-02-17T12:57:56.652652+0000","last_active":"2024-02-17T13:25:25.324343+0000","last_peered":"2024-02-17T13:25:25.324343+0000","last_clean":"2024-02-17T13:25:25.324343+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T13:25:25.324343+0000","last_undegraded":"2024-02-17T13:25:25.324343+0000","last_fullsized":"2024-02-17T13:25:25.324343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'126","reported_seq":156,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.283091+0000","last_change":"2024-02-17T12:58:02.538521+0000","last_active":"2024-02-17T13:25:20.283091+0000","last_peered":"2024-02-17T13:25:20.283091+0000","last_clean":"2024-02-17T13:25:20.283091+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T13:25:20.283091+0000","last_undegraded":"2024-02-17T13:25:20.283091+0000","last_fullsized":"2024-02-17T13:25:20.283091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:30.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":10959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'43","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.496542+0000","last_change":"2024-02-17T12:57:57.796547+0000","last_active":"2024-02-17T13:25:49.496542+0000","last_peered":"2024-02-17T13:25:49.496542+0000","last_clean":"2024-02-17T13:25:49.496542+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T13:25:49.496542+0000","last_undegraded":"2024-02-17T13:25:49.496542+0000","last_fullsized":"2024-02-17T13:25:49.496542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'14","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.267098+0000","last_change":"2024-02-17T13:26:02.267127+0000","last_active":"2024-02-17T13:26:02.267098+0000","last_peered":"2024-02-17T13:26:02.267098+0000","last_clean":"2024-02-17T13:26:02.267098+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T13:26:02.267098+0000","last_undegraded":"2024-02-17T13:26:02.267098+0000","last_fullsized":"2024-02-17T13:26:02.267098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-02-17T13:26:02.267038+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-02-17T13:26:02.267038+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.267038+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:24.897338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'167","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.207004+0000","last_change":"2024-02-17T12:58:02.535369+0000","last_active":"2024-02-17T13:25:21.207004+0000","last_peered":"2024-02-17T13:25:21.207004+0000","last_clean":"2024-02-17T13:25:21.207004+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T13:25:21.207004+0000","last_undegraded":"2024-02-17T13:25:21.207004+0000","last_fullsized":"2024-02-17T13:25:21.207004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:10.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"26'142","reported_seq":173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.459798+0000","last_change":"2024-02-17T12:58:02.519311+0000","last_active":"2024-02-17T13:25:19.459798+0000","last_peered":"2024-02-17T13:25:19.459798+0000","last_clean":"2024-02-17T13:25:19.459798+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T13:25:19.459798+0000","last_undegraded":"2024-02-17T13:25:19.459798+0000","last_fullsized":"2024-02-17T13:25:19.459798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:49:49.424654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":9062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.564794+0000","last_change":"2024-02-17T12:57:57.727641+0000","last_active":"2024-02-17T13:25:49.564794+0000","last_peered":"2024-02-17T13:25:49.564794+0000","last_clean":"2024-02-17T13:25:49.564794+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T13:25:49.564794+0000","last_undegraded":"2024-02-17T13:25:49.564794+0000","last_fullsized":"2024-02-17T13:25:49.564794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'8","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:42.844860+0000","last_change":"2024-02-17T12:57:56.653221+0000","last_active":"2024-02-17T13:25:42.844860+0000","last_peered":"2024-02-17T13:25:42.844860+0000","last_clean":"2024-02-17T13:25:42.844860+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T13:25:42.844860+0000","last_undegraded":"2024-02-17T13:25:42.844860+0000","last_fullsized":"2024-02-17T13:25:42.844860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.193398+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T13:25:21.193398+0000","last_peered":"2024-02-17T13:25:21.193398+0000","last_clean":"2024-02-17T13:25:21.193398+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T13:25:21.193398+0000","last_undegraded":"2024-02-17T13:25:21.193398+0000","last_fullsized":"2024-02-17T13:25:21.193398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":20244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'41","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.381918+0000","last_change":"2024-02-17T12:57:57.801256+0000","last_active":"2024-02-17T13:25:49.381918+0000","last_peered":"2024-02-17T13:25:49.381918+0000","last_clean":"2024-02-17T13:25:49.381918+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T13:25:49.381918+0000","last_undegraded":"2024-02-17T13:25:49.381918+0000","last_fullsized":"2024-02-17T13:25:49.381918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'12","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:36.704801+0000","last_change":"2024-02-17T12:57:56.643502+0000","last_active":"2024-02-17T13:25:36.704801+0000","last_peered":"2024-02-17T13:25:36.704801+0000","last_clean":"2024-02-17T13:25:36.704801+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T13:25:36.704801+0000","last_undegraded":"2024-02-17T13:25:36.704801+0000","last_fullsized":"2024-02-17T13:25:36.704801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:21:33.395038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'680","reported_seq":718,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:34.662542+0000","last_change":"2024-02-17T12:57:56.649584+0000","last_active":"2024-02-17T13:25:34.662542+0000","last_peered":"2024-02-17T13:25:34.662542+0000","last_clean":"2024-02-17T13:25:34.662542+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T13:25:34.662542+0000","last_undegraded":"2024-02-17T13:25:34.662542+0000","last_fullsized":"2024-02-17T13:25:34.662542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"26'40","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.529720+0000","last_change":"2024-02-17T12:57:57.773278+0000","last_active":"2024-02-17T13:25:49.529720+0000","last_peered":"2024-02-17T13:25:49.529720+0000","last_clean":"2024-02-17T13:25:49.529720+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T13:25:49.529720+0000","last_undegraded":"2024-02-17T13:25:49.529720+0000","last_fullsized":"2024-02-17T13:25:49.529720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'95","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:19.545426+0000","last_change":"2024-02-17T12:58:02.535565+0000","last_active":"2024-02-17T13:25:19.545426+0000","last_peered":"2024-02-17T13:25:19.545426+0000","last_clean":"2024-02-17T13:25:19.545426+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T13:25:19.545426+0000","last_undegraded":"2024-02-17T13:25:19.545426+0000","last_fullsized":"2024-02-17T13:25:19.545426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:33.141136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'659","reported_seq":696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:37.776248+0000","last_change":"2024-02-17T12:57:56.651847+0000","last_active":"2024-02-17T13:25:37.776248+0000","last_peered":"2024-02-17T13:25:37.776248+0000","last_clean":"2024-02-17T13:25:37.776248+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T13:25:37.776248+0000","last_undegraded":"2024-02-17T13:25:37.776248+0000","last_fullsized":"2024-02-17T13:25:37.776248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:55.398618+0000","last_clean_scrub_stamp":"2024-02-17T12:57:55.398618+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:14.435845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463913+0000","last_change":"2024-02-17T12:57:57.803653+0000","last_active":"2024-02-17T13:25:49.463913+0000","last_peered":"2024-02-17T13:25:49.463913+0000","last_clean":"2024-02-17T13:25:49.463913+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T13:25:49.463913+0000","last_undegraded":"2024-02-17T13:25:49.463913+0000","last_fullsized":"2024-02-17T13:25:49.463913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'162","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.351299+0000","last_change":"2024-02-17T12:58:37.887482+0000","last_active":"2024-02-17T13:25:20.351299+0000","last_peered":"2024-02-17T13:25:20.351299+0000","last_clean":"2024-02-17T13:25:20.351299+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T13:25:20.351299+0000","last_undegraded":"2024-02-17T13:25:20.351299+0000","last_fullsized":"2024-02-17T13:25:20.351299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"26'49","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493567+0000","last_change":"2024-02-17T12:57:57.760270+0000","last_active":"2024-02-17T13:25:49.493567+0000","last_peered":"2024-02-17T13:25:49.493567+0000","last_clean":"2024-02-17T13:25:49.493567+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T13:25:49.493567+0000","last_undegraded":"2024-02-17T13:25:49.493567+0000","last_fullsized":"2024-02-17T13:25:49.493567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"26'49","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387808+0000","last_change":"2024-02-17T12:57:57.795458+0000","last_active":"2024-02-17T13:25:49.387808+0000","last_peered":"2024-02-17T13:25:49.387808+0000","last_clean":"2024-02-17T13:25:49.387808+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T13:25:49.387808+0000","last_undegraded":"2024-02-17T13:25:49.387808+0000","last_fullsized":"2024-02-17T13:25:49.387808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:44.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"26'45","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.452735+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T13:25:49.452735+0000","last_peered":"2024-02-17T13:25:49.452735+0000","last_clean":"2024-02-17T13:25:49.452735+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T13:25:49.452735+0000","last_undegraded":"2024-02-17T13:25:49.452735+0000","last_fullsized":"2024-02-17T13:25:49.452735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.383488+0000","last_change":"2024-02-17T12:57:57.803392+0000","last_active":"2024-02-17T13:25:49.383488+0000","last_peered":"2024-02-17T13:25:49.383488+0000","last_clean":"2024-02-17T13:25:49.383488+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T13:25:49.383488+0000","last_undegraded":"2024-02-17T13:25:49.383488+0000","last_fullsized":"2024-02-17T13:25:49.383488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:36.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"26'27","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.368239+0000","last_change":"2024-02-17T12:57:57.774461+0000","last_active":"2024-02-17T13:25:49.368239+0000","last_peered":"2024-02-17T13:25:49.368239+0000","last_clean":"2024-02-17T13:25:49.368239+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T13:25:49.368239+0000","last_undegraded":"2024-02-17T13:25:49.368239+0000","last_fullsized":"2024-02-17T13:25:49.368239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:26.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"26'32","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367306+0000","last_change":"2024-02-17T12:57:57.795554+0000","last_active":"2024-02-17T13:25:49.367306+0000","last_peered":"2024-02-17T13:25:49.367306+0000","last_clean":"2024-02-17T13:25:49.367306+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T13:25:49.367306+0000","last_undegraded":"2024-02-17T13:25:49.367306+0000","last_fullsized":"2024-02-17T13:25:49.367306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:30.109016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'43","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.493944+0000","last_change":"2024-02-17T12:57:57.797091+0000","last_active":"2024-02-17T13:25:49.493944+0000","last_peered":"2024-02-17T13:25:49.493944+0000","last_clean":"2024-02-17T13:25:49.493944+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T13:25:49.493944+0000","last_undegraded":"2024-02-17T13:25:49.493944+0000","last_fullsized":"2024-02-17T13:25:49.493944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"26'31","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.370293+0000","last_change":"2024-02-17T12:57:57.804650+0000","last_active":"2024-02-17T13:25:49.370293+0000","last_peered":"2024-02-17T13:25:49.370293+0000","last_clean":"2024-02-17T13:25:49.370293+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T13:25:49.370293+0000","last_undegraded":"2024-02-17T13:25:49.370293+0000","last_fullsized":"2024-02-17T13:25:49.370293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:13.184640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"26'34","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.449610+0000","last_change":"2024-02-17T12:57:57.805794+0000","last_active":"2024-02-17T13:25:49.449610+0000","last_peered":"2024-02-17T13:25:49.449610+0000","last_clean":"2024-02-17T13:25:49.449610+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T13:25:49.449610+0000","last_undegraded":"2024-02-17T13:25:49.449610+0000","last_fullsized":"2024-02-17T13:25:49.449610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.377561+0000","last_change":"2024-02-17T12:57:57.802885+0000","last_active":"2024-02-17T13:25:49.377561+0000","last_peered":"2024-02-17T13:25:49.377561+0000","last_clean":"2024-02-17T13:25:49.377561+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T13:25:49.377561+0000","last_undegraded":"2024-02-17T13:25:49.377561+0000","last_fullsized":"2024-02-17T13:25:49.377561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:30:15.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"26'38","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.463842+0000","last_change":"2024-02-17T12:57:57.772303+0000","last_active":"2024-02-17T13:25:49.463842+0000","last_peered":"2024-02-17T13:25:49.463842+0000","last_clean":"2024-02-17T13:25:49.463842+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T13:25:49.463842+0000","last_undegraded":"2024-02-17T13:25:49.463842+0000","last_fullsized":"2024-02-17T13:25:49.463842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"26'45","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.527824+0000","last_change":"2024-02-17T12:57:57.724161+0000","last_active":"2024-02-17T13:25:49.527824+0000","last_peered":"2024-02-17T13:25:49.527824+0000","last_clean":"2024-02-17T13:25:49.527824+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T13:25:49.527824+0000","last_undegraded":"2024-02-17T13:25:49.527824+0000","last_fullsized":"2024-02-17T13:25:49.527824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'39","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387085+0000","last_change":"2024-02-17T12:58:37.741377+0000","last_active":"2024-02-17T13:25:49.387085+0000","last_peered":"2024-02-17T13:25:49.387085+0000","last_clean":"2024-02-17T13:25:49.387085+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T13:25:49.387085+0000","last_undegraded":"2024-02-17T13:25:49.387085+0000","last_fullsized":"2024-02-17T13:25:49.387085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:05.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"26'32","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.451522+0000","last_change":"2024-02-17T12:57:57.806161+0000","last_active":"2024-02-17T13:25:49.451522+0000","last_peered":"2024-02-17T13:25:49.451522+0000","last_clean":"2024-02-17T13:25:49.451522+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T13:25:49.451522+0000","last_undegraded":"2024-02-17T13:25:49.451522+0000","last_fullsized":"2024-02-17T13:25:49.451522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"26'47","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.387340+0000","last_change":"2024-02-17T12:57:57.795262+0000","last_active":"2024-02-17T13:25:49.387340+0000","last_peered":"2024-02-17T13:25:49.387340+0000","last_clean":"2024-02-17T13:25:49.387340+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T13:25:49.387340+0000","last_undegraded":"2024-02-17T13:25:49.387340+0000","last_fullsized":"2024-02-17T13:25:49.387340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:11:16.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"26'35","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:57.685941+0000","last_change":"2024-02-17T12:57:57.801008+0000","last_active":"2024-02-17T13:25:57.685941+0000","last_peered":"2024-02-17T13:25:57.685941+0000","last_clean":"2024-02-17T13:25:57.685941+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T13:25:57.685941+0000","last_undegraded":"2024-02-17T13:25:57.685941+0000","last_fullsized":"2024-02-17T13:25:57.685941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"26'42","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:57.685871+0000","last_change":"2024-02-17T12:57:57.795859+0000","last_active":"2024-02-17T13:25:57.685871+0000","last_peered":"2024-02-17T13:25:57.685871+0000","last_clean":"2024-02-17T13:25:57.685871+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T13:25:57.685871+0000","last_undegraded":"2024-02-17T13:25:57.685871+0000","last_fullsized":"2024-02-17T13:25:57.685871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"26'41","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.377006+0000","last_change":"2024-02-17T12:57:57.803602+0000","last_active":"2024-02-17T13:25:49.377006+0000","last_peered":"2024-02-17T13:25:49.377006+0000","last_clean":"2024-02-17T13:25:49.377006+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T13:25:49.377006+0000","last_undegraded":"2024-02-17T13:25:49.377006+0000","last_fullsized":"2024-02-17T13:25:49.377006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:37.235268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'35","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.368379+0000","last_change":"2024-02-17T12:57:57.795584+0000","last_active":"2024-02-17T13:25:49.368379+0000","last_peered":"2024-02-17T13:25:49.368379+0000","last_clean":"2024-02-17T13:25:49.368379+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T13:25:49.368379+0000","last_undegraded":"2024-02-17T13:25:49.368379+0000","last_fullsized":"2024-02-17T13:25:49.368379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:14:03.584720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"26'39","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.367607+0000","last_change":"2024-02-17T12:57:57.774422+0000","last_active":"2024-02-17T13:25:49.367607+0000","last_peered":"2024-02-17T13:25:49.367607+0000","last_clean":"2024-02-17T13:25:49.367607+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T13:25:49.367607+0000","last_undegraded":"2024-02-17T13:25:49.367607+0000","last_fullsized":"2024-02-17T13:25:49.367607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:51:35.488778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'28","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494252+0000","last_change":"2024-02-17T12:57:57.772178+0000","last_active":"2024-02-17T13:25:49.494252+0000","last_peered":"2024-02-17T13:25:49.494252+0000","last_clean":"2024-02-17T13:25:49.494252+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T13:25:49.494252+0000","last_undegraded":"2024-02-17T13:25:49.494252+0000","last_fullsized":"2024-02-17T13:25:49.494252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.491798+0000","last_change":"2024-02-17T12:57:57.797907+0000","last_active":"2024-02-17T13:25:49.491798+0000","last_peered":"2024-02-17T13:25:49.491798+0000","last_clean":"2024-02-17T13:25:49.491798+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T13:25:49.491798+0000","last_undegraded":"2024-02-17T13:25:49.491798+0000","last_fullsized":"2024-02-17T13:25:49.491798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"26'48","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.494960+0000","last_change":"2024-02-17T12:57:57.773192+0000","last_active":"2024-02-17T13:25:49.494960+0000","last_peered":"2024-02-17T13:25:49.494960+0000","last_clean":"2024-02-17T13:25:49.494960+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T13:25:49.494960+0000","last_undegraded":"2024-02-17T13:25:49.494960+0000","last_fullsized":"2024-02-17T13:25:49.494960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"26'38","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.464452+0000","last_change":"2024-02-17T12:57:57.796252+0000","last_active":"2024-02-17T13:25:49.464452+0000","last_peered":"2024-02-17T13:25:49.464452+0000","last_clean":"2024-02-17T13:25:49.464452+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T13:25:49.464452+0000","last_undegraded":"2024-02-17T13:25:49.464452+0000","last_fullsized":"2024-02-17T13:25:49.464452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"26'28","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382911+0000","last_change":"2024-02-17T12:57:57.804923+0000","last_active":"2024-02-17T13:25:49.382911+0000","last_peered":"2024-02-17T13:25:49.382911+0000","last_clean":"2024-02-17T13:25:49.382911+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T13:25:49.382911+0000","last_undegraded":"2024-02-17T13:25:49.382911+0000","last_fullsized":"2024-02-17T13:25:49.382911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:49.859342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484341+0000","last_change":"2024-02-17T12:57:57.772052+0000","last_active":"2024-02-17T13:25:49.484341+0000","last_peered":"2024-02-17T13:25:49.484341+0000","last_clean":"2024-02-17T13:25:49.484341+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T13:25:49.484341+0000","last_undegraded":"2024-02-17T13:25:49.484341+0000","last_fullsized":"2024-02-17T13:25:49.484341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"26'35","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.490540+0000","last_change":"2024-02-17T12:57:57.721762+0000","last_active":"2024-02-17T13:25:49.490540+0000","last_peered":"2024-02-17T13:25:49.490540+0000","last_clean":"2024-02-17T13:25:49.490540+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T13:25:49.490540+0000","last_undegraded":"2024-02-17T13:25:49.490540+0000","last_fullsized":"2024-02-17T13:25:49.490540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"26'33","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.488765+0000","last_change":"2024-02-17T12:57:57.803757+0000","last_active":"2024-02-17T13:25:49.488765+0000","last_peered":"2024-02-17T13:25:49.488765+0000","last_clean":"2024-02-17T13:25:49.488765+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T13:25:49.488765+0000","last_undegraded":"2024-02-17T13:25:49.488765+0000","last_fullsized":"2024-02-17T13:25:49.488765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'26","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.352972+0000","last_change":"2024-02-17T12:57:57.721703+0000","last_active":"2024-02-17T13:26:01.352972+0000","last_peered":"2024-02-17T13:26:01.352972+0000","last_clean":"2024-02-17T13:26:01.352972+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T13:26:01.352972+0000","last_undegraded":"2024-02-17T13:26:01.352972+0000","last_fullsized":"2024-02-17T13:26:01.352972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'41","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.382700+0000","last_change":"2024-02-17T12:57:57.803746+0000","last_active":"2024-02-17T13:25:49.382700+0000","last_peered":"2024-02-17T13:25:49.382700+0000","last_clean":"2024-02-17T13:25:49.382700+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T13:25:49.382700+0000","last_undegraded":"2024-02-17T13:25:49.382700+0000","last_fullsized":"2024-02-17T13:25:49.382700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:20:02.418577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"26'36","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.372153+0000","last_change":"2024-02-17T12:57:57.802774+0000","last_active":"2024-02-17T13:25:49.372153+0000","last_peered":"2024-02-17T13:25:49.372153+0000","last_clean":"2024-02-17T13:25:49.372153+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T13:25:49.372153+0000","last_undegraded":"2024-02-17T13:25:49.372153+0000","last_fullsized":"2024-02-17T13:25:49.372153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:24.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"26'26","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.484801+0000","last_change":"2024-02-17T12:57:57.797136+0000","last_active":"2024-02-17T13:25:49.484801+0000","last_peered":"2024-02-17T13:25:49.484801+0000","last_clean":"2024-02-17T13:25:49.484801+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T13:25:49.484801+0000","last_undegraded":"2024-02-17T13:25:49.484801+0000","last_fullsized":"2024-02-17T13:25:49.484801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3911,"num_write_kb":306687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4416,"ondisk_log_size":4416,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39077972,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":11090,"num_write_kb":44057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78405632,"data_stored":78155944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9147,"ondisk_log_size":9147,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575193,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63244,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308596,"statfs":{"total":96636764160,"available":96572002304,"internally_reserved":0,"allocated":5836800,"data_stored":5629759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":0.55900000000000005,"5min":0.65000000000000002,"15min":0.71199999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.502}]},{"osd":1,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.64400000000000002,"15min":0.749},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.72999999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.623,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.52800000000000002,"5min":0.69599999999999995,"15min":0.73599999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":0.63600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.79400000000000004},"last":0.442}]},{"osd":5,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76300000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.27000000000000002},"max":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81599999999999995,"5min":0.90200000000000002,"15min":0.92800000000000005},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575193,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":4388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":4493312,"data_stored":4311853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28799999999999998,"15min":0.217},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.68300000000000005},"last":0.441},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65500000000000003,"5min":0.67800000000000005,"15min":0.75700000000000001},"last":0.432}]},{"osd":1,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.70899999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.80000000000000004},"last":0.5}]},{"osd":2,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.63200000000000001,"5min":0.71899999999999997,"15min":0.72099999999999997},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.49299999999999999,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.27400000000000002},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.81299999999999994},"last":0.377}]},{"osd":4,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.77300000000000002},"last":0.307},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32600000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.86199999999999999,"15min":0.93400000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.23599999999999999},"max":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.84199999999999997},"last":0.40999999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.878},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.80800000000000005,"15min":0.94899999999999995},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575192,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70916,"kb_used_data":13372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300924,"statfs":{"total":96636764160,"available":96564146176,"internally_reserved":0,"allocated":13692928,"data_stored":13498704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57199999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.78100000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.751},"last":0.40899999999999997}]},{"osd":2,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.28799999999999998},"max":{"1min":0.61799999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.40899999999999997,"5min":0.28999999999999998,"15min":0.28199999999999997},"max":{"1min":0.67200000000000004,"5min":0.73299999999999998,"15min":0.75600000000000001},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.495},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.81499999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27300000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.79700000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.435}]},{"osd":6,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.872},"last":0.307},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.374}]},{"osd":7,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575192,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53580,"kb_used_data":8516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318260,"statfs":{"total":96636764160,"available":96581898240,"internally_reserved":0,"allocated":8720384,"data_stored":8505123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.59099999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.69199999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57799999999999996,"5min":0.621,"15min":0.745},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.71899999999999997},"last":0.46300000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.77900000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29699999999999999},"max":{"1min":0.63700000000000001,"5min":0.68400000000000005,"15min":0.68500000000000005},"last":0.442},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.82199999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44600000000000001,"15min":0.46999999999999997},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.47899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64200000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46800000000000003,"15min":0.48799999999999999},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66300000000000003,"5min":0.76800000000000002,"15min":0.872},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.51700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575193,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78404,"kb_used_data":16700,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293436,"statfs":{"total":96636764160,"available":96556478464,"internally_reserved":0,"allocated":17100800,"data_stored":16894525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.29799999999999999,"15min":0.30199999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.47499999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.309,"15min":0.311},"min":{"1min":0.223,"5min":0.223,"15min":0.21099999999999999},"max":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48799999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.19400000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.57499999999999996},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.379}]},{"osd":2,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.316},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.626,"5min":0.626,"15min":0.64600000000000002},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32100000000000001},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.79100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.77000000000000002,"15min":0.77300000000000002},"last":0.505}]},{"osd":5,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.75900000000000001,"15min":0.81899999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.85599999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.754,"15min":0.82499999999999996},"last":0.62},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.79300000000000004},"last":0.433},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.375},"max":{"1min":0.624,"5min":0.88,"15min":0.88},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575193,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8503353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.187,"15min":0.186},"max":{"1min":0.44700000000000001,"5min":0.59599999999999997,"15min":0.82899999999999996},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.19800000000000001},"max":{"1min":0.371,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.94299999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.33500000000000002,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.377,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.54100000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":1.02},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.29199999999999998},"max":{"1min":0.63900000000000001,"5min":0.74199999999999999,"15min":1.577},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.435}]},{"osd":5,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.78600000000000003,"15min":0.86399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.62,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.377}]},{"osd":6,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63400000000000001,"5min":0.77000000000000002,"15min":0.80700000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.76900000000000002,"15min":1.177},"last":0.41199999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36699999999999999},"max":{"1min":0.64300000000000002,"5min":0.80200000000000005,"15min":0.82399999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575192,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48560,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323280,"statfs":{"total":96636764160,"available":96587038720,"internally_reserved":0,"allocated":9281536,"data_stored":9094395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.69299999999999995},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.40699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.309}]},{"osd":2,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32100000000000001,"15min":0.311},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.504,"5min":0.622,"15min":0.622},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.56599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.23899999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.378,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.60799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.50900000000000001,"15min":0.81699999999999995},"last":0.254}]},{"osd":4,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.87,"15min":0.87},"last":0.45200000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.90700000000000003},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35699999999999998},"max":{"1min":0.63600000000000001,"5min":0.80800000000000005,"15min":0.81399999999999995},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66400000000000003,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.50900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575192,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71228,"kb_used_data":13684,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300612,"statfs":{"total":96636764160,"available":96563826688,"internally_reserved":0,"allocated":14012416,"data_stored":13811008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29299999999999998},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.52900000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.38900000000000001,"5min":0.55000000000000004,"15min":0.58399999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.45100000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.436},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.497,"5min":0.54600000000000004,"15min":0.624},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.42999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.252},"max":{"1min":0.53300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.73699999999999999,"15min":0.77100000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.78400000000000003},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.84699999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":0.71399999999999997,"15min":0.77200000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.61699999999999999,"5min":0.72499999999999998,"15min":0.78400000000000003},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":13697003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12820480,"data_stored":12794331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5515754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.874 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.875 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.876 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.877 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.878 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.879 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.880 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.881 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.882 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.883 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-02-17T12:57:55.398618+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=55, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.884 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.885 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.886 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:05.887 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-17T13:26:07.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:26:07.386 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:26:25.888 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T13:26:25.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.994+0000 7f0a6edf4640 1 Processor -- start 2024-02-17T13:26:25.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.994+0000 7f0a6edf4640 1 -- start start 2024-02-17T13:26:25.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.994+0000 7f0a6edf4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0a68151e20 0x7f0a680c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:25.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.994+0000 7f0a6edf4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680c9ba0 con 0x7f0a680c9750 2024-02-17T13:26:25.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.994+0000 7f0a6edf4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680c8340 con 0x7f0a680c4420 2024-02-17T13:26:25.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.994+0000 7f0a6edf4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680ca3a0 con 0x7f0a68151e20 2024-02-17T13:26:25.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.995+0000 7f0a6d391640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0a680c9750 0x7f0a68070720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:44700/0 (socket says 172.21.15.136:44700) 2024-02-17T13:26:25.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.995+0000 7f0a6d391640 1 -- 172.21.15.136:0/4221909624 learned_addr learned my addr 172.21.15.136:0/4221909624 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:25.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.995+0000 7f0a6cb90640 1 --2- 172.21.15.136:0/4221909624 >> v2:172.21.15.160:3300/0 conn(0x7f0a68151e20 0x7f0a680c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:25.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.997+0000 7f0a677fe640 1 -- 172.21.15.136:0/4221909624 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926587045 0 0) 0x7f0a60001490 con 0x7f0a680c9750 2024-02-17T13:26:25.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.997+0000 7f0a677fe640 1 -- 172.21.15.136:0/4221909624 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a58003520 con 0x7f0a680c9750 2024-02-17T13:26:25.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.998+0000 7f0a6cb90640 1 -- 172.21.15.136:0/4221909624 >> v1:172.21.15.160:6789/0 conn(0x7f0a680c4420 legacy=0x7f0a680c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:25.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.998+0000 7f0a6cb90640 1 -- 172.21.15.136:0/4221909624 >> v1:172.21.15.136:6789/0 conn(0x7f0a680c9750 legacy=0x7f0a68070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:25.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:25.998+0000 7f0a6cb90640 1 -- 172.21.15.136:0/4221909624 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680c94d0 con 0x7f0a68151e20 2024-02-17T13:26:26.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.003+0000 7f0a6cb90640 1 --2- 172.21.15.136:0/4221909624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68151e20 0x7f0a680c8760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097a0 tx=0x7f0a5c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e247946009a1bdfe server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:26.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a677fe640 1 -- 172.21.15.136:0/4221909624 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c030610 con 0x7f0a68151e20 2024-02-17T13:26:26.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a677fe640 1 -- 172.21.15.136:0/4221909624 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c030770 con 0x7f0a68151e20 2024-02-17T13:26:26.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a677fe640 1 -- 172.21.15.136:0/4221909624 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c030b00 con 0x7f0a68151e20 2024-02-17T13:26:26.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 -- 172.21.15.136:0/4221909624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68151e20 msgr2=0x7f0a680c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:26.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/4221909624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68151e20 0x7f0a680c8760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097a0 tx=0x7f0a5c02b960 comp rx=0 tx=0).stop 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 -- 172.21.15.136:0/4221909624 shutdown_connections 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/4221909624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68151e20 0x7f0a680c8760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 -- 172.21.15.136:0/4221909624 >> 172.21.15.136:0/4221909624 conn(0x7f0a6806fe80 msgr2=0x7f0a6806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 -- 172.21.15.136:0/4221909624 shutdown_connections 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.010+0000 7f0a6edf4640 1 -- 172.21.15.136:0/4221909624 wait complete. 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 Processor -- start 2024-02-17T13:26:26.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 -- start start 2024-02-17T13:26:26.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 0x7f0a6806d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:26.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a680c9750 0x7f0a680c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:26.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a68151e20 0x7f0a68155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:26.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680c7480 con 0x7f0a680c4420 2024-02-17T13:26:26.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680cd7c0 con 0x7f0a680c9750 2024-02-17T13:26:26.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.012+0000 7f0a6edf4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680cdaa0 con 0x7f0a68151e20 2024-02-17T13:26:26.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.013+0000 7f0a6cb90640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 0x7f0a6806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:26.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.013+0000 7f0a6d391640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a68151e20 0x7f0a68155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:26.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.013+0000 7f0a6cb90640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 0x7f0a6806d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:52276/0 (socket says 172.21.15.136:52276) 2024-02-17T13:26:26.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.013+0000 7f0a6cb90640 1 -- 172.21.15.136:0/3599158997 learned_addr learned my addr 172.21.15.136:0/3599158997 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:26.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.014+0000 7f0a67fff640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a680c9750 0x7f0a680c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:26.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.016+0000 7f0a6cb90640 1 -- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a68151e20 msgr2=0x7f0a68155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:26.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.016+0000 7f0a6cb90640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a68151e20 0x7f0a68155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.016+0000 7f0a6cb90640 1 -- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a680c9750 msgr2=0x7f0a680c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:26.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.016+0000 7f0a6cb90640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a680c9750 0x7f0a680c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.017+0000 7f0a6cb90640 1 -- 172.21.15.136:0/3599158997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c009400 con 0x7f0a680c4420 2024-02-17T13:26:26.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.019+0000 7f0a6cb90640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 0x7f0a6806d810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c02bf70 tx=0x7f0a5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:26.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.023+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c03e040 con 0x7f0a680c4420 2024-02-17T13:26:26.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.023+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c039cb0 con 0x7f0a680c4420 2024-02-17T13:26:26.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.023+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a680cdd80 con 0x7f0a680c4420 2024-02-17T13:26:26.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.023+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c044630 con 0x7f0a680c4420 2024-02-17T13:26:26.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.023+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a680c6a20 con 0x7f0a680c4420 2024-02-17T13:26:26.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.024+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a680ce2a0 con 0x7f0a680c4420 2024-02-17T13:26:26.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.266+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0a5c04d3b0 con 0x7f0a680c4420 2024-02-17T13:26:26.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.266+0000 7f0a657fa640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a4c06b860 0x7f0a4c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:26.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.266+0000 7f0a67fff640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a4c06b860 0x7f0a4c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:26.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.266+0000 7f0a67fff640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a4c06b860 0x7f0a4c06dd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b1e60 tx=0x7f0a54009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.281+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f0a5c039e20 con 0x7f0a680c4420 2024-02-17T13:26:26.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.281+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a5c0773e0 con 0x7f0a680c4420 2024-02-17T13:26:26.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.459+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a680c7fd0 con 0x7f0a4c06b860 2024-02-17T13:26:26.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.468+0000 7f0a657fa640 1 -- 172.21.15.136:0/3599158997 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371453 (secure 0 0 0) 0x7f0a54001c90 con 0x7f0a4c06b860 2024-02-17T13:26:26.473 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:26:26.475 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T13:26:26.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a4c06b860 msgr2=0x7f0a4c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a4c06b860 0x7f0a4c06dd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b1e60 tx=0x7f0a54009040 comp rx=0 tx=0).stop 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 msgr2=0x7f0a6806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 0x7f0a6806d810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c02bf70 tx=0x7f0a5c004730 comp rx=0 tx=0).stop 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 shutdown_connections 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f0a4c06b860 0x7f0a4c06dd20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a68151e20 0x7f0a68155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a680c9750 0x7f0a680c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 --2- 172.21.15.136:0/3599158997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a680c4420 0x7f0a6806d810 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.471+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 >> 172.21.15.136:0/3599158997 conn(0x7f0a6806fe80 msgr2=0x7f0a6806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.472+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 shutdown_connections 2024-02-17T13:26:26.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:26.472+0000 7f0a6edf4640 1 -- 172.21.15.136:0/3599158997 wait complete. 2024-02-17T13:26:26.484 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":881,"stamp":"2024-02-17T13:26:26.359842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39668340,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1020,"num_read_kb":1067,"num_write":15160,"num_write_kb":353160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16092,"ondisk_log_size":16092,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":448672,"kb_used_data":79904,"kb_used_omap":12,"kb_used_meta":368691,"kb_avail":754526048,"statfs":{"total":773094113280,"available":772634673152,"internally_reserved":0,"allocated":81821696,"data_stored":80248720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":377540144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"2.1f","version":"26'636","reported_seq":684,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.145461+0000","last_change":"2024-02-17T13:26:06.145492+0000","last_active":"2024-02-17T13:26:06.145461+0000","last_peered":"2024-02-17T13:26:06.145461+0000","last_clean":"2024-02-17T13:26:06.145461+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T13:26:06.145461+0000","last_undegraded":"2024-02-17T13:26:06.145461+0000","last_fullsized":"2024-02-17T13:26:06.145461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'636","last_scrub_stamp":"2024-02-17T13:26:06.145396+0000","last_deep_scrub":"26'636","last_deep_scrub_stamp":"2024-02-17T13:26:06.145396+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.145396+0000","objects_scrubbed":7,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:45.966359+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"26'28","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.765483+0000","last_change":"2024-02-17T13:26:13.765505+0000","last_active":"2024-02-17T13:26:13.765483+0000","last_peered":"2024-02-17T13:26:13.765483+0000","last_clean":"2024-02-17T13:26:13.765483+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T13:26:13.765483+0000","last_undegraded":"2024-02-17T13:26:13.765483+0000","last_fullsized":"2024-02-17T13:26:13.765483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:13.765418+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:13.765418+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.765418+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:42.894992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'137","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.314572+0000","last_change":"2024-02-17T13:26:11.314596+0000","last_active":"2024-02-17T13:26:11.314572+0000","last_peered":"2024-02-17T13:26:11.314572+0000","last_clean":"2024-02-17T13:26:11.314572+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T13:26:11.314572+0000","last_undegraded":"2024-02-17T13:26:11.314572+0000","last_fullsized":"2024-02-17T13:26:11.314572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'137","last_scrub_stamp":"2024-02-17T13:26:11.314493+0000","last_deep_scrub":"26'137","last_deep_scrub_stamp":"2024-02-17T13:26:11.314493+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.314493+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:44.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'681","reported_seq":730,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.837755+0000","last_change":"2024-02-17T13:26:10.837796+0000","last_active":"2024-02-17T13:26:10.837755+0000","last_peered":"2024-02-17T13:26:10.837755+0000","last_clean":"2024-02-17T13:26:10.837755+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T13:26:10.837755+0000","last_undegraded":"2024-02-17T13:26:10.837755+0000","last_fullsized":"2024-02-17T13:26:10.837755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'681","last_scrub_stamp":"2024-02-17T13:26:10.837659+0000","last_deep_scrub":"26'681","last_deep_scrub_stamp":"2024-02-17T13:26:10.837659+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.837659+0000","objects_scrubbed":1,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:45:25.408526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":4495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"26'36","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.792745+0000","last_change":"2024-02-17T13:26:15.792786+0000","last_active":"2024-02-17T13:26:15.792745+0000","last_peered":"2024-02-17T13:26:15.792745+0000","last_clean":"2024-02-17T13:26:15.792745+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T13:26:15.792745+0000","last_undegraded":"2024-02-17T13:26:15.792745+0000","last_fullsized":"2024-02-17T13:26:15.792745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-02-17T13:26:15.792641+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-02-17T13:26:15.792641+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.792641+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:01.920060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"26'131","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.682668+0000","last_change":"2024-02-17T13:26:10.682692+0000","last_active":"2024-02-17T13:26:10.682668+0000","last_peered":"2024-02-17T13:26:10.682668+0000","last_clean":"2024-02-17T13:26:10.682668+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T13:26:10.682668+0000","last_undegraded":"2024-02-17T13:26:10.682668+0000","last_fullsized":"2024-02-17T13:26:10.682668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'131","last_scrub_stamp":"2024-02-17T13:26:10.682598+0000","last_deep_scrub":"26'131","last_deep_scrub_stamp":"2024-02-17T13:26:10.682598+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.682598+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:24.141155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'1340","reported_seq":1386,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.799023+0000","last_change":"2024-02-17T13:26:03.799062+0000","last_active":"2024-02-17T13:26:03.799023+0000","last_peered":"2024-02-17T13:26:03.799023+0000","last_clean":"2024-02-17T13:26:03.799023+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T13:26:03.799023+0000","last_undegraded":"2024-02-17T13:26:03.799023+0000","last_fullsized":"2024-02-17T13:26:03.799023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1340","last_scrub_stamp":"2024-02-17T13:26:03.798961+0000","last_deep_scrub":"26'1340","last_deep_scrub_stamp":"2024-02-17T13:26:03.798961+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.798961+0000","objects_scrubbed":9,"log_size":1340,"log_dups_size":0,"ondisk_log_size":1340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:09.514378+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"26'31","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.246195+0000","last_change":"2024-02-17T13:26:04.246216+0000","last_active":"2024-02-17T13:26:04.246195+0000","last_peered":"2024-02-17T13:26:04.246195+0000","last_clean":"2024-02-17T13:26:04.246195+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T13:26:04.246195+0000","last_undegraded":"2024-02-17T13:26:04.246195+0000","last_fullsized":"2024-02-17T13:26:04.246195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-02-17T13:26:04.246120+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-02-17T13:26:04.246120+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.246120+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:33:44.442052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'136","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.645680+0000","last_change":"2024-02-17T13:26:15.645702+0000","last_active":"2024-02-17T13:26:15.645680+0000","last_peered":"2024-02-17T13:26:15.645680+0000","last_clean":"2024-02-17T13:26:15.645680+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T13:26:15.645680+0000","last_undegraded":"2024-02-17T13:26:15.645680+0000","last_fullsized":"2024-02-17T13:26:15.645680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'136","last_scrub_stamp":"2024-02-17T13:26:15.645605+0000","last_deep_scrub":"26'136","last_deep_scrub_stamp":"2024-02-17T13:26:15.645605+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.645605+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:44.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":9317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'10","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.752863+0000","last_change":"2024-02-17T13:26:04.752891+0000","last_active":"2024-02-17T13:26:04.752863+0000","last_peered":"2024-02-17T13:26:04.752863+0000","last_clean":"2024-02-17T13:26:04.752863+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T13:26:04.752863+0000","last_undegraded":"2024-02-17T13:26:04.752863+0000","last_fullsized":"2024-02-17T13:26:04.752863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-02-17T13:26:04.752783+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-02-17T13:26:04.752783+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.752783+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:49.222350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"26'47","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.835233+0000","last_change":"2024-02-17T13:26:04.835255+0000","last_active":"2024-02-17T13:26:04.835233+0000","last_peered":"2024-02-17T13:26:04.835233+0000","last_clean":"2024-02-17T13:26:04.835233+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T13:26:04.835233+0000","last_undegraded":"2024-02-17T13:26:04.835233+0000","last_fullsized":"2024-02-17T13:26:04.835233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'47","last_scrub_stamp":"2024-02-17T13:26:04.835163+0000","last_deep_scrub":"26'47","last_deep_scrub_stamp":"2024-02-17T13:26:04.835163+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.835163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:42.915209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"26'132","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.667279+0000","last_change":"2024-02-17T13:26:11.667324+0000","last_active":"2024-02-17T13:26:11.667279+0000","last_peered":"2024-02-17T13:26:11.667279+0000","last_clean":"2024-02-17T13:26:11.667279+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T13:26:11.667279+0000","last_undegraded":"2024-02-17T13:26:11.667279+0000","last_fullsized":"2024-02-17T13:26:11.667279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'132","last_scrub_stamp":"2024-02-17T13:26:11.667198+0000","last_deep_scrub":"26'132","last_deep_scrub_stamp":"2024-02-17T13:26:11.667198+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.667198+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:15.793632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":5852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"26'36","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.922231+0000","last_change":"2024-02-17T13:26:07.922231+0000","last_active":"2024-02-17T13:26:07.922231+0000","last_peered":"2024-02-17T13:26:07.922231+0000","last_clean":"2024-02-17T13:26:07.922231+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T13:26:07.922231+0000","last_undegraded":"2024-02-17T13:26:07.922231+0000","last_fullsized":"2024-02-17T13:26:07.922231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-02-17T13:26:07.922096+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-02-17T13:26:07.922096+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.922096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:37.051670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'624","reported_seq":671,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.987535+0000","last_change":"2024-02-17T13:26:17.987566+0000","last_active":"2024-02-17T13:26:17.987535+0000","last_peered":"2024-02-17T13:26:17.987535+0000","last_clean":"2024-02-17T13:26:17.987535+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T13:26:17.987535+0000","last_undegraded":"2024-02-17T13:26:17.987535+0000","last_fullsized":"2024-02-17T13:26:17.987535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'624","last_scrub_stamp":"2024-02-17T13:26:17.987471+0000","last_deep_scrub":"26'624","last_deep_scrub_stamp":"2024-02-17T13:26:17.987471+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.987471+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:21.439932+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'112","reported_seq":143,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.193581+0000","last_change":"2024-02-17T12:58:02.536110+0000","last_active":"2024-02-17T13:25:21.193581+0000","last_peered":"2024-02-17T13:25:21.193581+0000","last_clean":"2024-02-17T13:25:21.193581+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T13:25:21.193581+0000","last_undegraded":"2024-02-17T13:25:21.193581+0000","last_fullsized":"2024-02-17T13:25:21.193581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'34","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.351898+0000","last_change":"2024-02-17T13:26:10.351924+0000","last_active":"2024-02-17T13:26:10.351898+0000","last_peered":"2024-02-17T13:26:10.351898+0000","last_clean":"2024-02-17T13:26:10.351898+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T13:26:10.351898+0000","last_undegraded":"2024-02-17T13:26:10.351898+0000","last_fullsized":"2024-02-17T13:26:10.351898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:10.351806+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:10.351806+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.351806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:21:19.485003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'8","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.973333+0000","last_change":"2024-02-17T13:26:06.973333+0000","last_active":"2024-02-17T13:26:06.973333+0000","last_peered":"2024-02-17T13:26:06.973333+0000","last_clean":"2024-02-17T13:26:06.973333+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T13:26:06.973333+0000","last_undegraded":"2024-02-17T13:26:06.973333+0000","last_fullsized":"2024-02-17T13:26:06.973333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:06.973236+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:06.973236+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.973236+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:26:51.908733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"26'166","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.700596+0000","last_change":"2024-02-17T13:26:16.700622+0000","last_active":"2024-02-17T13:26:16.700596+0000","last_peered":"2024-02-17T13:26:16.700596+0000","last_clean":"2024-02-17T13:26:16.700596+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T13:26:16.700596+0000","last_undegraded":"2024-02-17T13:26:16.700596+0000","last_fullsized":"2024-02-17T13:26:16.700596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'166","last_scrub_stamp":"2024-02-17T13:26:16.700521+0000","last_deep_scrub":"26'166","last_deep_scrub_stamp":"2024-02-17T13:26:16.700521+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.700521+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:49:55.524622+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":14575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.207825+0000","last_change":"2024-02-17T13:26:13.207848+0000","last_active":"2024-02-17T13:26:13.207825+0000","last_peered":"2024-02-17T13:26:13.207825+0000","last_clean":"2024-02-17T13:26:13.207825+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T13:26:13.207825+0000","last_undegraded":"2024-02-17T13:26:13.207825+0000","last_fullsized":"2024-02-17T13:26:13.207825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:13.207754+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:13.207754+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.207754+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:17.334189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'13","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.117831+0000","last_change":"2024-02-17T13:26:04.117831+0000","last_active":"2024-02-17T13:26:04.117831+0000","last_peered":"2024-02-17T13:26:04.117831+0000","last_clean":"2024-02-17T13:26:04.117831+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T13:26:04.117831+0000","last_undegraded":"2024-02-17T13:26:04.117831+0000","last_fullsized":"2024-02-17T13:26:04.117831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-02-17T13:26:04.117751+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-02-17T13:26:04.117751+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.117751+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:26:49.053248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'115","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.238171+0000","last_change":"2024-02-17T13:26:13.238212+0000","last_active":"2024-02-17T13:26:13.238171+0000","last_peered":"2024-02-17T13:26:13.238171+0000","last_clean":"2024-02-17T13:26:13.238171+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T13:26:13.238171+0000","last_undegraded":"2024-02-17T13:26:13.238171+0000","last_fullsized":"2024-02-17T13:26:13.238171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2024-02-17T13:26:13.238067+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2024-02-17T13:26:13.238067+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.238067+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:53.059030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'33","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.959297+0000","last_change":"2024-02-17T13:26:10.959332+0000","last_active":"2024-02-17T13:26:10.959297+0000","last_peered":"2024-02-17T13:26:10.959297+0000","last_clean":"2024-02-17T13:26:10.959297+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T13:26:10.959297+0000","last_undegraded":"2024-02-17T13:26:10.959297+0000","last_fullsized":"2024-02-17T13:26:10.959297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:10.959202+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:10.959202+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.959202+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:38:02.585194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'8","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.754893+0000","last_change":"2024-02-17T13:26:02.754893+0000","last_active":"2024-02-17T13:26:02.754893+0000","last_peered":"2024-02-17T13:26:02.754893+0000","last_clean":"2024-02-17T13:26:02.754893+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T13:26:02.754893+0000","last_undegraded":"2024-02-17T13:26:02.754893+0000","last_fullsized":"2024-02-17T13:26:02.754893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:02.754749+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:02.754749+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.754749+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:16:48.541087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'126","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.697604+0000","last_change":"2024-02-17T13:26:13.697628+0000","last_active":"2024-02-17T13:26:13.697604+0000","last_peered":"2024-02-17T13:26:13.697604+0000","last_clean":"2024-02-17T13:26:13.697604+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T13:26:13.697604+0000","last_undegraded":"2024-02-17T13:26:13.697604+0000","last_fullsized":"2024-02-17T13:26:13.697604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2024-02-17T13:26:13.697528+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2024-02-17T13:26:13.697528+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.697528+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:22:41.754869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'40","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.212070+0000","last_change":"2024-02-17T13:26:14.212090+0000","last_active":"2024-02-17T13:26:14.212070+0000","last_peered":"2024-02-17T13:26:14.212070+0000","last_clean":"2024-02-17T13:26:14.212070+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T13:26:14.212070+0000","last_undegraded":"2024-02-17T13:26:14.212070+0000","last_fullsized":"2024-02-17T13:26:14.212070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-02-17T13:26:14.212004+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-02-17T13:26:14.212004+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.212004+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:45:28.782871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'20","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.026906+0000","last_change":"2024-02-17T13:26:14.026937+0000","last_active":"2024-02-17T13:26:14.026906+0000","last_peered":"2024-02-17T13:26:14.026906+0000","last_clean":"2024-02-17T13:26:14.026906+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T13:26:14.026906+0000","last_undegraded":"2024-02-17T13:26:14.026906+0000","last_fullsized":"2024-02-17T13:26:14.026906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-02-17T13:26:14.026828+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-02-17T13:26:14.026828+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.026828+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:46:45.623620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"26'146","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.708557+0000","last_change":"2024-02-17T13:26:09.708582+0000","last_active":"2024-02-17T13:26:09.708557+0000","last_peered":"2024-02-17T13:26:09.708557+0000","last_clean":"2024-02-17T13:26:09.708557+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T13:26:09.708557+0000","last_undegraded":"2024-02-17T13:26:09.708557+0000","last_fullsized":"2024-02-17T13:26:09.708557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'146","last_scrub_stamp":"2024-02-17T13:26:09.708475+0000","last_deep_scrub":"26'146","last_deep_scrub_stamp":"2024-02-17T13:26:09.708475+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.708475+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:34.451098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.127142+0000","last_change":"2024-02-17T13:26:03.127142+0000","last_active":"2024-02-17T13:26:03.127142+0000","last_peered":"2024-02-17T13:26:03.127142+0000","last_clean":"2024-02-17T13:26:03.127142+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T13:26:03.127142+0000","last_undegraded":"2024-02-17T13:26:03.127142+0000","last_fullsized":"2024-02-17T13:26:03.127142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:03.127052+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:03.127052+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.127052+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:24.657278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1342","reported_seq":1390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.141500+0000","last_change":"2024-02-17T13:26:05.141500+0000","last_active":"2024-02-17T13:26:05.141500+0000","last_peered":"2024-02-17T13:26:05.141500+0000","last_clean":"2024-02-17T13:26:05.141500+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T13:26:05.141500+0000","last_undegraded":"2024-02-17T13:26:05.141500+0000","last_fullsized":"2024-02-17T13:26:05.141500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1342","last_scrub_stamp":"2024-02-17T13:26:05.141412+0000","last_deep_scrub":"26'1342","last_deep_scrub_stamp":"2024-02-17T13:26:05.141412+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.141412+0000","objects_scrubbed":4,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:48.441561+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":1198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'135","reported_seq":176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.253962+0000","last_change":"2024-02-17T13:26:15.253985+0000","last_active":"2024-02-17T13:26:15.253962+0000","last_peered":"2024-02-17T13:26:15.253962+0000","last_clean":"2024-02-17T13:26:15.253962+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T13:26:15.253962+0000","last_undegraded":"2024-02-17T13:26:15.253962+0000","last_fullsized":"2024-02-17T13:26:15.253962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'135","last_scrub_stamp":"2024-02-17T13:26:15.253897+0000","last_deep_scrub":"26'135","last_deep_scrub_stamp":"2024-02-17T13:26:15.253897+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.253897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:38.118611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"26'35","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.011098+0000","last_change":"2024-02-17T13:26:14.011144+0000","last_active":"2024-02-17T13:26:14.011098+0000","last_peered":"2024-02-17T13:26:14.011098+0000","last_clean":"2024-02-17T13:26:14.011098+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T13:26:14.011098+0000","last_undegraded":"2024-02-17T13:26:14.011098+0000","last_fullsized":"2024-02-17T13:26:14.011098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:14.011018+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:14.011018+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.011018+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:39.973629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'9","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.031407+0000","last_change":"2024-02-17T13:26:15.031431+0000","last_active":"2024-02-17T13:26:15.031407+0000","last_peered":"2024-02-17T13:26:15.031407+0000","last_clean":"2024-02-17T13:26:15.031407+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T13:26:15.031407+0000","last_undegraded":"2024-02-17T13:26:15.031407+0000","last_fullsized":"2024-02-17T13:26:15.031407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-02-17T13:26:15.031336+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-02-17T13:26:15.031336+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.031336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:37:41.017535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"26'127","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.946297+0000","last_change":"2024-02-17T13:26:15.946320+0000","last_active":"2024-02-17T13:26:15.946297+0000","last_peered":"2024-02-17T13:26:15.946297+0000","last_clean":"2024-02-17T13:26:15.946297+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T13:26:15.946297+0000","last_undegraded":"2024-02-17T13:26:15.946297+0000","last_fullsized":"2024-02-17T13:26:15.946297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'127","last_scrub_stamp":"2024-02-17T13:26:15.946229+0000","last_deep_scrub":"26'127","last_deep_scrub_stamp":"2024-02-17T13:26:15.946229+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.946229+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:18:09.600737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.806125+0000","last_change":"2024-02-17T13:26:05.806149+0000","last_active":"2024-02-17T13:26:05.806125+0000","last_peered":"2024-02-17T13:26:05.806125+0000","last_clean":"2024-02-17T13:26:05.806125+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T13:26:05.806125+0000","last_undegraded":"2024-02-17T13:26:05.806125+0000","last_fullsized":"2024-02-17T13:26:05.806125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:05.806052+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:05.806052+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.806052+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:45.627015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'3","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.793265+0000","last_change":"2024-02-17T13:26:09.793289+0000","last_active":"2024-02-17T13:26:09.793265+0000","last_peered":"2024-02-17T13:26:09.793265+0000","last_clean":"2024-02-17T13:26:09.793265+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T13:26:09.793265+0000","last_undegraded":"2024-02-17T13:26:09.793265+0000","last_fullsized":"2024-02-17T13:26:09.793265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-02-17T13:26:09.793195+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-02-17T13:26:09.793195+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.793195+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:13.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"26'191","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.928684+0000","last_change":"2024-02-17T13:26:16.928727+0000","last_active":"2024-02-17T13:26:16.928684+0000","last_peered":"2024-02-17T13:26:16.928684+0000","last_clean":"2024-02-17T13:26:16.928684+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T13:26:16.928684+0000","last_undegraded":"2024-02-17T13:26:16.928684+0000","last_fullsized":"2024-02-17T13:26:16.928684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-02-17T13:26:16.928572+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-02-17T13:26:16.928572+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.928572+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:55.008618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.796819+0000","last_change":"2024-02-17T13:26:09.796844+0000","last_active":"2024-02-17T13:26:09.796819+0000","last_peered":"2024-02-17T13:26:09.796819+0000","last_clean":"2024-02-17T13:26:09.796819+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T13:26:09.796819+0000","last_undegraded":"2024-02-17T13:26:09.796819+0000","last_fullsized":"2024-02-17T13:26:09.796819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:09.796741+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:09.796741+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.796741+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:47.876788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'13","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.983627+0000","last_change":"2024-02-17T13:26:12.983652+0000","last_active":"2024-02-17T13:26:12.983627+0000","last_peered":"2024-02-17T13:26:12.983627+0000","last_clean":"2024-02-17T13:26:12.983627+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T13:26:12.983627+0000","last_undegraded":"2024-02-17T13:26:12.983627+0000","last_fullsized":"2024-02-17T13:26:12.983627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-02-17T13:26:12.983561+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-02-17T13:26:12.983561+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.983561+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:34:51.205634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'113","reported_seq":153,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.973937+0000","last_change":"2024-02-17T13:26:17.973982+0000","last_active":"2024-02-17T13:26:17.973937+0000","last_peered":"2024-02-17T13:26:17.973937+0000","last_clean":"2024-02-17T13:26:17.973937+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T13:26:17.973937+0000","last_undegraded":"2024-02-17T13:26:17.973937+0000","last_fullsized":"2024-02-17T13:26:17.973937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'113","last_scrub_stamp":"2024-02-17T13:26:17.973808+0000","last_deep_scrub":"26'113","last_deep_scrub_stamp":"2024-02-17T13:26:17.973808+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.973808+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:40.838522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"26'31","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.734182+0000","last_change":"2024-02-17T13:26:12.734205+0000","last_active":"2024-02-17T13:26:12.734182+0000","last_peered":"2024-02-17T13:26:12.734182+0000","last_clean":"2024-02-17T13:26:12.734182+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T13:26:12.734182+0000","last_undegraded":"2024-02-17T13:26:12.734182+0000","last_fullsized":"2024-02-17T13:26:12.734182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-02-17T13:26:12.734107+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-02-17T13:26:12.734107+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.734107+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:30.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'917","reported_seq":1869,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.366369+0000","last_change":"2024-02-17T13:26:06.366395+0000","last_active":"2024-02-17T13:26:06.366369+0000","last_peered":"2024-02-17T13:26:06.366369+0000","last_clean":"2024-02-17T13:26:06.366369+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T13:26:06.366369+0000","last_undegraded":"2024-02-17T13:26:06.366369+0000","last_fullsized":"2024-02-17T13:26:06.366369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'917","last_scrub_stamp":"2024-02-17T13:26:06.366306+0000","last_deep_scrub":"26'917","last_deep_scrub_stamp":"2024-02-17T13:26:06.366306+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.366306+0000","objects_scrubbed":4,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:44.329265+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210123,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":913,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'127","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.979792+0000","last_change":"2024-02-17T13:26:14.979816+0000","last_active":"2024-02-17T13:26:14.979792+0000","last_peered":"2024-02-17T13:26:14.979792+0000","last_clean":"2024-02-17T13:26:14.979792+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T13:26:14.979792+0000","last_undegraded":"2024-02-17T13:26:14.979792+0000","last_fullsized":"2024-02-17T13:26:14.979792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'127","last_scrub_stamp":"2024-02-17T13:26:14.979720+0000","last_deep_scrub":"26'127","last_deep_scrub_stamp":"2024-02-17T13:26:14.979720+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.979720+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:23:58.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"26'29","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.021354+0000","last_change":"2024-02-17T13:26:08.021380+0000","last_active":"2024-02-17T13:26:08.021354+0000","last_peered":"2024-02-17T13:26:08.021354+0000","last_clean":"2024-02-17T13:26:08.021354+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T13:26:08.021354+0000","last_undegraded":"2024-02-17T13:26:08.021354+0000","last_fullsized":"2024-02-17T13:26:08.021354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'29","last_scrub_stamp":"2024-02-17T13:26:08.021284+0000","last_deep_scrub":"26'29","last_deep_scrub_stamp":"2024-02-17T13:26:08.021284+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.021284+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:53.127639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'491","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:20.029515+0000","last_change":"2024-02-17T13:26:20.029546+0000","last_active":"2024-02-17T13:26:20.029515+0000","last_peered":"2024-02-17T13:26:20.029515+0000","last_clean":"2024-02-17T13:26:20.029515+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T13:26:20.029515+0000","last_undegraded":"2024-02-17T13:26:20.029515+0000","last_fullsized":"2024-02-17T13:26:20.029515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'491","last_scrub_stamp":"2024-02-17T13:26:20.029439+0000","last_deep_scrub":"26'491","last_deep_scrub_stamp":"2024-02-17T13:26:20.029439+0000","last_clean_scrub_stamp":"2024-02-17T13:26:20.029439+0000","objects_scrubbed":2,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:09.104716+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'120","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:21.926237+0000","last_change":"2024-02-17T13:26:21.926261+0000","last_active":"2024-02-17T13:26:21.926237+0000","last_peered":"2024-02-17T13:26:21.926237+0000","last_clean":"2024-02-17T13:26:21.926237+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T13:26:21.926237+0000","last_undegraded":"2024-02-17T13:26:21.926237+0000","last_fullsized":"2024-02-17T13:26:21.926237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'120","last_scrub_stamp":"2024-02-17T13:26:21.926156+0000","last_deep_scrub":"26'120","last_deep_scrub_stamp":"2024-02-17T13:26:21.926156+0000","last_clean_scrub_stamp":"2024-02-17T13:26:21.926156+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:37:14.075831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'33","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.250475+0000","last_change":"2024-02-17T13:26:09.250502+0000","last_active":"2024-02-17T13:26:09.250475+0000","last_peered":"2024-02-17T13:26:09.250475+0000","last_clean":"2024-02-17T13:26:09.250475+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T13:26:09.250475+0000","last_undegraded":"2024-02-17T13:26:09.250475+0000","last_fullsized":"2024-02-17T13:26:09.250475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:09.250383+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:09.250383+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.250383+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.719949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'13","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.997187+0000","last_change":"2024-02-17T13:26:16.997234+0000","last_active":"2024-02-17T13:26:16.997187+0000","last_peered":"2024-02-17T13:26:16.997187+0000","last_clean":"2024-02-17T13:26:16.997187+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T13:26:16.997187+0000","last_undegraded":"2024-02-17T13:26:16.997187+0000","last_fullsized":"2024-02-17T13:26:16.997187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-02-17T13:26:16.997109+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-02-17T13:26:16.997109+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.997109+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:48:07.544049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.289604+0000","last_change":"2024-02-17T13:26:01.289633+0000","last_active":"2024-02-17T13:26:01.289604+0000","last_peered":"2024-02-17T13:26:01.289604+0000","last_clean":"2024-02-17T13:26:01.289604+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T13:26:01.289604+0000","last_undegraded":"2024-02-17T13:26:01.289604+0000","last_fullsized":"2024-02-17T13:26:01.289604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-02-17T13:26:01.289538+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-02-17T13:26:01.289538+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.289538+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:40:19.512484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"26'170","reported_seq":202,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:18.859385+0000","last_change":"2024-02-17T12:58:02.527352+0000","last_active":"2024-02-17T13:25:18.859385+0000","last_peered":"2024-02-17T13:25:18.859385+0000","last_clean":"2024-02-17T13:25:18.859385+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T13:25:18.859385+0000","last_undegraded":"2024-02-17T13:25:18.859385+0000","last_fullsized":"2024-02-17T13:25:18.859385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":8669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"26'34","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.895697+0000","last_change":"2024-02-17T13:26:06.895720+0000","last_active":"2024-02-17T13:26:06.895697+0000","last_peered":"2024-02-17T13:26:06.895697+0000","last_clean":"2024-02-17T13:26:06.895697+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T13:26:06.895697+0000","last_undegraded":"2024-02-17T13:26:06.895697+0000","last_fullsized":"2024-02-17T13:26:06.895697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:06.895627+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:06.895627+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.895627+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:24.461103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'12","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.942019+0000","last_change":"2024-02-17T13:26:05.942063+0000","last_active":"2024-02-17T13:26:05.942019+0000","last_peered":"2024-02-17T13:26:05.942019+0000","last_clean":"2024-02-17T13:26:05.942019+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T13:26:05.942019+0000","last_undegraded":"2024-02-17T13:26:05.942019+0000","last_fullsized":"2024-02-17T13:26:05.942019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-02-17T13:26:05.941923+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-02-17T13:26:05.941923+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.941923+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:27.472150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'141","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.700898+0000","last_change":"2024-02-17T13:26:12.700898+0000","last_active":"2024-02-17T13:26:12.700898+0000","last_peered":"2024-02-17T13:26:12.700898+0000","last_clean":"2024-02-17T13:26:12.700898+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T13:26:12.700898+0000","last_undegraded":"2024-02-17T13:26:12.700898+0000","last_fullsized":"2024-02-17T13:26:12.700898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'141","last_scrub_stamp":"2024-02-17T13:26:12.700784+0000","last_deep_scrub":"26'141","last_deep_scrub_stamp":"2024-02-17T13:26:12.700784+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.700784+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:45:27.271651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'39","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.791142+0000","last_change":"2024-02-17T13:26:12.791169+0000","last_active":"2024-02-17T13:26:12.791142+0000","last_peered":"2024-02-17T13:26:12.791142+0000","last_clean":"2024-02-17T13:26:12.791142+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T13:26:12.791142+0000","last_undegraded":"2024-02-17T13:26:12.791142+0000","last_fullsized":"2024-02-17T13:26:12.791142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:12.791075+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:12.791075+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.791075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:41.920649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'11","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.788951+0000","last_change":"2024-02-17T13:26:08.788979+0000","last_active":"2024-02-17T13:26:08.788951+0000","last_peered":"2024-02-17T13:26:08.788951+0000","last_clean":"2024-02-17T13:26:08.788951+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T13:26:08.788951+0000","last_undegraded":"2024-02-17T13:26:08.788951+0000","last_fullsized":"2024-02-17T13:26:08.788951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-02-17T13:26:08.788860+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-02-17T13:26:08.788860+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.788860+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:22.247417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'175","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:19.925644+0000","last_change":"2024-02-17T13:26:19.925671+0000","last_active":"2024-02-17T13:26:19.925644+0000","last_peered":"2024-02-17T13:26:19.925644+0000","last_clean":"2024-02-17T13:26:19.925644+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T13:26:19.925644+0000","last_undegraded":"2024-02-17T13:26:19.925644+0000","last_fullsized":"2024-02-17T13:26:19.925644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'175","last_scrub_stamp":"2024-02-17T13:26:19.925559+0000","last_deep_scrub":"26'175","last_deep_scrub_stamp":"2024-02-17T13:26:19.925559+0000","last_clean_scrub_stamp":"2024-02-17T13:26:19.925559+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:46:51.522351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:00.721503+0000","last_change":"2024-02-17T13:26:00.721524+0000","last_active":"2024-02-17T13:26:00.721503+0000","last_peered":"2024-02-17T13:26:00.721503+0000","last_clean":"2024-02-17T13:26:00.721503+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T13:26:00.721503+0000","last_undegraded":"2024-02-17T13:26:00.721503+0000","last_fullsized":"2024-02-17T13:26:00.721503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:00.721437+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:00.721437+0000","last_clean_scrub_stamp":"2024-02-17T13:26:00.721437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:45.827792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.160756+0000","last_change":"2024-02-17T13:26:07.160809+0000","last_active":"2024-02-17T13:26:07.160756+0000","last_peered":"2024-02-17T13:26:07.160756+0000","last_clean":"2024-02-17T13:26:07.160756+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T13:26:07.160756+0000","last_undegraded":"2024-02-17T13:26:07.160756+0000","last_fullsized":"2024-02-17T13:26:07.160756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:07.160676+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:07.160676+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.160676+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:39:46.826114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"26'122","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.133211+0000","last_change":"2024-02-17T12:58:02.526210+0000","last_active":"2024-02-17T13:26:02.133211+0000","last_peered":"2024-02-17T13:26:02.133211+0000","last_clean":"2024-02-17T13:26:02.133211+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T13:26:02.133211+0000","last_undegraded":"2024-02-17T13:26:02.133211+0000","last_fullsized":"2024-02-17T13:26:02.133211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'21","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.758812+0000","last_change":"2024-02-17T13:26:06.758835+0000","last_active":"2024-02-17T13:26:06.758812+0000","last_peered":"2024-02-17T13:26:06.758812+0000","last_clean":"2024-02-17T13:26:06.758812+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T13:26:06.758812+0000","last_undegraded":"2024-02-17T13:26:06.758812+0000","last_fullsized":"2024-02-17T13:26:06.758812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2024-02-17T13:26:06.758744+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2024-02-17T13:26:06.758744+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.758744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:37:53.956853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'8","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.714607+0000","last_change":"2024-02-17T13:26:05.714637+0000","last_active":"2024-02-17T13:26:05.714607+0000","last_peered":"2024-02-17T13:26:05.714607+0000","last_clean":"2024-02-17T13:26:05.714607+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T13:26:05.714607+0000","last_undegraded":"2024-02-17T13:26:05.714607+0000","last_fullsized":"2024-02-17T13:26:05.714607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:05.714542+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:05.714542+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.714542+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:09.046873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"26'161","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.274537+0000","last_change":"2024-02-17T13:26:08.274537+0000","last_active":"2024-02-17T13:26:08.274537+0000","last_peered":"2024-02-17T13:26:08.274537+0000","last_clean":"2024-02-17T13:26:08.274537+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T13:26:08.274537+0000","last_undegraded":"2024-02-17T13:26:08.274537+0000","last_fullsized":"2024-02-17T13:26:08.274537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'161","last_scrub_stamp":"2024-02-17T13:26:08.274429+0000","last_deep_scrub":"26'161","last_deep_scrub_stamp":"2024-02-17T13:26:08.274429+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.274429+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:21:17.407627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.902139+0000","last_change":"2024-02-17T13:26:02.902178+0000","last_active":"2024-02-17T13:26:02.902139+0000","last_peered":"2024-02-17T13:26:02.902139+0000","last_clean":"2024-02-17T13:26:02.902139+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T13:26:02.902139+0000","last_undegraded":"2024-02-17T13:26:02.902139+0000","last_fullsized":"2024-02-17T13:26:02.902139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:02.902059+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:02.902059+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.902059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:23:45.931985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'28","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.211627+0000","last_change":"2024-02-17T13:26:08.211666+0000","last_active":"2024-02-17T13:26:08.211627+0000","last_peered":"2024-02-17T13:26:08.211627+0000","last_clean":"2024-02-17T13:26:08.211627+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T13:26:08.211627+0000","last_undegraded":"2024-02-17T13:26:08.211627+0000","last_fullsized":"2024-02-17T13:26:08.211627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:08.211560+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:08.211560+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.211560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:13.926977+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"26'138","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.248982+0000","last_change":"2024-02-17T12:58:02.532846+0000","last_active":"2024-02-17T13:25:20.248982+0000","last_peered":"2024-02-17T13:25:20.248982+0000","last_clean":"2024-02-17T13:25:20.248982+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T13:25:20.248982+0000","last_undegraded":"2024-02-17T13:25:20.248982+0000","last_fullsized":"2024-02-17T13:25:20.248982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'30","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.233029+0000","last_change":"2024-02-17T13:26:07.233054+0000","last_active":"2024-02-17T13:26:07.233029+0000","last_peered":"2024-02-17T13:26:07.233029+0000","last_clean":"2024-02-17T13:26:07.233029+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T13:26:07.233029+0000","last_undegraded":"2024-02-17T13:26:07.233029+0000","last_fullsized":"2024-02-17T13:26:07.233029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-02-17T13:26:07.232950+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-02-17T13:26:07.232950+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.232950+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:02.260028+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'11","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.733932+0000","last_change":"2024-02-17T13:26:01.733958+0000","last_active":"2024-02-17T13:26:01.733932+0000","last_peered":"2024-02-17T13:26:01.733932+0000","last_clean":"2024-02-17T13:26:01.733932+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T13:26:01.733932+0000","last_undegraded":"2024-02-17T13:26:01.733932+0000","last_fullsized":"2024-02-17T13:26:01.733932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-02-17T13:26:01.733870+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-02-17T13:26:01.733870+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.733870+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:09.001282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"26'136","reported_seq":174,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:20.879711+0000","last_change":"2024-02-17T13:26:20.879755+0000","last_active":"2024-02-17T13:26:20.879711+0000","last_peered":"2024-02-17T13:26:20.879711+0000","last_clean":"2024-02-17T13:26:20.879711+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T13:26:20.879711+0000","last_undegraded":"2024-02-17T13:26:20.879711+0000","last_fullsized":"2024-02-17T13:26:20.879711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'136","last_scrub_stamp":"2024-02-17T13:26:20.879588+0000","last_deep_scrub":"26'136","last_deep_scrub_stamp":"2024-02-17T13:26:20.879588+0000","last_clean_scrub_stamp":"2024-02-17T13:26:20.879588+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:37:46.865787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'47","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.884642+0000","last_change":"2024-02-17T13:26:03.884662+0000","last_active":"2024-02-17T13:26:03.884642+0000","last_peered":"2024-02-17T13:26:03.884642+0000","last_clean":"2024-02-17T13:26:03.884642+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T13:26:03.884642+0000","last_undegraded":"2024-02-17T13:26:03.884642+0000","last_fullsized":"2024-02-17T13:26:03.884642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'47","last_scrub_stamp":"2024-02-17T13:26:03.884572+0000","last_deep_scrub":"26'47","last_deep_scrub_stamp":"2024-02-17T13:26:03.884572+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.884572+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:17:57.539080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'18","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.000306+0000","last_change":"2024-02-17T13:26:12.000350+0000","last_active":"2024-02-17T13:26:12.000306+0000","last_peered":"2024-02-17T13:26:12.000306+0000","last_clean":"2024-02-17T13:26:12.000306+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T13:26:12.000306+0000","last_undegraded":"2024-02-17T13:26:12.000306+0000","last_fullsized":"2024-02-17T13:26:12.000306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-02-17T13:26:12.000231+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-02-17T13:26:12.000231+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.000231+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:01.682523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'115","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:18.947192+0000","last_change":"2024-02-17T13:26:18.947221+0000","last_active":"2024-02-17T13:26:18.947192+0000","last_peered":"2024-02-17T13:26:18.947192+0000","last_clean":"2024-02-17T13:26:18.947192+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T13:26:18.947192+0000","last_undegraded":"2024-02-17T13:26:18.947192+0000","last_fullsized":"2024-02-17T13:26:18.947192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2024-02-17T13:26:18.947102+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2024-02-17T13:26:18.947102+0000","last_clean_scrub_stamp":"2024-02-17T13:26:18.947102+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:36.512578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"26'39","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.967940+0000","last_change":"2024-02-17T13:26:12.967964+0000","last_active":"2024-02-17T13:26:12.967940+0000","last_peered":"2024-02-17T13:26:12.967940+0000","last_clean":"2024-02-17T13:26:12.967940+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T13:26:12.967940+0000","last_undegraded":"2024-02-17T13:26:12.967940+0000","last_fullsized":"2024-02-17T13:26:12.967940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:12.967859+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:12.967859+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.967859+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:27:15.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'137","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.341615+0000","last_change":"2024-02-17T13:26:05.341643+0000","last_active":"2024-02-17T13:26:05.341615+0000","last_peered":"2024-02-17T13:26:05.341615+0000","last_clean":"2024-02-17T13:26:05.341615+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T13:26:05.341615+0000","last_undegraded":"2024-02-17T13:26:05.341615+0000","last_fullsized":"2024-02-17T13:26:05.341615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'137","last_scrub_stamp":"2024-02-17T13:26:05.341553+0000","last_deep_scrub":"26'137","last_deep_scrub_stamp":"2024-02-17T13:26:05.341553+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.341553+0000","objects_scrubbed":7,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:05:54.057507+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110453,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'131","reported_seq":161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:20.288364+0000","last_change":"2024-02-17T12:58:02.518988+0000","last_active":"2024-02-17T13:25:20.288364+0000","last_peered":"2024-02-17T13:25:20.288364+0000","last_clean":"2024-02-17T13:25:20.288364+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T13:25:20.288364+0000","last_undegraded":"2024-02-17T13:25:20.288364+0000","last_fullsized":"2024-02-17T13:25:20.288364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'37","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.814533+0000","last_change":"2024-02-17T13:26:11.814573+0000","last_active":"2024-02-17T13:26:11.814533+0000","last_peered":"2024-02-17T13:26:11.814533+0000","last_clean":"2024-02-17T13:26:11.814533+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T13:26:11.814533+0000","last_undegraded":"2024-02-17T13:26:11.814533+0000","last_fullsized":"2024-02-17T13:26:11.814533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-02-17T13:26:11.814444+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-02-17T13:26:11.814444+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.814444+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:29.379920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'827","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.819108+0000","last_change":"2024-02-17T13:26:01.819108+0000","last_active":"2024-02-17T13:26:01.819108+0000","last_peered":"2024-02-17T13:26:01.819108+0000","last_clean":"2024-02-17T13:26:01.819108+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T13:26:01.819108+0000","last_undegraded":"2024-02-17T13:26:01.819108+0000","last_fullsized":"2024-02-17T13:26:01.819108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'827","last_scrub_stamp":"2024-02-17T13:26:01.818949+0000","last_deep_scrub":"26'827","last_deep_scrub_stamp":"2024-02-17T13:26:01.818949+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.818949+0000","objects_scrubbed":6,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:56.846026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"26'125","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.289324+0000","last_change":"2024-02-17T13:26:17.289349+0000","last_active":"2024-02-17T13:26:17.289324+0000","last_peered":"2024-02-17T13:26:17.289324+0000","last_clean":"2024-02-17T13:26:17.289324+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T13:26:17.289324+0000","last_undegraded":"2024-02-17T13:26:17.289324+0000","last_fullsized":"2024-02-17T13:26:17.289324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2024-02-17T13:26:17.289246+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2024-02-17T13:26:17.289246+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.289246+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:20.116515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'32","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.852160+0000","last_change":"2024-02-17T13:26:05.852197+0000","last_active":"2024-02-17T13:26:05.852160+0000","last_peered":"2024-02-17T13:26:05.852160+0000","last_clean":"2024-02-17T13:26:05.852160+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T13:26:05.852160+0000","last_undegraded":"2024-02-17T13:26:05.852160+0000","last_fullsized":"2024-02-17T13:26:05.852160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-02-17T13:26:05.852074+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-02-17T13:26:05.852074+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.852074+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'658","reported_seq":704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.330788+0000","last_change":"2024-02-17T13:26:07.330835+0000","last_active":"2024-02-17T13:26:07.330788+0000","last_peered":"2024-02-17T13:26:07.330788+0000","last_clean":"2024-02-17T13:26:07.330788+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T13:26:07.330788+0000","last_undegraded":"2024-02-17T13:26:07.330788+0000","last_fullsized":"2024-02-17T13:26:07.330788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'658","last_scrub_stamp":"2024-02-17T13:26:07.330707+0000","last_deep_scrub":"26'658","last_deep_scrub_stamp":"2024-02-17T13:26:07.330707+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.330707+0000","objects_scrubbed":4,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:41.284319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"26'151","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.657427+0000","last_change":"2024-02-17T13:26:14.657480+0000","last_active":"2024-02-17T13:26:14.657427+0000","last_peered":"2024-02-17T13:26:14.657427+0000","last_clean":"2024-02-17T13:26:14.657427+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T13:26:14.657427+0000","last_undegraded":"2024-02-17T13:26:14.657427+0000","last_fullsized":"2024-02-17T13:26:14.657427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'151","last_scrub_stamp":"2024-02-17T13:26:14.657295+0000","last_deep_scrub":"26'151","last_deep_scrub_stamp":"2024-02-17T13:26:14.657295+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.657295+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:32.222771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":23394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"26'39","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.831948+0000","last_change":"2024-02-17T13:26:16.831974+0000","last_active":"2024-02-17T13:26:16.831948+0000","last_peered":"2024-02-17T13:26:16.831948+0000","last_clean":"2024-02-17T13:26:16.831948+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T13:26:16.831948+0000","last_undegraded":"2024-02-17T13:26:16.831948+0000","last_fullsized":"2024-02-17T13:26:16.831948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:16.831854+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:16.831854+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.831854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:38:08.457846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.746163+0000","last_change":"2024-02-17T13:26:06.746187+0000","last_active":"2024-02-17T13:26:06.746163+0000","last_peered":"2024-02-17T13:26:06.746163+0000","last_clean":"2024-02-17T13:26:06.746163+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T13:26:06.746163+0000","last_undegraded":"2024-02-17T13:26:06.746163+0000","last_fullsized":"2024-02-17T13:26:06.746163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-02-17T13:26:06.746101+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-02-17T13:26:06.746101+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.746101+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:32.708711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'126","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.270555+0000","last_change":"2024-02-17T13:26:12.270578+0000","last_active":"2024-02-17T13:26:12.270555+0000","last_peered":"2024-02-17T13:26:12.270555+0000","last_clean":"2024-02-17T13:26:12.270555+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T13:26:12.270555+0000","last_undegraded":"2024-02-17T13:26:12.270555+0000","last_fullsized":"2024-02-17T13:26:12.270555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2024-02-17T13:26:12.270468+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2024-02-17T13:26:12.270468+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.270468+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:55.570618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":10959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'43","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.730345+0000","last_change":"2024-02-17T13:26:07.730368+0000","last_active":"2024-02-17T13:26:07.730345+0000","last_peered":"2024-02-17T13:26:07.730345+0000","last_clean":"2024-02-17T13:26:07.730345+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T13:26:07.730345+0000","last_undegraded":"2024-02-17T13:26:07.730345+0000","last_fullsized":"2024-02-17T13:26:07.730345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'43","last_scrub_stamp":"2024-02-17T13:26:07.730273+0000","last_deep_scrub":"26'43","last_deep_scrub_stamp":"2024-02-17T13:26:07.730273+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.730273+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:52.199840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'14","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.267098+0000","last_change":"2024-02-17T13:26:02.267127+0000","last_active":"2024-02-17T13:26:02.267098+0000","last_peered":"2024-02-17T13:26:02.267098+0000","last_clean":"2024-02-17T13:26:02.267098+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T13:26:02.267098+0000","last_undegraded":"2024-02-17T13:26:02.267098+0000","last_fullsized":"2024-02-17T13:26:02.267098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-02-17T13:26:02.267038+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-02-17T13:26:02.267038+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.267038+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:24.897338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'167","reported_seq":206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:18.298289+0000","last_change":"2024-02-17T13:26:18.298331+0000","last_active":"2024-02-17T13:26:18.298289+0000","last_peered":"2024-02-17T13:26:18.298289+0000","last_clean":"2024-02-17T13:26:18.298289+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T13:26:18.298289+0000","last_undegraded":"2024-02-17T13:26:18.298289+0000","last_fullsized":"2024-02-17T13:26:18.298289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'167","last_scrub_stamp":"2024-02-17T13:26:18.298177+0000","last_deep_scrub":"26'167","last_deep_scrub_stamp":"2024-02-17T13:26:18.298177+0000","last_clean_scrub_stamp":"2024-02-17T13:26:18.298177+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:04.425596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"26'142","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.266654+0000","last_change":"2024-02-17T13:26:16.266676+0000","last_active":"2024-02-17T13:26:16.266654+0000","last_peered":"2024-02-17T13:26:16.266654+0000","last_clean":"2024-02-17T13:26:16.266654+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T13:26:16.266654+0000","last_undegraded":"2024-02-17T13:26:16.266654+0000","last_fullsized":"2024-02-17T13:26:16.266654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'142","last_scrub_stamp":"2024-02-17T13:26:16.266582+0000","last_deep_scrub":"26'142","last_deep_scrub_stamp":"2024-02-17T13:26:16.266582+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.266582+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:27:34.158354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":9062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"26'40","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.202906+0000","last_change":"2024-02-17T13:26:11.202929+0000","last_active":"2024-02-17T13:26:11.202906+0000","last_peered":"2024-02-17T13:26:11.202906+0000","last_clean":"2024-02-17T13:26:11.202906+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T13:26:11.202906+0000","last_undegraded":"2024-02-17T13:26:11.202906+0000","last_fullsized":"2024-02-17T13:26:11.202906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-02-17T13:26:11.202835+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-02-17T13:26:11.202835+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.202835+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:37.165445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'9","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:19.026565+0000","last_change":"2024-02-17T13:26:19.026589+0000","last_active":"2024-02-17T13:26:19.026565+0000","last_peered":"2024-02-17T13:26:19.026565+0000","last_clean":"2024-02-17T13:26:19.026565+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T13:26:19.026565+0000","last_undegraded":"2024-02-17T13:26:19.026565+0000","last_fullsized":"2024-02-17T13:26:19.026565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-02-17T13:26:19.026505+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-02-17T13:26:19.026505+0000","last_clean_scrub_stamp":"2024-02-17T13:26:19.026505+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:23:50.536306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:21.193398+0000","last_change":"2024-02-17T12:58:02.526385+0000","last_active":"2024-02-17T13:25:21.193398+0000","last_peered":"2024-02-17T13:25:21.193398+0000","last_clean":"2024-02-17T13:25:21.193398+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T13:25:21.193398+0000","last_undegraded":"2024-02-17T13:25:21.193398+0000","last_fullsized":"2024-02-17T13:25:21.193398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:58:01.234263+0000","last_clean_scrub_stamp":"2024-02-17T12:58:01.234263+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":20244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'41","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.779988+0000","last_change":"2024-02-17T13:26:11.780009+0000","last_active":"2024-02-17T13:26:11.779988+0000","last_peered":"2024-02-17T13:26:11.779988+0000","last_clean":"2024-02-17T13:26:11.779988+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T13:26:11.779988+0000","last_undegraded":"2024-02-17T13:26:11.779988+0000","last_fullsized":"2024-02-17T13:26:11.779988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'41","last_scrub_stamp":"2024-02-17T13:26:11.779918+0000","last_deep_scrub":"26'41","last_deep_scrub_stamp":"2024-02-17T13:26:11.779918+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.779918+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:22:39.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'14","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.979439+0000","last_change":"2024-02-17T13:26:04.979464+0000","last_active":"2024-02-17T13:26:04.979439+0000","last_peered":"2024-02-17T13:26:04.979439+0000","last_clean":"2024-02-17T13:26:04.979439+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T13:26:04.979439+0000","last_undegraded":"2024-02-17T13:26:04.979439+0000","last_fullsized":"2024-02-17T13:26:04.979439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-02-17T13:26:04.979376+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-02-17T13:26:04.979376+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.979376+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:34.498677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'684","reported_seq":730,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.015005+0000","last_change":"2024-02-17T13:26:16.015035+0000","last_active":"2024-02-17T13:26:16.015005+0000","last_peered":"2024-02-17T13:26:16.015005+0000","last_clean":"2024-02-17T13:26:16.015005+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T13:26:16.015005+0000","last_undegraded":"2024-02-17T13:26:16.015005+0000","last_fullsized":"2024-02-17T13:26:16.015005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'684","last_scrub_stamp":"2024-02-17T13:26:16.014902+0000","last_deep_scrub":"26'684","last_deep_scrub_stamp":"2024-02-17T13:26:16.014902+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.014902+0000","objects_scrubbed":4,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:50:23.531917+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"26'40","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.248009+0000","last_change":"2024-02-17T13:26:12.248037+0000","last_active":"2024-02-17T13:26:12.248009+0000","last_peered":"2024-02-17T13:26:12.248009+0000","last_clean":"2024-02-17T13:26:12.248009+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T13:26:12.248009+0000","last_undegraded":"2024-02-17T13:26:12.248009+0000","last_fullsized":"2024-02-17T13:26:12.248009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-02-17T13:26:12.247940+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-02-17T13:26:12.247940+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.247940+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:25.706496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'95","reported_seq":133,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:19.337558+0000","last_change":"2024-02-17T13:26:19.337582+0000","last_active":"2024-02-17T13:26:19.337558+0000","last_peered":"2024-02-17T13:26:19.337558+0000","last_clean":"2024-02-17T13:26:19.337558+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T13:26:19.337558+0000","last_undegraded":"2024-02-17T13:26:19.337558+0000","last_fullsized":"2024-02-17T13:26:19.337558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'95","last_scrub_stamp":"2024-02-17T13:26:19.337486+0000","last_deep_scrub":"26'95","last_deep_scrub_stamp":"2024-02-17T13:26:19.337486+0000","last_clean_scrub_stamp":"2024-02-17T13:26:19.337486+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:51.251243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'661","reported_seq":707,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.847639+0000","last_change":"2024-02-17T13:26:07.847693+0000","last_active":"2024-02-17T13:26:07.847639+0000","last_peered":"2024-02-17T13:26:07.847639+0000","last_clean":"2024-02-17T13:26:07.847639+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T13:26:07.847639+0000","last_undegraded":"2024-02-17T13:26:07.847639+0000","last_fullsized":"2024-02-17T13:26:07.847639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'661","last_scrub_stamp":"2024-02-17T13:26:07.847551+0000","last_deep_scrub":"26'661","last_deep_scrub_stamp":"2024-02-17T13:26:07.847551+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.847551+0000","objects_scrubbed":3,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.590174+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.235369+0000","last_change":"2024-02-17T13:26:06.235392+0000","last_active":"2024-02-17T13:26:06.235369+0000","last_peered":"2024-02-17T13:26:06.235369+0000","last_clean":"2024-02-17T13:26:06.235369+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T13:26:06.235369+0000","last_undegraded":"2024-02-17T13:26:06.235369+0000","last_fullsized":"2024-02-17T13:26:06.235369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:06.235300+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:06.235300+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.235300+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:35.754602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'162","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.611834+0000","last_change":"2024-02-17T13:26:16.611870+0000","last_active":"2024-02-17T13:26:16.611834+0000","last_peered":"2024-02-17T13:26:16.611834+0000","last_clean":"2024-02-17T13:26:16.611834+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T13:26:16.611834+0000","last_undegraded":"2024-02-17T13:26:16.611834+0000","last_fullsized":"2024-02-17T13:26:16.611834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'162","last_scrub_stamp":"2024-02-17T13:26:16.611755+0000","last_deep_scrub":"26'162","last_deep_scrub_stamp":"2024-02-17T13:26:16.611755+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.611755+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:41:19.361216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"26'49","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.760253+0000","last_change":"2024-02-17T13:26:04.760293+0000","last_active":"2024-02-17T13:26:04.760253+0000","last_peered":"2024-02-17T13:26:04.760253+0000","last_clean":"2024-02-17T13:26:04.760253+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T13:26:04.760253+0000","last_undegraded":"2024-02-17T13:26:04.760253+0000","last_fullsized":"2024-02-17T13:26:04.760253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'49","last_scrub_stamp":"2024-02-17T13:26:04.760180+0000","last_deep_scrub":"26'49","last_deep_scrub_stamp":"2024-02-17T13:26:04.760180+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.760180+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:48.060329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"26'49","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.397468+0000","last_change":"2024-02-17T13:26:09.397493+0000","last_active":"2024-02-17T13:26:09.397468+0000","last_peered":"2024-02-17T13:26:09.397468+0000","last_clean":"2024-02-17T13:26:09.397468+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T13:26:09.397468+0000","last_undegraded":"2024-02-17T13:26:09.397468+0000","last_fullsized":"2024-02-17T13:26:09.397468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'49","last_scrub_stamp":"2024-02-17T13:26:09.397389+0000","last_deep_scrub":"26'49","last_deep_scrub_stamp":"2024-02-17T13:26:09.397389+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.397389+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:58.905524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"26'45","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:25:49.452735+0000","last_change":"2024-02-17T12:57:57.806298+0000","last_active":"2024-02-17T13:25:49.452735+0000","last_peered":"2024-02-17T13:25:49.452735+0000","last_clean":"2024-02-17T13:25:49.452735+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T13:25:49.452735+0000","last_undegraded":"2024-02-17T13:25:49.452735+0000","last_fullsized":"2024-02-17T13:25:49.452735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:57:56.433669+0000","last_clean_scrub_stamp":"2024-02-17T12:57:56.433669+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"26'35","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.827967+0000","last_change":"2024-02-17T13:26:06.827991+0000","last_active":"2024-02-17T13:26:06.827967+0000","last_peered":"2024-02-17T13:26:06.827967+0000","last_clean":"2024-02-17T13:26:06.827967+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T13:26:06.827967+0000","last_undegraded":"2024-02-17T13:26:06.827967+0000","last_fullsized":"2024-02-17T13:26:06.827967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:06.827894+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:06.827894+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.827894+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:10.160225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"26'27","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.966999+0000","last_change":"2024-02-17T13:26:09.967022+0000","last_active":"2024-02-17T13:26:09.966999+0000","last_peered":"2024-02-17T13:26:09.966999+0000","last_clean":"2024-02-17T13:26:09.966999+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T13:26:09.966999+0000","last_undegraded":"2024-02-17T13:26:09.966999+0000","last_fullsized":"2024-02-17T13:26:09.966999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-02-17T13:26:09.966921+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-02-17T13:26:09.966921+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.966921+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:39:49.632359+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"26'32","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.983842+0000","last_change":"2024-02-17T13:26:10.983886+0000","last_active":"2024-02-17T13:26:10.983842+0000","last_peered":"2024-02-17T13:26:10.983842+0000","last_clean":"2024-02-17T13:26:10.983842+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T13:26:10.983842+0000","last_undegraded":"2024-02-17T13:26:10.983842+0000","last_fullsized":"2024-02-17T13:26:10.983842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-02-17T13:26:10.983767+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-02-17T13:26:10.983767+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.983767+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:16.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'43","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.706322+0000","last_change":"2024-02-17T13:26:08.706345+0000","last_active":"2024-02-17T13:26:08.706322+0000","last_peered":"2024-02-17T13:26:08.706322+0000","last_clean":"2024-02-17T13:26:08.706322+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T13:26:08.706322+0000","last_undegraded":"2024-02-17T13:26:08.706322+0000","last_fullsized":"2024-02-17T13:26:08.706322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'43","last_scrub_stamp":"2024-02-17T13:26:08.706246+0000","last_deep_scrub":"26'43","last_deep_scrub_stamp":"2024-02-17T13:26:08.706246+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.706246+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:12.038577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"26'31","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.846409+0000","last_change":"2024-02-17T13:26:17.846451+0000","last_active":"2024-02-17T13:26:17.846409+0000","last_peered":"2024-02-17T13:26:17.846409+0000","last_clean":"2024-02-17T13:26:17.846409+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T13:26:17.846409+0000","last_undegraded":"2024-02-17T13:26:17.846409+0000","last_fullsized":"2024-02-17T13:26:17.846409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-02-17T13:26:17.846316+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-02-17T13:26:17.846316+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.846316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:07.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:20.989067+0000","last_change":"2024-02-17T13:26:20.989089+0000","last_active":"2024-02-17T13:26:20.989067+0000","last_peered":"2024-02-17T13:26:20.989067+0000","last_clean":"2024-02-17T13:26:20.989067+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T13:26:20.989067+0000","last_undegraded":"2024-02-17T13:26:20.989067+0000","last_fullsized":"2024-02-17T13:26:20.989067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:20.988991+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:20.988991+0000","last_clean_scrub_stamp":"2024-02-17T13:26:20.988991+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:38:32.074029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"26'45","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.815691+0000","last_change":"2024-02-17T13:26:14.815735+0000","last_active":"2024-02-17T13:26:14.815691+0000","last_peered":"2024-02-17T13:26:14.815691+0000","last_clean":"2024-02-17T13:26:14.815691+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T13:26:14.815691+0000","last_undegraded":"2024-02-17T13:26:14.815691+0000","last_fullsized":"2024-02-17T13:26:14.815691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'45","last_scrub_stamp":"2024-02-17T13:26:14.815593+0000","last_deep_scrub":"26'45","last_deep_scrub_stamp":"2024-02-17T13:26:14.815593+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.815593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:41:17.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"26'38","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.225894+0000","last_change":"2024-02-17T13:26:03.225917+0000","last_active":"2024-02-17T13:26:03.225894+0000","last_peered":"2024-02-17T13:26:03.225894+0000","last_clean":"2024-02-17T13:26:03.225894+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T13:26:03.225894+0000","last_undegraded":"2024-02-17T13:26:03.225894+0000","last_fullsized":"2024-02-17T13:26:03.225894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2024-02-17T13:26:03.225811+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2024-02-17T13:26:03.225811+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.225811+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:17:20.293106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"26'45","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.201711+0000","last_change":"2024-02-17T13:26:10.201733+0000","last_active":"2024-02-17T13:26:10.201711+0000","last_peered":"2024-02-17T13:26:10.201711+0000","last_clean":"2024-02-17T13:26:10.201711+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T13:26:10.201711+0000","last_undegraded":"2024-02-17T13:26:10.201711+0000","last_fullsized":"2024-02-17T13:26:10.201711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'45","last_scrub_stamp":"2024-02-17T13:26:10.201639+0000","last_deep_scrub":"26'45","last_deep_scrub_stamp":"2024-02-17T13:26:10.201639+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.201639+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:13.533970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'39","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.270771+0000","last_change":"2024-02-17T13:26:14.270795+0000","last_active":"2024-02-17T13:26:14.270771+0000","last_peered":"2024-02-17T13:26:14.270771+0000","last_clean":"2024-02-17T13:26:14.270771+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T13:26:14.270771+0000","last_undegraded":"2024-02-17T13:26:14.270771+0000","last_fullsized":"2024-02-17T13:26:14.270771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:14.270710+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:14.270710+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.270710+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:39:53.936148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"26'32","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:21.962225+0000","last_change":"2024-02-17T13:26:21.962246+0000","last_active":"2024-02-17T13:26:21.962225+0000","last_peered":"2024-02-17T13:26:21.962225+0000","last_clean":"2024-02-17T13:26:21.962225+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T13:26:21.962225+0000","last_undegraded":"2024-02-17T13:26:21.962225+0000","last_fullsized":"2024-02-17T13:26:21.962225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-02-17T13:26:21.962120+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-02-17T13:26:21.962120+0000","last_clean_scrub_stamp":"2024-02-17T13:26:21.962120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:10.663683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"26'47","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.360669+0000","last_change":"2024-02-17T13:26:08.360692+0000","last_active":"2024-02-17T13:26:08.360669+0000","last_peered":"2024-02-17T13:26:08.360669+0000","last_clean":"2024-02-17T13:26:08.360669+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T13:26:08.360669+0000","last_undegraded":"2024-02-17T13:26:08.360669+0000","last_fullsized":"2024-02-17T13:26:08.360669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'47","last_scrub_stamp":"2024-02-17T13:26:08.360595+0000","last_deep_scrub":"26'47","last_deep_scrub_stamp":"2024-02-17T13:26:08.360595+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.360595+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:16.654443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.957345+0000","last_change":"2024-02-17T13:26:08.957367+0000","last_active":"2024-02-17T13:26:08.957345+0000","last_peered":"2024-02-17T13:26:08.957345+0000","last_clean":"2024-02-17T13:26:08.957345+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T13:26:08.957345+0000","last_undegraded":"2024-02-17T13:26:08.957345+0000","last_fullsized":"2024-02-17T13:26:08.957345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:08.957274+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:08.957274+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.957274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:41:11.706734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"26'42","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.972150+0000","last_change":"2024-02-17T13:26:09.972171+0000","last_active":"2024-02-17T13:26:09.972150+0000","last_peered":"2024-02-17T13:26:09.972150+0000","last_clean":"2024-02-17T13:26:09.972150+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T13:26:09.972150+0000","last_undegraded":"2024-02-17T13:26:09.972150+0000","last_fullsized":"2024-02-17T13:26:09.972150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'42","last_scrub_stamp":"2024-02-17T13:26:09.972074+0000","last_deep_scrub":"26'42","last_deep_scrub_stamp":"2024-02-17T13:26:09.972074+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.972074+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:34:56.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"26'41","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.784199+0000","last_change":"2024-02-17T13:26:04.784246+0000","last_active":"2024-02-17T13:26:04.784199+0000","last_peered":"2024-02-17T13:26:04.784199+0000","last_clean":"2024-02-17T13:26:04.784199+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T13:26:04.784199+0000","last_undegraded":"2024-02-17T13:26:04.784199+0000","last_fullsized":"2024-02-17T13:26:04.784199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'41","last_scrub_stamp":"2024-02-17T13:26:04.784115+0000","last_deep_scrub":"26'41","last_deep_scrub_stamp":"2024-02-17T13:26:04.784115+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.784115+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:37:51.982224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.977255+0000","last_change":"2024-02-17T13:26:11.977279+0000","last_active":"2024-02-17T13:26:11.977255+0000","last_peered":"2024-02-17T13:26:11.977255+0000","last_clean":"2024-02-17T13:26:11.977255+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T13:26:11.977255+0000","last_undegraded":"2024-02-17T13:26:11.977255+0000","last_fullsized":"2024-02-17T13:26:11.977255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:11.977185+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:11.977185+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.977185+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:56.446752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"26'39","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.015506+0000","last_change":"2024-02-17T13:26:09.015563+0000","last_active":"2024-02-17T13:26:09.015506+0000","last_peered":"2024-02-17T13:26:09.015506+0000","last_clean":"2024-02-17T13:26:09.015506+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T13:26:09.015506+0000","last_undegraded":"2024-02-17T13:26:09.015506+0000","last_fullsized":"2024-02-17T13:26:09.015506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:09.015407+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:09.015407+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.015407+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:16.282819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'28","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.755724+0000","last_change":"2024-02-17T13:26:08.755767+0000","last_active":"2024-02-17T13:26:08.755724+0000","last_peered":"2024-02-17T13:26:08.755724+0000","last_clean":"2024-02-17T13:26:08.755724+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T13:26:08.755724+0000","last_undegraded":"2024-02-17T13:26:08.755724+0000","last_fullsized":"2024-02-17T13:26:08.755724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:08.755644+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:08.755644+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.755644+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:12.882079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.767200+0000","last_change":"2024-02-17T13:26:14.767245+0000","last_active":"2024-02-17T13:26:14.767200+0000","last_peered":"2024-02-17T13:26:14.767200+0000","last_clean":"2024-02-17T13:26:14.767200+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T13:26:14.767200+0000","last_undegraded":"2024-02-17T13:26:14.767200+0000","last_fullsized":"2024-02-17T13:26:14.767200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:14.767083+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:14.767083+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.767083+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:00.894502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"26'48","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.810743+0000","last_change":"2024-02-17T13:26:10.810764+0000","last_active":"2024-02-17T13:26:10.810743+0000","last_peered":"2024-02-17T13:26:10.810743+0000","last_clean":"2024-02-17T13:26:10.810743+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T13:26:10.810743+0000","last_undegraded":"2024-02-17T13:26:10.810743+0000","last_fullsized":"2024-02-17T13:26:10.810743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'48","last_scrub_stamp":"2024-02-17T13:26:10.810670+0000","last_deep_scrub":"26'48","last_deep_scrub_stamp":"2024-02-17T13:26:10.810670+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.810670+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:33.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"26'38","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.281478+0000","last_change":"2024-02-17T13:26:05.281516+0000","last_active":"2024-02-17T13:26:05.281478+0000","last_peered":"2024-02-17T13:26:05.281478+0000","last_clean":"2024-02-17T13:26:05.281478+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T13:26:05.281478+0000","last_undegraded":"2024-02-17T13:26:05.281478+0000","last_fullsized":"2024-02-17T13:26:05.281478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2024-02-17T13:26:05.281371+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2024-02-17T13:26:05.281371+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.281371+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:39.684223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"26'28","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:18.886997+0000","last_change":"2024-02-17T13:26:18.887025+0000","last_active":"2024-02-17T13:26:18.886997+0000","last_peered":"2024-02-17T13:26:18.886997+0000","last_clean":"2024-02-17T13:26:18.886997+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T13:26:18.886997+0000","last_undegraded":"2024-02-17T13:26:18.886997+0000","last_fullsized":"2024-02-17T13:26:18.886997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:18.886905+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:18.886905+0000","last_clean_scrub_stamp":"2024-02-17T13:26:18.886905+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:34:57.108979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.715543+0000","last_change":"2024-02-17T13:26:07.715568+0000","last_active":"2024-02-17T13:26:07.715543+0000","last_peered":"2024-02-17T13:26:07.715543+0000","last_clean":"2024-02-17T13:26:07.715543+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T13:26:07.715543+0000","last_undegraded":"2024-02-17T13:26:07.715543+0000","last_fullsized":"2024-02-17T13:26:07.715543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:07.715472+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:07.715472+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.715472+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:21.174029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"26'35","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.764958+0000","last_change":"2024-02-17T13:26:03.764980+0000","last_active":"2024-02-17T13:26:03.764958+0000","last_peered":"2024-02-17T13:26:03.764958+0000","last_clean":"2024-02-17T13:26:03.764958+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T13:26:03.764958+0000","last_undegraded":"2024-02-17T13:26:03.764958+0000","last_fullsized":"2024-02-17T13:26:03.764958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:03.764892+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:03.764892+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.764892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:37.384799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.734254+0000","last_change":"2024-02-17T13:26:15.734279+0000","last_active":"2024-02-17T13:26:15.734254+0000","last_peered":"2024-02-17T13:26:15.734254+0000","last_clean":"2024-02-17T13:26:15.734254+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T13:26:15.734254+0000","last_undegraded":"2024-02-17T13:26:15.734254+0000","last_fullsized":"2024-02-17T13:26:15.734254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:15.734182+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:15.734182+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.734182+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:38:07.360174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'26","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.772827+0000","last_change":"2024-02-17T13:26:02.772857+0000","last_active":"2024-02-17T13:26:02.772827+0000","last_peered":"2024-02-17T13:26:02.772827+0000","last_clean":"2024-02-17T13:26:02.772827+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T13:26:02.772827+0000","last_undegraded":"2024-02-17T13:26:02.772827+0000","last_fullsized":"2024-02-17T13:26:02.772827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'26","last_scrub_stamp":"2024-02-17T13:26:02.772764+0000","last_deep_scrub":"26'26","last_deep_scrub_stamp":"2024-02-17T13:26:02.772764+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.772764+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:21:11.905962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'41","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.833282+0000","last_change":"2024-02-17T13:26:05.833304+0000","last_active":"2024-02-17T13:26:05.833282+0000","last_peered":"2024-02-17T13:26:05.833282+0000","last_clean":"2024-02-17T13:26:05.833282+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T13:26:05.833282+0000","last_undegraded":"2024-02-17T13:26:05.833282+0000","last_fullsized":"2024-02-17T13:26:05.833282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'41","last_scrub_stamp":"2024-02-17T13:26:05.833216+0000","last_deep_scrub":"26'41","last_deep_scrub_stamp":"2024-02-17T13:26:05.833216+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.833216+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:50.302782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"26'36","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.799165+0000","last_change":"2024-02-17T13:26:03.799191+0000","last_active":"2024-02-17T13:26:03.799165+0000","last_peered":"2024-02-17T13:26:03.799165+0000","last_clean":"2024-02-17T13:26:03.799165+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T13:26:03.799165+0000","last_undegraded":"2024-02-17T13:26:03.799165+0000","last_fullsized":"2024-02-17T13:26:03.799165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-02-17T13:26:03.799091+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-02-17T13:26:03.799091+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.799091+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:43.620054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"26'26","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.776978+0000","last_change":"2024-02-17T13:26:13.777017+0000","last_active":"2024-02-17T13:26:13.776978+0000","last_peered":"2024-02-17T13:26:13.776978+0000","last_clean":"2024-02-17T13:26:13.776978+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T13:26:13.776978+0000","last_undegraded":"2024-02-17T13:26:13.776978+0000","last_fullsized":"2024-02-17T13:26:13.776978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'26","last_scrub_stamp":"2024-02-17T13:26:13.776875+0000","last_deep_scrub":"26'26","last_deep_scrub_stamp":"2024-02-17T13:26:13.776875+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.776875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:16.604144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3911,"num_write_kb":306687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4416,"ondisk_log_size":4416,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39077972,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":11090,"num_write_kb":44057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78405632,"data_stored":78155944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9235,"ondisk_log_size":9235,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575197,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63244,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308596,"statfs":{"total":96636764160,"available":96572002304,"internally_reserved":0,"allocated":5836800,"data_stored":5629759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":0.55900000000000005,"5min":0.65000000000000002,"15min":0.71199999999999997},"last":0.441},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.64400000000000002,"15min":0.749},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.72999999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.623,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.52800000000000002,"5min":0.69599999999999995,"15min":0.73599999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52400000000000002}]},{"osd":4,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":0.63600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.372},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.79400000000000004},"last":0.31}]},{"osd":5,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76300000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.27000000000000002},"max":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41699999999999998}]},{"osd":6,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81599999999999995,"5min":0.90200000000000002,"15min":0.92800000000000005},"last":0.35599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575197,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":4388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":4493312,"data_stored":4311853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28799999999999998,"15min":0.217},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.68300000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65500000000000003,"5min":0.67800000000000005,"15min":0.75700000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.70899999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.80000000000000004},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.63200000000000001,"5min":0.71899999999999997,"15min":0.72099999999999997},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.49299999999999999,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.27400000000000002},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.81299999999999994},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.77300000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.86199999999999999,"15min":0.93400000000000005},"last":0.441},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.23599999999999999},"max":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.84199999999999997},"last":0.39800000000000002}]},{"osd":7,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.878},"last":0.501},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.80800000000000005,"15min":0.94899999999999995},"last":0.51400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575196,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70916,"kb_used_data":13372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300924,"statfs":{"total":96636764160,"available":96564146176,"internally_reserved":0,"allocated":13692928,"data_stored":13498704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57199999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.308},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.19400000000000001}]},{"osd":1,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.78100000000000003},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.751},"last":0.25}]},{"osd":2,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.28799999999999998},"max":{"1min":0.61799999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.40899999999999997,"5min":0.28999999999999998,"15min":0.28199999999999997},"max":{"1min":0.67200000000000004,"5min":0.73299999999999998,"15min":0.75600000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.81499999999999995},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27300000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.79700000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.872},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.39000000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.378}]}]},{"osd":4,"up_from":13,"seq":55834575196,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53580,"kb_used_data":8516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318260,"statfs":{"total":96636764160,"available":96581898240,"internally_reserved":0,"allocated":8720384,"data_stored":8505123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.433,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.59099999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.69199999999999995},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.27800000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57799999999999996,"5min":0.621,"15min":0.745},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.71899999999999997},"last":0.498}]},{"osd":2,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58899999999999997,"5min":0.625,"15min":0.77900000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29699999999999999},"max":{"1min":0.63700000000000001,"5min":0.68400000000000005,"15min":0.68500000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.82199999999999995},"last":0.625}]},{"osd":5,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44600000000000001,"15min":0.46999999999999997},"min":{"1min":0.23899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.47899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64200000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64100000000000001}]},{"osd":6,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46800000000000003,"15min":0.48799999999999999},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66300000000000003,"5min":0.76800000000000002,"15min":0.872},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Feb 17 13:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575197,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61764,"kb_used_data":16700,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310076,"statfs":{"total":96636764160,"available":96573517824,"internally_reserved":0,"allocated":17100800,"data_stored":16894525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.29799999999999999,"15min":0.30199999999999999},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.47499999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.309,"15min":0.311},"min":{"1min":0.223,"5min":0.223,"15min":0.21099999999999999},"max":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.48799999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.19400000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.57499999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.28699999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.626,"5min":0.626,"15min":0.64600000000000002},"last":0.439}]},{"osd":4,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36299999999999999,"5min":0.34100000000000003,"15min":0.32100000000000001},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.79100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.77000000000000002,"15min":0.77300000000000002},"last":0.50800000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.75900000000000001,"15min":0.81899999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.85599999999999998},"last":0.48799999999999999}]},{"osd":6,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.754,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.499}]},{"osd":7,"last update":"Sat Feb 17 13:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.79300000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.375},"max":{"1min":0.624,"5min":0.88,"15min":0.88},"last":0.47299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575197,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8503353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30499999999999999},"min":{"1min":0.20200000000000001,"5min":0.187,"15min":0.186},"max":{"1min":0.44700000000000001,"5min":0.59599999999999997,"15min":0.82899999999999996},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.19800000000000001},"max":{"1min":0.371,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.372}]},{"osd":1,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.94299999999999995},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.33500000000000002,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.377,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.308}]},{"osd":3,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.54100000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.38300000000000001,"15min":0.377},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":1.02},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.29199999999999998},"max":{"1min":0.63900000000000001,"5min":0.74199999999999999,"15min":1.577},"last":0.624},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.78600000000000003,"15min":0.86399999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.62,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63400000000000001,"5min":0.77000000000000002,"15min":0.80700000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.76900000000000002,"15min":1.177},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Feb 17 13:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36699999999999999},"max":{"1min":0.64300000000000002,"5min":0.80200000000000005,"15min":0.82399999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575196,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48560,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323280,"statfs":{"total":96636764160,"available":96587038720,"internally_reserved":0,"allocated":9281536,"data_stored":9094395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.69299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.40699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32100000000000001,"15min":0.311},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.504,"5min":0.622,"15min":0.622},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.56599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.378,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.60799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.50900000000000001,"15min":0.81699999999999995},"last":0.29599999999999999}]},{"osd":4,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.87,"15min":0.87},"last":0.62}]},{"osd":5,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.90700000000000003},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35699999999999998},"max":{"1min":0.63600000000000001,"5min":0.80800000000000005,"15min":0.81399999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66400000000000003,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575196,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71228,"kb_used_data":13684,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300612,"statfs":{"total":96636764160,"available":96563826688,"internally_reserved":0,"allocated":14012416,"data_stored":13811008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29299999999999998},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.52900000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.38900000000000001,"5min":0.55000000000000004,"15min":0.58399999999999996},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"min":{"1min":0.246,"5min":0.219,"15min":0.219},"max":{"1min":0.45100000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.497,"5min":0.54600000000000004,"15min":0.624},"last":0.24099999999999999}]},{"osd":3,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.24099999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.42999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.252},"max":{"1min":0.53300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.32700000000000001}]},{"osd":4,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.73699999999999999,"15min":0.77100000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.78400000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.84699999999999998},"last":0.49399999999999999}]},{"osd":6,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":0.71399999999999997,"15min":0.77200000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57799999999999996}]},{"osd":7,"last update":"Sat Feb 17 13:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.82099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.496,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.61699999999999999,"5min":0.72499999999999998,"15min":0.78400000000000003},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":13697003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12820480,"data_stored":12794331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5515754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T13:26:26.490 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.491 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.491 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.491 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.491 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.492 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-17T12:58:01.234263+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=58, tm_sec=1, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.492 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-17T12:57:56.433669+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=13, tm_min=25, tm_sec=58, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T13:26:26.492 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-17T13:26:37.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:26:37.533 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:26:46.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T13:26:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.603+0000 7fcbb2b4b640 1 Processor -- start 2024-02-17T13:26:46.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.603+0000 7fcbb2b4b640 1 -- start start 2024-02-17T13:26:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.604+0000 7fcbb2b4b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcbac0c2640 0x7fcbac0668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.604+0000 7fcbb2b4b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcbac0c6cf0 0x7fcbac0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.604+0000 7fcbb2b4b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0c6580 con 0x7fcbac0c2a20 2024-02-17T13:26:46.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.604+0000 7fcbb2b4b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0c2e00 con 0x7fcbac0c6cf0 2024-02-17T13:26:46.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.604+0000 7fcbb2b4b640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0c6860 con 0x7fcbac0c2640 2024-02-17T13:26:46.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.612+0000 7fcbb10e8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcbac0c6cf0 0x7fcbac0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:46.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.613+0000 7fcbabfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fcbac0c2a20 0x7fcbac06bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33784/0 (socket says 172.21.15.136:33784) 2024-02-17T13:26:46.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.613+0000 7fcbabfff640 1 -- 172.21.15.136:0/2104596973 learned_addr learned my addr 172.21.15.136:0/2104596973 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:46.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.615+0000 7fcbb08e7640 1 --2- 172.21.15.136:0/2104596973 >> v2:172.21.15.160:3300/0 conn(0x7fcbac0c2640 0x7fcbac0668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:46.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.616+0000 7fcbb10e8640 1 -- 172.21.15.136:0/2104596973 >> v2:172.21.15.160:3300/0 conn(0x7fcbac0c2640 msgr2=0x7fcbac0668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:46.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.616+0000 7fcbb10e8640 1 --2- 172.21.15.136:0/2104596973 >> v2:172.21.15.160:3300/0 conn(0x7fcbac0c2640 0x7fcbac0668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:46.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.616+0000 7fcbb10e8640 1 -- 172.21.15.136:0/2104596973 >> v1:172.21.15.136:6789/0 conn(0x7fcbac0c2a20 legacy=0x7fcbac06bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:46.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.616+0000 7fcbb10e8640 1 -- 172.21.15.136:0/2104596973 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0c76c0 con 0x7fcbac0c6cf0 2024-02-17T13:26:46.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.620+0000 7fcbb10e8640 1 --2- 172.21.15.136:0/2104596973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac0c7180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcbac070ea0 tx=0x7fcba402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd2820e4b6a695b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:46.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.627+0000 7fcbab7fe640 1 -- 172.21.15.136:0/2104596973 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba402cc80 con 0x7fcbac0c6cf0 2024-02-17T13:26:46.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.627+0000 7fcbab7fe640 1 -- 172.21.15.136:0/2104596973 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba402cde0 con 0x7fcbac0c6cf0 2024-02-17T13:26:46.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.627+0000 7fcbab7fe640 1 -- 172.21.15.136:0/2104596973 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4034660 con 0x7fcbac0c6cf0 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/2104596973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c6cf0 msgr2=0x7fcbac0c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/2104596973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac0c7180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcbac070ea0 tx=0x7fcba402bed0 comp rx=0 tx=0).stop 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/2104596973 shutdown_connections 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/2104596973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac0c7180 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/2104596973 >> v2:172.21.15.160:3300/0 conn(0x7fcbac0c2640 0x7fcbac0668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/2104596973 >> 172.21.15.136:0/2104596973 conn(0x7fcbac0c8680 msgr2=0x7fcbac0c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/2104596973 shutdown_connections 2024-02-17T13:26:46.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.628+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/2104596973 wait complete. 2024-02-17T13:26:46.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.629+0000 7fcbb2b4b640 1 Processor -- start 2024-02-17T13:26:46.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.629+0000 7fcbb2b4b640 1 -- start start 2024-02-17T13:26:46.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb2b4b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 0x7fcbac14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:46.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb2b4b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbac0c2a20 0x7fcbac0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:46.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb2b4b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:46.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb2b4b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1590d0 con 0x7fcbac0c2640 2024-02-17T13:26:46.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb2b4b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac154ae0 con 0x7fcbac0c6cf0 2024-02-17T13:26:46.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb2b4b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac158b50 con 0x7fcbac0c2a20 2024-02-17T13:26:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.630+0000 7fcbb08e7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 0x7fcbac14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.631+0000 7fcbb10e8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.631+0000 7fcbabfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbac0c2a20 0x7fcbac0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.631+0000 7fcbb08e7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 0x7fcbac14c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48376/0 (socket says 172.21.15.136:48376) 2024-02-17T13:26:46.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.631+0000 7fcbb08e7640 1 -- 172.21.15.136:0/683551402 learned_addr learned my addr 172.21.15.136:0/683551402 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:46.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.634+0000 7fcbb08e7640 1 -- 172.21.15.136:0/683551402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbac0c2a20 msgr2=0x7fcbac0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:46.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.634+0000 7fcbb08e7640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbac0c2a20 0x7fcbac0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:46.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.634+0000 7fcbb08e7640 1 -- 172.21.15.136:0/683551402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbac0c6cf0 msgr2=0x7fcbac14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:46.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.634+0000 7fcbb08e7640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:46.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.634+0000 7fcbb08e7640 1 -- 172.21.15.136:0/683551402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009a70 con 0x7fcbac0c2640 2024-02-17T13:26:46.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.636+0000 7fcbb08e7640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 0x7fcbac14c270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c820 tx=0x7fcba000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:46.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.640+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0004020 con 0x7fcbac0c2640 2024-02-17T13:26:46.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.640+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0004180 con 0x7fcbac0c2640 2024-02-17T13:26:46.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.640+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0007830 con 0x7fcbac0c2640 2024-02-17T13:26:46.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.640+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac1573c0 con 0x7fcbac0c2640 2024-02-17T13:26:46.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.640+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac158df0 con 0x7fcbac0c2640 2024-02-17T13:26:46.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.641+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac04efc0 con 0x7fcbac0c2640 2024-02-17T13:26:46.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.659+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcba0007990 con 0x7fcbac0c2640 2024-02-17T13:26:46.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.659+0000 7fcba97fa640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb9006b890 0x7fcb9006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:46.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.660+0000 7fcbabfff640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb9006b890 0x7fcb9006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:46.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.660+0000 7fcbabfff640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb9006b890 0x7fcb9006dd50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbac1581f0 tx=0x7fcb98007e80 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:46.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.663+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fcba0058aa0 con 0x7fcbac0c2640 2024-02-17T13:26:46.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:46.900+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcba0054d40 con 0x7fcbac0c2640 2024-02-17T13:26:47.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.070+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 --> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbac15a280 con 0x7fcb9006b890 2024-02-17T13:26:47.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.079+0000 7fcba97fa640 1 -- 172.21.15.136:0/683551402 <== mgr.4117 v2:172.21.15.136:6832/451441740 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371719 (secure 0 0 0) 0x7fcb98001460 con 0x7fcb9006b890 2024-02-17T13:26:47.083 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:26:47.085 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb9006b890 msgr2=0x7fcb9006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb9006b890 0x7fcb9006dd50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbac1581f0 tx=0x7fcb98007e80 comp rx=0 tx=0).stop 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 msgr2=0x7fcbac14c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 0x7fcbac14c270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c820 tx=0x7fcba000cce0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 shutdown_connections 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fcb9006b890 0x7fcb9006dd50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbac0c6cf0 0x7fcbac14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbac0c2a20 0x7fcbac0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 --2- 172.21.15.136:0/683551402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbac0c2640 0x7fcbac14c270 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 >> 172.21.15.136:0/683551402 conn(0x7fcbac0c8680 msgr2=0x7fcbac06b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 shutdown_connections 2024-02-17T13:26:47.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.082+0000 7fcbb2b4b640 1 -- 172.21.15.136:0/683551402 wait complete. 2024-02-17T13:26:47.093 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":891,"stamp":"2024-02-17T13:26:46.365191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39668340,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":1020,"num_read_kb":1067,"num_write":15160,"num_write_kb":353160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16092,"ondisk_log_size":16092,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":448672,"kb_used_data":79904,"kb_used_omap":12,"kb_used_meta":368691,"kb_avail":754526048,"statfs":{"total":773094113280,"available":772634673152,"internally_reserved":0,"allocated":81821696,"data_stored":80248720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":377540144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003371"},"pg_stats":[{"pgid":"2.1f","version":"26'636","reported_seq":684,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.145461+0000","last_change":"2024-02-17T13:26:06.145492+0000","last_active":"2024-02-17T13:26:06.145461+0000","last_peered":"2024-02-17T13:26:06.145461+0000","last_clean":"2024-02-17T13:26:06.145461+0000","last_became_active":"2024-02-17T12:57:56.647767+0000","last_became_peered":"2024-02-17T12:57:56.647767+0000","last_unstale":"2024-02-17T13:26:06.145461+0000","last_undegraded":"2024-02-17T13:26:06.145461+0000","last_fullsized":"2024-02-17T13:26:06.145461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'636","last_scrub_stamp":"2024-02-17T13:26:06.145396+0000","last_deep_scrub":"26'636","last_deep_scrub_stamp":"2024-02-17T13:26:06.145396+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.145396+0000","objects_scrubbed":7,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:45.966359+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"26'28","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.765483+0000","last_change":"2024-02-17T13:26:13.765505+0000","last_active":"2024-02-17T13:26:13.765483+0000","last_peered":"2024-02-17T13:26:13.765483+0000","last_clean":"2024-02-17T13:26:13.765483+0000","last_became_active":"2024-02-17T12:57:57.801742+0000","last_became_peered":"2024-02-17T12:57:57.801742+0000","last_unstale":"2024-02-17T13:26:13.765483+0000","last_undegraded":"2024-02-17T13:26:13.765483+0000","last_fullsized":"2024-02-17T13:26:13.765483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:13.765418+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:13.765418+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.765418+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:42.894992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"26'137","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.314572+0000","last_change":"2024-02-17T13:26:11.314596+0000","last_active":"2024-02-17T13:26:11.314572+0000","last_peered":"2024-02-17T13:26:11.314572+0000","last_clean":"2024-02-17T13:26:11.314572+0000","last_became_active":"2024-02-17T12:58:02.535769+0000","last_became_peered":"2024-02-17T12:58:02.535769+0000","last_unstale":"2024-02-17T13:26:11.314572+0000","last_undegraded":"2024-02-17T13:26:11.314572+0000","last_fullsized":"2024-02-17T13:26:11.314572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'137","last_scrub_stamp":"2024-02-17T13:26:11.314493+0000","last_deep_scrub":"26'137","last_deep_scrub_stamp":"2024-02-17T13:26:11.314493+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.314493+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:44.934400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'681","reported_seq":730,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.837755+0000","last_change":"2024-02-17T13:26:10.837796+0000","last_active":"2024-02-17T13:26:10.837755+0000","last_peered":"2024-02-17T13:26:10.837755+0000","last_clean":"2024-02-17T13:26:10.837755+0000","last_became_active":"2024-02-17T12:57:56.658338+0000","last_became_peered":"2024-02-17T12:57:56.658338+0000","last_unstale":"2024-02-17T13:26:10.837755+0000","last_undegraded":"2024-02-17T13:26:10.837755+0000","last_fullsized":"2024-02-17T13:26:10.837755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'681","last_scrub_stamp":"2024-02-17T13:26:10.837659+0000","last_deep_scrub":"26'681","last_deep_scrub_stamp":"2024-02-17T13:26:10.837659+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.837659+0000","objects_scrubbed":1,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:45:25.408526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":4495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"26'36","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.792745+0000","last_change":"2024-02-17T13:26:15.792786+0000","last_active":"2024-02-17T13:26:15.792745+0000","last_peered":"2024-02-17T13:26:15.792745+0000","last_clean":"2024-02-17T13:26:15.792745+0000","last_became_active":"2024-02-17T12:57:57.803964+0000","last_became_peered":"2024-02-17T12:57:57.803964+0000","last_unstale":"2024-02-17T13:26:15.792745+0000","last_undegraded":"2024-02-17T13:26:15.792745+0000","last_fullsized":"2024-02-17T13:26:15.792745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-02-17T13:26:15.792641+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-02-17T13:26:15.792641+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.792641+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:01.920060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"26'131","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.682668+0000","last_change":"2024-02-17T13:26:10.682692+0000","last_active":"2024-02-17T13:26:10.682668+0000","last_peered":"2024-02-17T13:26:10.682668+0000","last_clean":"2024-02-17T13:26:10.682668+0000","last_became_active":"2024-02-17T12:58:02.532041+0000","last_became_peered":"2024-02-17T12:58:02.532041+0000","last_unstale":"2024-02-17T13:26:10.682668+0000","last_undegraded":"2024-02-17T13:26:10.682668+0000","last_fullsized":"2024-02-17T13:26:10.682668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'131","last_scrub_stamp":"2024-02-17T13:26:10.682598+0000","last_deep_scrub":"26'131","last_deep_scrub_stamp":"2024-02-17T13:26:10.682598+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.682598+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:24.141155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'1340","reported_seq":1386,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.799023+0000","last_change":"2024-02-17T13:26:03.799062+0000","last_active":"2024-02-17T13:26:03.799023+0000","last_peered":"2024-02-17T13:26:03.799023+0000","last_clean":"2024-02-17T13:26:03.799023+0000","last_became_active":"2024-02-17T12:57:56.649388+0000","last_became_peered":"2024-02-17T12:57:56.649388+0000","last_unstale":"2024-02-17T13:26:03.799023+0000","last_undegraded":"2024-02-17T13:26:03.799023+0000","last_fullsized":"2024-02-17T13:26:03.799023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1340","last_scrub_stamp":"2024-02-17T13:26:03.798961+0000","last_deep_scrub":"26'1340","last_deep_scrub_stamp":"2024-02-17T13:26:03.798961+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.798961+0000","objects_scrubbed":9,"log_size":1340,"log_dups_size":0,"ondisk_log_size":1340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:09.514378+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"26'31","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.246195+0000","last_change":"2024-02-17T13:26:04.246216+0000","last_active":"2024-02-17T13:26:04.246195+0000","last_peered":"2024-02-17T13:26:04.246195+0000","last_clean":"2024-02-17T13:26:04.246195+0000","last_became_active":"2024-02-17T12:57:57.773855+0000","last_became_peered":"2024-02-17T12:57:57.773855+0000","last_unstale":"2024-02-17T13:26:04.246195+0000","last_undegraded":"2024-02-17T13:26:04.246195+0000","last_fullsized":"2024-02-17T13:26:04.246195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-02-17T13:26:04.246120+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-02-17T13:26:04.246120+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.246120+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:33:44.442052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'136","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.645680+0000","last_change":"2024-02-17T13:26:15.645702+0000","last_active":"2024-02-17T13:26:15.645680+0000","last_peered":"2024-02-17T13:26:15.645680+0000","last_clean":"2024-02-17T13:26:15.645680+0000","last_became_active":"2024-02-17T12:58:37.886957+0000","last_became_peered":"2024-02-17T12:58:37.886957+0000","last_unstale":"2024-02-17T13:26:15.645680+0000","last_undegraded":"2024-02-17T13:26:15.645680+0000","last_fullsized":"2024-02-17T13:26:15.645680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'136","last_scrub_stamp":"2024-02-17T13:26:15.645605+0000","last_deep_scrub":"26'136","last_deep_scrub_stamp":"2024-02-17T13:26:15.645605+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.645605+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:44.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":9317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'10","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.752863+0000","last_change":"2024-02-17T13:26:04.752891+0000","last_active":"2024-02-17T13:26:04.752863+0000","last_peered":"2024-02-17T13:26:04.752863+0000","last_clean":"2024-02-17T13:26:04.752863+0000","last_became_active":"2024-02-17T12:57:56.651314+0000","last_became_peered":"2024-02-17T12:57:56.651314+0000","last_unstale":"2024-02-17T13:26:04.752863+0000","last_undegraded":"2024-02-17T13:26:04.752863+0000","last_fullsized":"2024-02-17T13:26:04.752863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-02-17T13:26:04.752783+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-02-17T13:26:04.752783+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.752783+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:49.222350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"26'47","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.835233+0000","last_change":"2024-02-17T13:26:04.835255+0000","last_active":"2024-02-17T13:26:04.835233+0000","last_peered":"2024-02-17T13:26:04.835233+0000","last_clean":"2024-02-17T13:26:04.835233+0000","last_became_active":"2024-02-17T12:57:57.798901+0000","last_became_peered":"2024-02-17T12:57:57.798901+0000","last_unstale":"2024-02-17T13:26:04.835233+0000","last_undegraded":"2024-02-17T13:26:04.835233+0000","last_fullsized":"2024-02-17T13:26:04.835233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'47","last_scrub_stamp":"2024-02-17T13:26:04.835163+0000","last_deep_scrub":"26'47","last_deep_scrub_stamp":"2024-02-17T13:26:04.835163+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.835163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:42.915209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"26'132","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.667279+0000","last_change":"2024-02-17T13:26:11.667324+0000","last_active":"2024-02-17T13:26:11.667279+0000","last_peered":"2024-02-17T13:26:11.667279+0000","last_clean":"2024-02-17T13:26:11.667279+0000","last_became_active":"2024-02-17T12:58:02.533175+0000","last_became_peered":"2024-02-17T12:58:02.533175+0000","last_unstale":"2024-02-17T13:26:11.667279+0000","last_undegraded":"2024-02-17T13:26:11.667279+0000","last_fullsized":"2024-02-17T13:26:11.667279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'132","last_scrub_stamp":"2024-02-17T13:26:11.667198+0000","last_deep_scrub":"26'132","last_deep_scrub_stamp":"2024-02-17T13:26:11.667198+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.667198+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:15.793632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":5852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"26'36","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.922231+0000","last_change":"2024-02-17T13:26:07.922231+0000","last_active":"2024-02-17T13:26:07.922231+0000","last_peered":"2024-02-17T13:26:07.922231+0000","last_clean":"2024-02-17T13:26:07.922231+0000","last_became_active":"2024-02-17T12:57:57.798579+0000","last_became_peered":"2024-02-17T12:57:57.798579+0000","last_unstale":"2024-02-17T13:26:07.922231+0000","last_undegraded":"2024-02-17T13:26:07.922231+0000","last_fullsized":"2024-02-17T13:26:07.922231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-02-17T13:26:07.922096+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-02-17T13:26:07.922096+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.922096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:37.051670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'624","reported_seq":671,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.987535+0000","last_change":"2024-02-17T13:26:17.987566+0000","last_active":"2024-02-17T13:26:17.987535+0000","last_peered":"2024-02-17T13:26:17.987535+0000","last_clean":"2024-02-17T13:26:17.987535+0000","last_became_active":"2024-02-17T12:57:56.650658+0000","last_became_peered":"2024-02-17T12:57:56.650658+0000","last_unstale":"2024-02-17T13:26:17.987535+0000","last_undegraded":"2024-02-17T13:26:17.987535+0000","last_fullsized":"2024-02-17T13:26:17.987535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'624","last_scrub_stamp":"2024-02-17T13:26:17.987471+0000","last_deep_scrub":"26'624","last_deep_scrub_stamp":"2024-02-17T13:26:17.987471+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.987471+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:21.439932+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"26'112","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:27.982671+0000","last_change":"2024-02-17T13:26:27.982698+0000","last_active":"2024-02-17T13:26:27.982671+0000","last_peered":"2024-02-17T13:26:27.982671+0000","last_clean":"2024-02-17T13:26:27.982671+0000","last_became_active":"2024-02-17T12:58:02.534591+0000","last_became_peered":"2024-02-17T12:58:02.534591+0000","last_unstale":"2024-02-17T13:26:27.982671+0000","last_undegraded":"2024-02-17T13:26:27.982671+0000","last_fullsized":"2024-02-17T13:26:27.982671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-02-17T13:26:27.982587+0000","last_deep_scrub":"26'112","last_deep_scrub_stamp":"2024-02-17T13:26:27.982587+0000","last_clean_scrub_stamp":"2024-02-17T13:26:27.982587+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:08.809684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'34","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.351898+0000","last_change":"2024-02-17T13:26:10.351924+0000","last_active":"2024-02-17T13:26:10.351898+0000","last_peered":"2024-02-17T13:26:10.351898+0000","last_clean":"2024-02-17T13:26:10.351898+0000","last_became_active":"2024-02-17T12:57:57.798346+0000","last_became_peered":"2024-02-17T12:57:57.798346+0000","last_unstale":"2024-02-17T13:26:10.351898+0000","last_undegraded":"2024-02-17T13:26:10.351898+0000","last_fullsized":"2024-02-17T13:26:10.351898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:10.351806+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:10.351806+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.351806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:21:19.485003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'8","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.973333+0000","last_change":"2024-02-17T13:26:06.973333+0000","last_active":"2024-02-17T13:26:06.973333+0000","last_peered":"2024-02-17T13:26:06.973333+0000","last_clean":"2024-02-17T13:26:06.973333+0000","last_became_active":"2024-02-17T12:57:56.653153+0000","last_became_peered":"2024-02-17T12:57:56.653153+0000","last_unstale":"2024-02-17T13:26:06.973333+0000","last_undegraded":"2024-02-17T13:26:06.973333+0000","last_fullsized":"2024-02-17T13:26:06.973333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:06.973236+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:06.973236+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.973236+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:26:51.908733+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"26'166","reported_seq":205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.700596+0000","last_change":"2024-02-17T13:26:16.700622+0000","last_active":"2024-02-17T13:26:16.700596+0000","last_peered":"2024-02-17T13:26:16.700596+0000","last_clean":"2024-02-17T13:26:16.700596+0000","last_became_active":"2024-02-17T12:58:02.482627+0000","last_became_peered":"2024-02-17T12:58:02.482627+0000","last_unstale":"2024-02-17T13:26:16.700596+0000","last_undegraded":"2024-02-17T13:26:16.700596+0000","last_fullsized":"2024-02-17T13:26:16.700596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'166","last_scrub_stamp":"2024-02-17T13:26:16.700521+0000","last_deep_scrub":"26'166","last_deep_scrub_stamp":"2024-02-17T13:26:16.700521+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.700521+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:49:55.524622+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":14575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.207825+0000","last_change":"2024-02-17T13:26:13.207848+0000","last_active":"2024-02-17T13:26:13.207825+0000","last_peered":"2024-02-17T13:26:13.207825+0000","last_clean":"2024-02-17T13:26:13.207825+0000","last_became_active":"2024-02-17T12:57:57.795310+0000","last_became_peered":"2024-02-17T12:57:57.795310+0000","last_unstale":"2024-02-17T13:26:13.207825+0000","last_undegraded":"2024-02-17T13:26:13.207825+0000","last_fullsized":"2024-02-17T13:26:13.207825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:13.207754+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:13.207754+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.207754+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:17.334189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'13","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.117831+0000","last_change":"2024-02-17T13:26:04.117831+0000","last_active":"2024-02-17T13:26:04.117831+0000","last_peered":"2024-02-17T13:26:04.117831+0000","last_clean":"2024-02-17T13:26:04.117831+0000","last_became_active":"2024-02-17T12:57:56.644144+0000","last_became_peered":"2024-02-17T12:57:56.644144+0000","last_unstale":"2024-02-17T13:26:04.117831+0000","last_undegraded":"2024-02-17T13:26:04.117831+0000","last_fullsized":"2024-02-17T13:26:04.117831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-02-17T13:26:04.117751+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-02-17T13:26:04.117751+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.117751+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:26:49.053248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"26'115","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.238171+0000","last_change":"2024-02-17T13:26:13.238212+0000","last_active":"2024-02-17T13:26:13.238171+0000","last_peered":"2024-02-17T13:26:13.238171+0000","last_clean":"2024-02-17T13:26:13.238171+0000","last_became_active":"2024-02-17T12:58:02.540267+0000","last_became_peered":"2024-02-17T12:58:02.540267+0000","last_unstale":"2024-02-17T13:26:13.238171+0000","last_undegraded":"2024-02-17T13:26:13.238171+0000","last_fullsized":"2024-02-17T13:26:13.238171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2024-02-17T13:26:13.238067+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2024-02-17T13:26:13.238067+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.238067+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:53.059030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"26'33","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.959297+0000","last_change":"2024-02-17T13:26:10.959332+0000","last_active":"2024-02-17T13:26:10.959297+0000","last_peered":"2024-02-17T13:26:10.959297+0000","last_clean":"2024-02-17T13:26:10.959297+0000","last_became_active":"2024-02-17T12:57:57.803421+0000","last_became_peered":"2024-02-17T12:57:57.803421+0000","last_unstale":"2024-02-17T13:26:10.959297+0000","last_undegraded":"2024-02-17T13:26:10.959297+0000","last_fullsized":"2024-02-17T13:26:10.959297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:10.959202+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:10.959202+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.959202+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:38:02.585194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"26'8","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.754893+0000","last_change":"2024-02-17T13:26:02.754893+0000","last_active":"2024-02-17T13:26:02.754893+0000","last_peered":"2024-02-17T13:26:02.754893+0000","last_clean":"2024-02-17T13:26:02.754893+0000","last_became_active":"2024-02-17T12:57:56.648908+0000","last_became_peered":"2024-02-17T12:57:56.648908+0000","last_unstale":"2024-02-17T13:26:02.754893+0000","last_undegraded":"2024-02-17T13:26:02.754893+0000","last_fullsized":"2024-02-17T13:26:02.754893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:02.754749+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:02.754749+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.754749+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:16:48.541087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"26'126","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.697604+0000","last_change":"2024-02-17T13:26:13.697628+0000","last_active":"2024-02-17T13:26:13.697604+0000","last_peered":"2024-02-17T13:26:13.697604+0000","last_clean":"2024-02-17T13:26:13.697604+0000","last_became_active":"2024-02-17T12:58:02.533519+0000","last_became_peered":"2024-02-17T12:58:02.533519+0000","last_unstale":"2024-02-17T13:26:13.697604+0000","last_undegraded":"2024-02-17T13:26:13.697604+0000","last_fullsized":"2024-02-17T13:26:13.697604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2024-02-17T13:26:13.697528+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2024-02-17T13:26:13.697528+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.697528+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:22:41.754869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'40","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.212070+0000","last_change":"2024-02-17T13:26:14.212090+0000","last_active":"2024-02-17T13:26:14.212070+0000","last_peered":"2024-02-17T13:26:14.212070+0000","last_clean":"2024-02-17T13:26:14.212070+0000","last_became_active":"2024-02-17T12:57:57.795933+0000","last_became_peered":"2024-02-17T12:57:57.795933+0000","last_unstale":"2024-02-17T13:26:14.212070+0000","last_undegraded":"2024-02-17T13:26:14.212070+0000","last_fullsized":"2024-02-17T13:26:14.212070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-02-17T13:26:14.212004+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-02-17T13:26:14.212004+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.212004+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:45:28.782871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'20","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.026906+0000","last_change":"2024-02-17T13:26:14.026937+0000","last_active":"2024-02-17T13:26:14.026906+0000","last_peered":"2024-02-17T13:26:14.026906+0000","last_clean":"2024-02-17T13:26:14.026906+0000","last_became_active":"2024-02-17T12:57:56.647149+0000","last_became_peered":"2024-02-17T12:57:56.647149+0000","last_unstale":"2024-02-17T13:26:14.026906+0000","last_undegraded":"2024-02-17T13:26:14.026906+0000","last_fullsized":"2024-02-17T13:26:14.026906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-02-17T13:26:14.026828+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-02-17T13:26:14.026828+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.026828+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:46:45.623620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"26'146","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.708557+0000","last_change":"2024-02-17T13:26:09.708582+0000","last_active":"2024-02-17T13:26:09.708557+0000","last_peered":"2024-02-17T13:26:09.708557+0000","last_clean":"2024-02-17T13:26:09.708557+0000","last_became_active":"2024-02-17T12:58:02.530540+0000","last_became_peered":"2024-02-17T12:58:02.530540+0000","last_unstale":"2024-02-17T13:26:09.708557+0000","last_undegraded":"2024-02-17T13:26:09.708557+0000","last_fullsized":"2024-02-17T13:26:09.708557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'146","last_scrub_stamp":"2024-02-17T13:26:09.708475+0000","last_deep_scrub":"26'146","last_deep_scrub_stamp":"2024-02-17T13:26:09.708475+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.708475+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:34.451098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.127142+0000","last_change":"2024-02-17T13:26:03.127142+0000","last_active":"2024-02-17T13:26:03.127142+0000","last_peered":"2024-02-17T13:26:03.127142+0000","last_clean":"2024-02-17T13:26:03.127142+0000","last_became_active":"2024-02-17T12:57:57.760250+0000","last_became_peered":"2024-02-17T12:57:57.760250+0000","last_unstale":"2024-02-17T13:26:03.127142+0000","last_undegraded":"2024-02-17T13:26:03.127142+0000","last_fullsized":"2024-02-17T13:26:03.127142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:03.127052+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:03.127052+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.127052+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:24.657278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1342","reported_seq":1390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.141500+0000","last_change":"2024-02-17T13:26:05.141500+0000","last_active":"2024-02-17T13:26:05.141500+0000","last_peered":"2024-02-17T13:26:05.141500+0000","last_clean":"2024-02-17T13:26:05.141500+0000","last_became_active":"2024-02-17T12:57:56.645423+0000","last_became_peered":"2024-02-17T12:57:56.645423+0000","last_unstale":"2024-02-17T13:26:05.141500+0000","last_undegraded":"2024-02-17T13:26:05.141500+0000","last_fullsized":"2024-02-17T13:26:05.141500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1342","last_scrub_stamp":"2024-02-17T13:26:05.141412+0000","last_deep_scrub":"26'1342","last_deep_scrub_stamp":"2024-02-17T13:26:05.141412+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.141412+0000","objects_scrubbed":4,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:48.441561+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":1198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'135","reported_seq":176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.253962+0000","last_change":"2024-02-17T13:26:15.253985+0000","last_active":"2024-02-17T13:26:15.253962+0000","last_peered":"2024-02-17T13:26:15.253962+0000","last_clean":"2024-02-17T13:26:15.253962+0000","last_became_active":"2024-02-17T12:58:02.478148+0000","last_became_peered":"2024-02-17T12:58:02.478148+0000","last_unstale":"2024-02-17T13:26:15.253962+0000","last_undegraded":"2024-02-17T13:26:15.253962+0000","last_fullsized":"2024-02-17T13:26:15.253962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'135","last_scrub_stamp":"2024-02-17T13:26:15.253897+0000","last_deep_scrub":"26'135","last_deep_scrub_stamp":"2024-02-17T13:26:15.253897+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.253897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:38.118611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"26'35","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.011098+0000","last_change":"2024-02-17T13:26:14.011144+0000","last_active":"2024-02-17T13:26:14.011098+0000","last_peered":"2024-02-17T13:26:14.011098+0000","last_clean":"2024-02-17T13:26:14.011098+0000","last_became_active":"2024-02-17T12:57:57.804397+0000","last_became_peered":"2024-02-17T12:57:57.804397+0000","last_unstale":"2024-02-17T13:26:14.011098+0000","last_undegraded":"2024-02-17T13:26:14.011098+0000","last_fullsized":"2024-02-17T13:26:14.011098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:14.011018+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:14.011018+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.011018+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:39.973629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"26'9","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.031407+0000","last_change":"2024-02-17T13:26:15.031431+0000","last_active":"2024-02-17T13:26:15.031407+0000","last_peered":"2024-02-17T13:26:15.031407+0000","last_clean":"2024-02-17T13:26:15.031407+0000","last_became_active":"2024-02-17T12:57:56.647613+0000","last_became_peered":"2024-02-17T12:57:56.647613+0000","last_unstale":"2024-02-17T13:26:15.031407+0000","last_undegraded":"2024-02-17T13:26:15.031407+0000","last_fullsized":"2024-02-17T13:26:15.031407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-02-17T13:26:15.031336+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-02-17T13:26:15.031336+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.031336+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:37:41.017535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"26'127","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.946297+0000","last_change":"2024-02-17T13:26:15.946320+0000","last_active":"2024-02-17T13:26:15.946297+0000","last_peered":"2024-02-17T13:26:15.946297+0000","last_clean":"2024-02-17T13:26:15.946297+0000","last_became_active":"2024-02-17T12:58:02.536612+0000","last_became_peered":"2024-02-17T12:58:02.536612+0000","last_unstale":"2024-02-17T13:26:15.946297+0000","last_undegraded":"2024-02-17T13:26:15.946297+0000","last_fullsized":"2024-02-17T13:26:15.946297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'127","last_scrub_stamp":"2024-02-17T13:26:15.946229+0000","last_deep_scrub":"26'127","last_deep_scrub_stamp":"2024-02-17T13:26:15.946229+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.946229+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:18:09.600737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.806125+0000","last_change":"2024-02-17T13:26:05.806149+0000","last_active":"2024-02-17T13:26:05.806125+0000","last_peered":"2024-02-17T13:26:05.806125+0000","last_clean":"2024-02-17T13:26:05.806125+0000","last_became_active":"2024-02-17T12:57:57.760461+0000","last_became_peered":"2024-02-17T12:57:57.760461+0000","last_unstale":"2024-02-17T13:26:05.806125+0000","last_undegraded":"2024-02-17T13:26:05.806125+0000","last_fullsized":"2024-02-17T13:26:05.806125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:05.806052+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:05.806052+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.806052+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:45.627015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'3","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.793265+0000","last_change":"2024-02-17T13:26:09.793289+0000","last_active":"2024-02-17T13:26:09.793265+0000","last_peered":"2024-02-17T13:26:09.793265+0000","last_clean":"2024-02-17T13:26:09.793265+0000","last_became_active":"2024-02-17T12:57:56.651429+0000","last_became_peered":"2024-02-17T12:57:56.651429+0000","last_unstale":"2024-02-17T13:26:09.793265+0000","last_undegraded":"2024-02-17T13:26:09.793265+0000","last_fullsized":"2024-02-17T13:26:09.793265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-02-17T13:26:09.793195+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-02-17T13:26:09.793195+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.793195+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:13.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"26'191","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.928684+0000","last_change":"2024-02-17T13:26:16.928727+0000","last_active":"2024-02-17T13:26:16.928684+0000","last_peered":"2024-02-17T13:26:16.928684+0000","last_clean":"2024-02-17T13:26:16.928684+0000","last_became_active":"2024-02-17T12:58:02.536731+0000","last_became_peered":"2024-02-17T12:58:02.536731+0000","last_unstale":"2024-02-17T13:26:16.928684+0000","last_undegraded":"2024-02-17T13:26:16.928684+0000","last_fullsized":"2024-02-17T13:26:16.928684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-02-17T13:26:16.928572+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-02-17T13:26:16.928572+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.928572+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:55.008618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.796819+0000","last_change":"2024-02-17T13:26:09.796844+0000","last_active":"2024-02-17T13:26:09.796819+0000","last_peered":"2024-02-17T13:26:09.796819+0000","last_clean":"2024-02-17T13:26:09.796819+0000","last_became_active":"2024-02-17T12:57:57.772521+0000","last_became_peered":"2024-02-17T12:57:57.772521+0000","last_unstale":"2024-02-17T13:26:09.796819+0000","last_undegraded":"2024-02-17T13:26:09.796819+0000","last_fullsized":"2024-02-17T13:26:09.796819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:09.796741+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:09.796741+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.796741+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:47:47.876788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'13","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.983627+0000","last_change":"2024-02-17T13:26:12.983652+0000","last_active":"2024-02-17T13:26:12.983627+0000","last_peered":"2024-02-17T13:26:12.983627+0000","last_clean":"2024-02-17T13:26:12.983627+0000","last_became_active":"2024-02-17T12:57:56.646719+0000","last_became_peered":"2024-02-17T12:57:56.646719+0000","last_unstale":"2024-02-17T13:26:12.983627+0000","last_undegraded":"2024-02-17T13:26:12.983627+0000","last_fullsized":"2024-02-17T13:26:12.983627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-02-17T13:26:12.983561+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-02-17T13:26:12.983561+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.983561+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:34:51.205634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'113","reported_seq":153,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.973937+0000","last_change":"2024-02-17T13:26:17.973982+0000","last_active":"2024-02-17T13:26:17.973937+0000","last_peered":"2024-02-17T13:26:17.973937+0000","last_clean":"2024-02-17T13:26:17.973937+0000","last_became_active":"2024-02-17T12:58:02.536956+0000","last_became_peered":"2024-02-17T12:58:02.536956+0000","last_unstale":"2024-02-17T13:26:17.973937+0000","last_undegraded":"2024-02-17T13:26:17.973937+0000","last_fullsized":"2024-02-17T13:26:17.973937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'113","last_scrub_stamp":"2024-02-17T13:26:17.973808+0000","last_deep_scrub":"26'113","last_deep_scrub_stamp":"2024-02-17T13:26:17.973808+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.973808+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:40.838522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"26'31","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.734182+0000","last_change":"2024-02-17T13:26:12.734205+0000","last_active":"2024-02-17T13:26:12.734182+0000","last_peered":"2024-02-17T13:26:12.734182+0000","last_clean":"2024-02-17T13:26:12.734182+0000","last_became_active":"2024-02-17T12:57:57.801602+0000","last_became_peered":"2024-02-17T12:57:57.801602+0000","last_unstale":"2024-02-17T13:26:12.734182+0000","last_undegraded":"2024-02-17T13:26:12.734182+0000","last_fullsized":"2024-02-17T13:26:12.734182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-02-17T13:26:12.734107+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-02-17T13:26:12.734107+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.734107+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:30.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'917","reported_seq":1869,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.366369+0000","last_change":"2024-02-17T13:26:06.366395+0000","last_active":"2024-02-17T13:26:06.366369+0000","last_peered":"2024-02-17T13:26:06.366369+0000","last_clean":"2024-02-17T13:26:06.366369+0000","last_became_active":"2024-02-17T12:57:56.658557+0000","last_became_peered":"2024-02-17T12:57:56.658557+0000","last_unstale":"2024-02-17T13:26:06.366369+0000","last_undegraded":"2024-02-17T13:26:06.366369+0000","last_fullsized":"2024-02-17T13:26:06.366369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'917","last_scrub_stamp":"2024-02-17T13:26:06.366306+0000","last_deep_scrub":"26'917","last_deep_scrub_stamp":"2024-02-17T13:26:06.366306+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.366306+0000","objects_scrubbed":4,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:44.329265+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210123,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":913,"num_write_kb":973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'127","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.979792+0000","last_change":"2024-02-17T13:26:14.979816+0000","last_active":"2024-02-17T13:26:14.979792+0000","last_peered":"2024-02-17T13:26:14.979792+0000","last_clean":"2024-02-17T13:26:14.979792+0000","last_became_active":"2024-02-17T12:58:02.530791+0000","last_became_peered":"2024-02-17T12:58:02.530791+0000","last_unstale":"2024-02-17T13:26:14.979792+0000","last_undegraded":"2024-02-17T13:26:14.979792+0000","last_fullsized":"2024-02-17T13:26:14.979792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'127","last_scrub_stamp":"2024-02-17T13:26:14.979720+0000","last_deep_scrub":"26'127","last_deep_scrub_stamp":"2024-02-17T13:26:14.979720+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.979720+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:23:58.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"26'29","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.021354+0000","last_change":"2024-02-17T13:26:08.021380+0000","last_active":"2024-02-17T13:26:08.021354+0000","last_peered":"2024-02-17T13:26:08.021354+0000","last_clean":"2024-02-17T13:26:08.021354+0000","last_became_active":"2024-02-17T12:57:57.760299+0000","last_became_peered":"2024-02-17T12:57:57.760299+0000","last_unstale":"2024-02-17T13:26:08.021354+0000","last_undegraded":"2024-02-17T13:26:08.021354+0000","last_fullsized":"2024-02-17T13:26:08.021354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'29","last_scrub_stamp":"2024-02-17T13:26:08.021284+0000","last_deep_scrub":"26'29","last_deep_scrub_stamp":"2024-02-17T13:26:08.021284+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.021284+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:53.127639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'491","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:20.029515+0000","last_change":"2024-02-17T13:26:20.029546+0000","last_active":"2024-02-17T13:26:20.029515+0000","last_peered":"2024-02-17T13:26:20.029515+0000","last_clean":"2024-02-17T13:26:20.029515+0000","last_became_active":"2024-02-17T12:57:56.653234+0000","last_became_peered":"2024-02-17T12:57:56.653234+0000","last_unstale":"2024-02-17T13:26:20.029515+0000","last_undegraded":"2024-02-17T13:26:20.029515+0000","last_fullsized":"2024-02-17T13:26:20.029515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'491","last_scrub_stamp":"2024-02-17T13:26:20.029439+0000","last_deep_scrub":"26'491","last_deep_scrub_stamp":"2024-02-17T13:26:20.029439+0000","last_clean_scrub_stamp":"2024-02-17T13:26:20.029439+0000","objects_scrubbed":2,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:09.104716+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":4341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'120","reported_seq":160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:21.926237+0000","last_change":"2024-02-17T13:26:21.926261+0000","last_active":"2024-02-17T13:26:21.926237+0000","last_peered":"2024-02-17T13:26:21.926237+0000","last_clean":"2024-02-17T13:26:21.926237+0000","last_became_active":"2024-02-17T12:58:02.532188+0000","last_became_peered":"2024-02-17T12:58:02.532188+0000","last_unstale":"2024-02-17T13:26:21.926237+0000","last_undegraded":"2024-02-17T13:26:21.926237+0000","last_fullsized":"2024-02-17T13:26:21.926237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'120","last_scrub_stamp":"2024-02-17T13:26:21.926156+0000","last_deep_scrub":"26'120","last_deep_scrub_stamp":"2024-02-17T13:26:21.926156+0000","last_clean_scrub_stamp":"2024-02-17T13:26:21.926156+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:37:14.075831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"26'33","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.250475+0000","last_change":"2024-02-17T13:26:09.250502+0000","last_active":"2024-02-17T13:26:09.250475+0000","last_peered":"2024-02-17T13:26:09.250475+0000","last_clean":"2024-02-17T13:26:09.250475+0000","last_became_active":"2024-02-17T12:57:57.721429+0000","last_became_peered":"2024-02-17T12:57:57.721429+0000","last_unstale":"2024-02-17T13:26:09.250475+0000","last_undegraded":"2024-02-17T13:26:09.250475+0000","last_fullsized":"2024-02-17T13:26:09.250475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:09.250383+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:09.250383+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.250383+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.719949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'13","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.997187+0000","last_change":"2024-02-17T13:26:16.997234+0000","last_active":"2024-02-17T13:26:16.997187+0000","last_peered":"2024-02-17T13:26:16.997187+0000","last_clean":"2024-02-17T13:26:16.997187+0000","last_became_active":"2024-02-17T12:57:56.650390+0000","last_became_peered":"2024-02-17T12:57:56.650390+0000","last_unstale":"2024-02-17T13:26:16.997187+0000","last_undegraded":"2024-02-17T13:26:16.997187+0000","last_fullsized":"2024-02-17T13:26:16.997187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-02-17T13:26:16.997109+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-02-17T13:26:16.997109+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.997109+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:48:07.544049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.289604+0000","last_change":"2024-02-17T13:26:01.289633+0000","last_active":"2024-02-17T13:26:01.289604+0000","last_peered":"2024-02-17T13:26:01.289604+0000","last_clean":"2024-02-17T13:26:01.289604+0000","last_became_active":"2024-02-17T12:57:44.602710+0000","last_became_peered":"2024-02-17T12:57:44.602710+0000","last_unstale":"2024-02-17T13:26:01.289604+0000","last_undegraded":"2024-02-17T13:26:01.289604+0000","last_fullsized":"2024-02-17T13:26:01.289604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-02-17T13:26:01.289538+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-02-17T13:26:01.289538+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.289538+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:40:19.512484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"26'170","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:27.025438+0000","last_change":"2024-02-17T13:26:27.025461+0000","last_active":"2024-02-17T13:26:27.025438+0000","last_peered":"2024-02-17T13:26:27.025438+0000","last_clean":"2024-02-17T13:26:27.025438+0000","last_became_active":"2024-02-17T12:58:02.527000+0000","last_became_peered":"2024-02-17T12:58:02.527000+0000","last_unstale":"2024-02-17T13:26:27.025438+0000","last_undegraded":"2024-02-17T13:26:27.025438+0000","last_fullsized":"2024-02-17T13:26:27.025438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'170","last_scrub_stamp":"2024-02-17T13:26:27.025357+0000","last_deep_scrub":"26'170","last_deep_scrub_stamp":"2024-02-17T13:26:27.025357+0000","last_clean_scrub_stamp":"2024-02-17T13:26:27.025357+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:32:00.335438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":8669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"26'34","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.895697+0000","last_change":"2024-02-17T13:26:06.895720+0000","last_active":"2024-02-17T13:26:06.895697+0000","last_peered":"2024-02-17T13:26:06.895697+0000","last_clean":"2024-02-17T13:26:06.895697+0000","last_became_active":"2024-02-17T12:57:57.799171+0000","last_became_peered":"2024-02-17T12:57:57.799171+0000","last_unstale":"2024-02-17T13:26:06.895697+0000","last_undegraded":"2024-02-17T13:26:06.895697+0000","last_fullsized":"2024-02-17T13:26:06.895697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:06.895627+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:06.895627+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.895627+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:24.461103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'12","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.942019+0000","last_change":"2024-02-17T13:26:05.942063+0000","last_active":"2024-02-17T13:26:05.942019+0000","last_peered":"2024-02-17T13:26:05.942019+0000","last_clean":"2024-02-17T13:26:05.942019+0000","last_became_active":"2024-02-17T12:57:56.644880+0000","last_became_peered":"2024-02-17T12:57:56.644880+0000","last_unstale":"2024-02-17T13:26:05.942019+0000","last_undegraded":"2024-02-17T13:26:05.942019+0000","last_fullsized":"2024-02-17T13:26:05.942019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-02-17T13:26:05.941923+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-02-17T13:26:05.941923+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.941923+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:27.472150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"26'141","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.700898+0000","last_change":"2024-02-17T13:26:12.700898+0000","last_active":"2024-02-17T13:26:12.700898+0000","last_peered":"2024-02-17T13:26:12.700898+0000","last_clean":"2024-02-17T13:26:12.700898+0000","last_became_active":"2024-02-17T12:58:02.532663+0000","last_became_peered":"2024-02-17T12:58:02.532663+0000","last_unstale":"2024-02-17T13:26:12.700898+0000","last_undegraded":"2024-02-17T13:26:12.700898+0000","last_fullsized":"2024-02-17T13:26:12.700898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'141","last_scrub_stamp":"2024-02-17T13:26:12.700784+0000","last_deep_scrub":"26'141","last_deep_scrub_stamp":"2024-02-17T13:26:12.700784+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.700784+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:45:27.271651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'39","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.791142+0000","last_change":"2024-02-17T13:26:12.791169+0000","last_active":"2024-02-17T13:26:12.791142+0000","last_peered":"2024-02-17T13:26:12.791142+0000","last_clean":"2024-02-17T13:26:12.791142+0000","last_became_active":"2024-02-17T12:57:57.795043+0000","last_became_peered":"2024-02-17T12:57:57.795043+0000","last_unstale":"2024-02-17T13:26:12.791142+0000","last_undegraded":"2024-02-17T13:26:12.791142+0000","last_fullsized":"2024-02-17T13:26:12.791142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:12.791075+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:12.791075+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.791075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:53:41.920649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'11","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.788951+0000","last_change":"2024-02-17T13:26:08.788979+0000","last_active":"2024-02-17T13:26:08.788951+0000","last_peered":"2024-02-17T13:26:08.788951+0000","last_clean":"2024-02-17T13:26:08.788951+0000","last_became_active":"2024-02-17T12:57:56.651566+0000","last_became_peered":"2024-02-17T12:57:56.651566+0000","last_unstale":"2024-02-17T13:26:08.788951+0000","last_undegraded":"2024-02-17T13:26:08.788951+0000","last_fullsized":"2024-02-17T13:26:08.788951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-02-17T13:26:08.788860+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-02-17T13:26:08.788860+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.788860+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:22.247417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"26'175","reported_seq":214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:19.925644+0000","last_change":"2024-02-17T13:26:19.925671+0000","last_active":"2024-02-17T13:26:19.925644+0000","last_peered":"2024-02-17T13:26:19.925644+0000","last_clean":"2024-02-17T13:26:19.925644+0000","last_became_active":"2024-02-17T12:58:02.528691+0000","last_became_peered":"2024-02-17T12:58:02.528691+0000","last_unstale":"2024-02-17T13:26:19.925644+0000","last_undegraded":"2024-02-17T13:26:19.925644+0000","last_fullsized":"2024-02-17T13:26:19.925644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'175","last_scrub_stamp":"2024-02-17T13:26:19.925559+0000","last_deep_scrub":"26'175","last_deep_scrub_stamp":"2024-02-17T13:26:19.925559+0000","last_clean_scrub_stamp":"2024-02-17T13:26:19.925559+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:46:51.522351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:00.721503+0000","last_change":"2024-02-17T13:26:00.721524+0000","last_active":"2024-02-17T13:26:00.721503+0000","last_peered":"2024-02-17T13:26:00.721503+0000","last_clean":"2024-02-17T13:26:00.721503+0000","last_became_active":"2024-02-17T12:57:57.771682+0000","last_became_peered":"2024-02-17T12:57:57.771682+0000","last_unstale":"2024-02-17T13:26:00.721503+0000","last_undegraded":"2024-02-17T13:26:00.721503+0000","last_fullsized":"2024-02-17T13:26:00.721503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:00.721437+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:00.721437+0000","last_clean_scrub_stamp":"2024-02-17T13:26:00.721437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:45.827792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.160756+0000","last_change":"2024-02-17T13:26:07.160809+0000","last_active":"2024-02-17T13:26:07.160756+0000","last_peered":"2024-02-17T13:26:07.160756+0000","last_clean":"2024-02-17T13:26:07.160756+0000","last_became_active":"2024-02-17T12:57:56.653357+0000","last_became_peered":"2024-02-17T12:57:56.653357+0000","last_unstale":"2024-02-17T13:26:07.160756+0000","last_undegraded":"2024-02-17T13:26:07.160756+0000","last_fullsized":"2024-02-17T13:26:07.160756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:07.160676+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:07.160676+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.160676+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:39:46.826114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"26'122","reported_seq":162,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:24.973519+0000","last_change":"2024-02-17T13:26:24.973543+0000","last_active":"2024-02-17T13:26:24.973519+0000","last_peered":"2024-02-17T13:26:24.973519+0000","last_clean":"2024-02-17T13:26:24.973519+0000","last_became_active":"2024-02-17T12:58:02.525835+0000","last_became_peered":"2024-02-17T12:58:02.525835+0000","last_unstale":"2024-02-17T13:26:24.973519+0000","last_undegraded":"2024-02-17T13:26:24.973519+0000","last_fullsized":"2024-02-17T13:26:24.973519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'122","last_scrub_stamp":"2024-02-17T13:26:24.973432+0000","last_deep_scrub":"26'122","last_deep_scrub_stamp":"2024-02-17T13:26:24.973432+0000","last_clean_scrub_stamp":"2024-02-17T13:26:24.973432+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:05:38.507055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'21","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.758812+0000","last_change":"2024-02-17T13:26:06.758835+0000","last_active":"2024-02-17T13:26:06.758812+0000","last_peered":"2024-02-17T13:26:06.758812+0000","last_clean":"2024-02-17T13:26:06.758812+0000","last_became_active":"2024-02-17T12:57:57.774195+0000","last_became_peered":"2024-02-17T12:57:57.774195+0000","last_unstale":"2024-02-17T13:26:06.758812+0000","last_undegraded":"2024-02-17T13:26:06.758812+0000","last_fullsized":"2024-02-17T13:26:06.758812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2024-02-17T13:26:06.758744+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2024-02-17T13:26:06.758744+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.758744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:37:53.956853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'8","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.714607+0000","last_change":"2024-02-17T13:26:05.714637+0000","last_active":"2024-02-17T13:26:05.714607+0000","last_peered":"2024-02-17T13:26:05.714607+0000","last_clean":"2024-02-17T13:26:05.714607+0000","last_became_active":"2024-02-17T12:57:56.652001+0000","last_became_peered":"2024-02-17T12:57:56.652001+0000","last_unstale":"2024-02-17T13:26:05.714607+0000","last_undegraded":"2024-02-17T13:26:05.714607+0000","last_fullsized":"2024-02-17T13:26:05.714607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-02-17T13:26:05.714542+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-02-17T13:26:05.714542+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.714542+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:09.046873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"26'161","reported_seq":201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.274537+0000","last_change":"2024-02-17T13:26:08.274537+0000","last_active":"2024-02-17T13:26:08.274537+0000","last_peered":"2024-02-17T13:26:08.274537+0000","last_clean":"2024-02-17T13:26:08.274537+0000","last_became_active":"2024-02-17T12:58:02.525406+0000","last_became_peered":"2024-02-17T12:58:02.525406+0000","last_unstale":"2024-02-17T13:26:08.274537+0000","last_undegraded":"2024-02-17T13:26:08.274537+0000","last_fullsized":"2024-02-17T13:26:08.274537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'161","last_scrub_stamp":"2024-02-17T13:26:08.274429+0000","last_deep_scrub":"26'161","last_deep_scrub_stamp":"2024-02-17T13:26:08.274429+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.274429+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:21:17.407627+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.902139+0000","last_change":"2024-02-17T13:26:02.902178+0000","last_active":"2024-02-17T13:26:02.902139+0000","last_peered":"2024-02-17T13:26:02.902139+0000","last_clean":"2024-02-17T13:26:02.902139+0000","last_became_active":"2024-02-17T12:57:57.798721+0000","last_became_peered":"2024-02-17T12:57:57.798721+0000","last_unstale":"2024-02-17T13:26:02.902139+0000","last_undegraded":"2024-02-17T13:26:02.902139+0000","last_fullsized":"2024-02-17T13:26:02.902139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:02.902059+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:02.902059+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.902059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:23:45.931985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'28","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.211627+0000","last_change":"2024-02-17T13:26:08.211666+0000","last_active":"2024-02-17T13:26:08.211627+0000","last_peered":"2024-02-17T13:26:08.211627+0000","last_clean":"2024-02-17T13:26:08.211627+0000","last_became_active":"2024-02-17T12:57:56.658252+0000","last_became_peered":"2024-02-17T12:57:56.658252+0000","last_unstale":"2024-02-17T13:26:08.211627+0000","last_undegraded":"2024-02-17T13:26:08.211627+0000","last_fullsized":"2024-02-17T13:26:08.211627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:08.211560+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:08.211560+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.211560+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:13.926977+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"26'138","reported_seq":176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:22.949495+0000","last_change":"2024-02-17T13:26:22.949522+0000","last_active":"2024-02-17T13:26:22.949495+0000","last_peered":"2024-02-17T13:26:22.949495+0000","last_clean":"2024-02-17T13:26:22.949495+0000","last_became_active":"2024-02-17T12:58:02.532490+0000","last_became_peered":"2024-02-17T12:58:02.532490+0000","last_unstale":"2024-02-17T13:26:22.949495+0000","last_undegraded":"2024-02-17T13:26:22.949495+0000","last_fullsized":"2024-02-17T13:26:22.949495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'138","last_scrub_stamp":"2024-02-17T13:26:22.949418+0000","last_deep_scrub":"26'138","last_deep_scrub_stamp":"2024-02-17T13:26:22.949418+0000","last_clean_scrub_stamp":"2024-02-17T13:26:22.949418+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:28:19.225528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'30","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.233029+0000","last_change":"2024-02-17T13:26:07.233054+0000","last_active":"2024-02-17T13:26:07.233029+0000","last_peered":"2024-02-17T13:26:07.233029+0000","last_clean":"2024-02-17T13:26:07.233029+0000","last_became_active":"2024-02-17T12:57:57.804293+0000","last_became_peered":"2024-02-17T12:57:57.804293+0000","last_unstale":"2024-02-17T13:26:07.233029+0000","last_undegraded":"2024-02-17T13:26:07.233029+0000","last_fullsized":"2024-02-17T13:26:07.233029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-02-17T13:26:07.232950+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-02-17T13:26:07.232950+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.232950+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:02.260028+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'11","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.733932+0000","last_change":"2024-02-17T13:26:01.733958+0000","last_active":"2024-02-17T13:26:01.733932+0000","last_peered":"2024-02-17T13:26:01.733932+0000","last_clean":"2024-02-17T13:26:01.733932+0000","last_became_active":"2024-02-17T12:57:56.647965+0000","last_became_peered":"2024-02-17T12:57:56.647965+0000","last_unstale":"2024-02-17T13:26:01.733932+0000","last_undegraded":"2024-02-17T13:26:01.733932+0000","last_fullsized":"2024-02-17T13:26:01.733932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-02-17T13:26:01.733870+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-02-17T13:26:01.733870+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.733870+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:09.001282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"26'136","reported_seq":174,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:20.879711+0000","last_change":"2024-02-17T13:26:20.879755+0000","last_active":"2024-02-17T13:26:20.879711+0000","last_peered":"2024-02-17T13:26:20.879711+0000","last_clean":"2024-02-17T13:26:20.879711+0000","last_became_active":"2024-02-17T12:58:02.528750+0000","last_became_peered":"2024-02-17T12:58:02.528750+0000","last_unstale":"2024-02-17T13:26:20.879711+0000","last_undegraded":"2024-02-17T13:26:20.879711+0000","last_fullsized":"2024-02-17T13:26:20.879711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'136","last_scrub_stamp":"2024-02-17T13:26:20.879588+0000","last_deep_scrub":"26'136","last_deep_scrub_stamp":"2024-02-17T13:26:20.879588+0000","last_clean_scrub_stamp":"2024-02-17T13:26:20.879588+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:37:46.865787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'47","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.884642+0000","last_change":"2024-02-17T13:26:03.884662+0000","last_active":"2024-02-17T13:26:03.884642+0000","last_peered":"2024-02-17T13:26:03.884642+0000","last_clean":"2024-02-17T13:26:03.884642+0000","last_became_active":"2024-02-17T12:57:57.798660+0000","last_became_peered":"2024-02-17T12:57:57.798660+0000","last_unstale":"2024-02-17T13:26:03.884642+0000","last_undegraded":"2024-02-17T13:26:03.884642+0000","last_fullsized":"2024-02-17T13:26:03.884642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'47","last_scrub_stamp":"2024-02-17T13:26:03.884572+0000","last_deep_scrub":"26'47","last_deep_scrub_stamp":"2024-02-17T13:26:03.884572+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.884572+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:17:57.539080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"26'18","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.000306+0000","last_change":"2024-02-17T13:26:12.000350+0000","last_active":"2024-02-17T13:26:12.000306+0000","last_peered":"2024-02-17T13:26:12.000306+0000","last_clean":"2024-02-17T13:26:12.000306+0000","last_became_active":"2024-02-17T12:57:56.658008+0000","last_became_peered":"2024-02-17T12:57:56.658008+0000","last_unstale":"2024-02-17T13:26:12.000306+0000","last_undegraded":"2024-02-17T13:26:12.000306+0000","last_fullsized":"2024-02-17T13:26:12.000306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-02-17T13:26:12.000231+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-02-17T13:26:12.000231+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.000231+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:01.682523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"26'115","reported_seq":154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:18.947192+0000","last_change":"2024-02-17T13:26:18.947221+0000","last_active":"2024-02-17T13:26:18.947192+0000","last_peered":"2024-02-17T13:26:18.947192+0000","last_clean":"2024-02-17T13:26:18.947192+0000","last_became_active":"2024-02-17T12:58:02.537317+0000","last_became_peered":"2024-02-17T12:58:02.537317+0000","last_unstale":"2024-02-17T13:26:18.947192+0000","last_undegraded":"2024-02-17T13:26:18.947192+0000","last_fullsized":"2024-02-17T13:26:18.947192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'115","last_scrub_stamp":"2024-02-17T13:26:18.947102+0000","last_deep_scrub":"26'115","last_deep_scrub_stamp":"2024-02-17T13:26:18.947102+0000","last_clean_scrub_stamp":"2024-02-17T13:26:18.947102+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:36.512578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"26'39","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.967940+0000","last_change":"2024-02-17T13:26:12.967964+0000","last_active":"2024-02-17T13:26:12.967940+0000","last_peered":"2024-02-17T13:26:12.967940+0000","last_clean":"2024-02-17T13:26:12.967940+0000","last_became_active":"2024-02-17T12:57:57.799253+0000","last_became_peered":"2024-02-17T12:57:57.799253+0000","last_unstale":"2024-02-17T13:26:12.967940+0000","last_undegraded":"2024-02-17T13:26:12.967940+0000","last_fullsized":"2024-02-17T13:26:12.967940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:12.967859+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:12.967859+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.967859+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:27:15.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'137","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.341615+0000","last_change":"2024-02-17T13:26:05.341643+0000","last_active":"2024-02-17T13:26:05.341615+0000","last_peered":"2024-02-17T13:26:05.341615+0000","last_clean":"2024-02-17T13:26:05.341615+0000","last_became_active":"2024-02-17T12:57:56.658259+0000","last_became_peered":"2024-02-17T12:57:56.658259+0000","last_unstale":"2024-02-17T13:26:05.341615+0000","last_undegraded":"2024-02-17T13:26:05.341615+0000","last_fullsized":"2024-02-17T13:26:05.341615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'137","last_scrub_stamp":"2024-02-17T13:26:05.341553+0000","last_deep_scrub":"26'137","last_deep_scrub_stamp":"2024-02-17T13:26:05.341553+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.341553+0000","objects_scrubbed":7,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:05:54.057507+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1110453,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"26'131","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:24.001827+0000","last_change":"2024-02-17T13:26:24.001857+0000","last_active":"2024-02-17T13:26:24.001827+0000","last_peered":"2024-02-17T13:26:24.001827+0000","last_clean":"2024-02-17T13:26:24.001827+0000","last_became_active":"2024-02-17T12:58:02.518566+0000","last_became_peered":"2024-02-17T12:58:02.518566+0000","last_unstale":"2024-02-17T13:26:24.001827+0000","last_undegraded":"2024-02-17T13:26:24.001827+0000","last_fullsized":"2024-02-17T13:26:24.001827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'131","last_scrub_stamp":"2024-02-17T13:26:24.001756+0000","last_deep_scrub":"26'131","last_deep_scrub_stamp":"2024-02-17T13:26:24.001756+0000","last_clean_scrub_stamp":"2024-02-17T13:26:24.001756+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:37:43.206748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'37","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.814533+0000","last_change":"2024-02-17T13:26:11.814573+0000","last_active":"2024-02-17T13:26:11.814533+0000","last_peered":"2024-02-17T13:26:11.814533+0000","last_clean":"2024-02-17T13:26:11.814533+0000","last_became_active":"2024-02-17T12:57:57.773359+0000","last_became_peered":"2024-02-17T12:57:57.773359+0000","last_unstale":"2024-02-17T13:26:11.814533+0000","last_undegraded":"2024-02-17T13:26:11.814533+0000","last_fullsized":"2024-02-17T13:26:11.814533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-02-17T13:26:11.814444+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-02-17T13:26:11.814444+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.814444+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:29.379920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'827","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:01.819108+0000","last_change":"2024-02-17T13:26:01.819108+0000","last_active":"2024-02-17T13:26:01.819108+0000","last_peered":"2024-02-17T13:26:01.819108+0000","last_clean":"2024-02-17T13:26:01.819108+0000","last_became_active":"2024-02-17T12:57:56.620817+0000","last_became_peered":"2024-02-17T12:57:56.620817+0000","last_unstale":"2024-02-17T13:26:01.819108+0000","last_undegraded":"2024-02-17T13:26:01.819108+0000","last_fullsized":"2024-02-17T13:26:01.819108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'827","last_scrub_stamp":"2024-02-17T13:26:01.818949+0000","last_deep_scrub":"26'827","last_deep_scrub_stamp":"2024-02-17T13:26:01.818949+0000","last_clean_scrub_stamp":"2024-02-17T13:26:01.818949+0000","objects_scrubbed":6,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:56.846026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"26'125","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.289324+0000","last_change":"2024-02-17T13:26:17.289349+0000","last_active":"2024-02-17T13:26:17.289324+0000","last_peered":"2024-02-17T13:26:17.289324+0000","last_clean":"2024-02-17T13:26:17.289324+0000","last_became_active":"2024-02-17T12:58:02.521187+0000","last_became_peered":"2024-02-17T12:58:02.521187+0000","last_unstale":"2024-02-17T13:26:17.289324+0000","last_undegraded":"2024-02-17T13:26:17.289324+0000","last_fullsized":"2024-02-17T13:26:17.289324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2024-02-17T13:26:17.289246+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2024-02-17T13:26:17.289246+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.289246+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:20.116515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'32","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.852160+0000","last_change":"2024-02-17T13:26:05.852197+0000","last_active":"2024-02-17T13:26:05.852160+0000","last_peered":"2024-02-17T13:26:05.852160+0000","last_clean":"2024-02-17T13:26:05.852160+0000","last_became_active":"2024-02-17T12:57:57.798586+0000","last_became_peered":"2024-02-17T12:57:57.798586+0000","last_unstale":"2024-02-17T13:26:05.852160+0000","last_undegraded":"2024-02-17T13:26:05.852160+0000","last_fullsized":"2024-02-17T13:26:05.852160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-02-17T13:26:05.852074+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-02-17T13:26:05.852074+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.852074+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'658","reported_seq":704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.330788+0000","last_change":"2024-02-17T13:26:07.330835+0000","last_active":"2024-02-17T13:26:07.330788+0000","last_peered":"2024-02-17T13:26:07.330788+0000","last_clean":"2024-02-17T13:26:07.330788+0000","last_became_active":"2024-02-17T12:57:56.659653+0000","last_became_peered":"2024-02-17T12:57:56.659653+0000","last_unstale":"2024-02-17T13:26:07.330788+0000","last_undegraded":"2024-02-17T13:26:07.330788+0000","last_fullsized":"2024-02-17T13:26:07.330788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'658","last_scrub_stamp":"2024-02-17T13:26:07.330707+0000","last_deep_scrub":"26'658","last_deep_scrub_stamp":"2024-02-17T13:26:07.330707+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.330707+0000","objects_scrubbed":4,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:41.284319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"26'151","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.657427+0000","last_change":"2024-02-17T13:26:14.657480+0000","last_active":"2024-02-17T13:26:14.657427+0000","last_peered":"2024-02-17T13:26:14.657427+0000","last_clean":"2024-02-17T13:26:14.657427+0000","last_became_active":"2024-02-17T12:58:02.533474+0000","last_became_peered":"2024-02-17T12:58:02.533474+0000","last_unstale":"2024-02-17T13:26:14.657427+0000","last_undegraded":"2024-02-17T13:26:14.657427+0000","last_fullsized":"2024-02-17T13:26:14.657427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'151","last_scrub_stamp":"2024-02-17T13:26:14.657295+0000","last_deep_scrub":"26'151","last_deep_scrub_stamp":"2024-02-17T13:26:14.657295+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.657295+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:38:32.222771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":23394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"26'39","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.831948+0000","last_change":"2024-02-17T13:26:16.831974+0000","last_active":"2024-02-17T13:26:16.831948+0000","last_peered":"2024-02-17T13:26:16.831948+0000","last_clean":"2024-02-17T13:26:16.831948+0000","last_became_active":"2024-02-17T12:57:57.804448+0000","last_became_peered":"2024-02-17T12:57:57.804448+0000","last_unstale":"2024-02-17T13:26:16.831948+0000","last_undegraded":"2024-02-17T13:26:16.831948+0000","last_fullsized":"2024-02-17T13:26:16.831948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:16.831854+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:16.831854+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.831854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:38:08.457846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'7","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.746163+0000","last_change":"2024-02-17T13:26:06.746187+0000","last_active":"2024-02-17T13:26:06.746163+0000","last_peered":"2024-02-17T13:26:06.746163+0000","last_clean":"2024-02-17T13:26:06.746163+0000","last_became_active":"2024-02-17T12:57:56.652399+0000","last_became_peered":"2024-02-17T12:57:56.652399+0000","last_unstale":"2024-02-17T13:26:06.746163+0000","last_undegraded":"2024-02-17T13:26:06.746163+0000","last_fullsized":"2024-02-17T13:26:06.746163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-02-17T13:26:06.746101+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-02-17T13:26:06.746101+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.746101+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:32.708711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"26'126","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.270555+0000","last_change":"2024-02-17T13:26:12.270578+0000","last_active":"2024-02-17T13:26:12.270555+0000","last_peered":"2024-02-17T13:26:12.270555+0000","last_clean":"2024-02-17T13:26:12.270555+0000","last_became_active":"2024-02-17T12:58:02.538180+0000","last_became_peered":"2024-02-17T12:58:02.538180+0000","last_unstale":"2024-02-17T13:26:12.270555+0000","last_undegraded":"2024-02-17T13:26:12.270555+0000","last_fullsized":"2024-02-17T13:26:12.270555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'126","last_scrub_stamp":"2024-02-17T13:26:12.270468+0000","last_deep_scrub":"26'126","last_deep_scrub_stamp":"2024-02-17T13:26:12.270468+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.270468+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:55.570618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":10959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'43","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.730345+0000","last_change":"2024-02-17T13:26:07.730368+0000","last_active":"2024-02-17T13:26:07.730345+0000","last_peered":"2024-02-17T13:26:07.730345+0000","last_clean":"2024-02-17T13:26:07.730345+0000","last_became_active":"2024-02-17T12:57:57.796149+0000","last_became_peered":"2024-02-17T12:57:57.796149+0000","last_unstale":"2024-02-17T13:26:07.730345+0000","last_undegraded":"2024-02-17T13:26:07.730345+0000","last_fullsized":"2024-02-17T13:26:07.730345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'43","last_scrub_stamp":"2024-02-17T13:26:07.730273+0000","last_deep_scrub":"26'43","last_deep_scrub_stamp":"2024-02-17T13:26:07.730273+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.730273+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:52.199840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'14","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.267098+0000","last_change":"2024-02-17T13:26:02.267127+0000","last_active":"2024-02-17T13:26:02.267098+0000","last_peered":"2024-02-17T13:26:02.267098+0000","last_clean":"2024-02-17T13:26:02.267098+0000","last_became_active":"2024-02-17T12:57:56.656290+0000","last_became_peered":"2024-02-17T12:57:56.656290+0000","last_unstale":"2024-02-17T13:26:02.267098+0000","last_undegraded":"2024-02-17T13:26:02.267098+0000","last_fullsized":"2024-02-17T13:26:02.267098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-02-17T13:26:02.267038+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-02-17T13:26:02.267038+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.267038+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:23:24.897338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"26'167","reported_seq":206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:18.298289+0000","last_change":"2024-02-17T13:26:18.298331+0000","last_active":"2024-02-17T13:26:18.298289+0000","last_peered":"2024-02-17T13:26:18.298289+0000","last_clean":"2024-02-17T13:26:18.298289+0000","last_became_active":"2024-02-17T12:58:02.535024+0000","last_became_peered":"2024-02-17T12:58:02.535024+0000","last_unstale":"2024-02-17T13:26:18.298289+0000","last_undegraded":"2024-02-17T13:26:18.298289+0000","last_fullsized":"2024-02-17T13:26:18.298289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'167","last_scrub_stamp":"2024-02-17T13:26:18.298177+0000","last_deep_scrub":"26'167","last_deep_scrub_stamp":"2024-02-17T13:26:18.298177+0000","last_clean_scrub_stamp":"2024-02-17T13:26:18.298177+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:04.425596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"26'142","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.266654+0000","last_change":"2024-02-17T13:26:16.266676+0000","last_active":"2024-02-17T13:26:16.266654+0000","last_peered":"2024-02-17T13:26:16.266654+0000","last_clean":"2024-02-17T13:26:16.266654+0000","last_became_active":"2024-02-17T12:58:02.518914+0000","last_became_peered":"2024-02-17T12:58:02.518914+0000","last_unstale":"2024-02-17T13:26:16.266654+0000","last_undegraded":"2024-02-17T13:26:16.266654+0000","last_fullsized":"2024-02-17T13:26:16.266654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'142","last_scrub_stamp":"2024-02-17T13:26:16.266582+0000","last_deep_scrub":"26'142","last_deep_scrub_stamp":"2024-02-17T13:26:16.266582+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.266582+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:27:34.158354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":9062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"26'40","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.202906+0000","last_change":"2024-02-17T13:26:11.202929+0000","last_active":"2024-02-17T13:26:11.202906+0000","last_peered":"2024-02-17T13:26:11.202906+0000","last_clean":"2024-02-17T13:26:11.202906+0000","last_became_active":"2024-02-17T12:57:57.727445+0000","last_became_peered":"2024-02-17T12:57:57.727445+0000","last_unstale":"2024-02-17T13:26:11.202906+0000","last_undegraded":"2024-02-17T13:26:11.202906+0000","last_fullsized":"2024-02-17T13:26:11.202906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-02-17T13:26:11.202835+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-02-17T13:26:11.202835+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.202835+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:37.165445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"26'9","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:19.026565+0000","last_change":"2024-02-17T13:26:19.026589+0000","last_active":"2024-02-17T13:26:19.026565+0000","last_peered":"2024-02-17T13:26:19.026565+0000","last_clean":"2024-02-17T13:26:19.026565+0000","last_became_active":"2024-02-17T12:57:56.652959+0000","last_became_peered":"2024-02-17T12:57:56.652959+0000","last_unstale":"2024-02-17T13:26:19.026565+0000","last_undegraded":"2024-02-17T13:26:19.026565+0000","last_fullsized":"2024-02-17T13:26:19.026565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-02-17T13:26:19.026505+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-02-17T13:26:19.026505+0000","last_clean_scrub_stamp":"2024-02-17T13:26:19.026505+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:23:50.536306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:25.988887+0000","last_change":"2024-02-17T13:26:25.988909+0000","last_active":"2024-02-17T13:26:25.988887+0000","last_peered":"2024-02-17T13:26:25.988887+0000","last_clean":"2024-02-17T13:26:25.988887+0000","last_became_active":"2024-02-17T12:58:02.526043+0000","last_became_peered":"2024-02-17T12:58:02.526043+0000","last_unstale":"2024-02-17T13:26:25.988887+0000","last_undegraded":"2024-02-17T13:26:25.988887+0000","last_fullsized":"2024-02-17T13:26:25.988887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'145","last_scrub_stamp":"2024-02-17T13:26:25.988809+0000","last_deep_scrub":"26'145","last_deep_scrub_stamp":"2024-02-17T13:26:25.988809+0000","last_clean_scrub_stamp":"2024-02-17T13:26:25.988809+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:14:17.744506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":20244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"26'41","reported_seq":85,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.779988+0000","last_change":"2024-02-17T13:26:11.780009+0000","last_active":"2024-02-17T13:26:11.779988+0000","last_peered":"2024-02-17T13:26:11.779988+0000","last_clean":"2024-02-17T13:26:11.779988+0000","last_became_active":"2024-02-17T12:57:57.801000+0000","last_became_peered":"2024-02-17T12:57:57.801000+0000","last_unstale":"2024-02-17T13:26:11.779988+0000","last_undegraded":"2024-02-17T13:26:11.779988+0000","last_fullsized":"2024-02-17T13:26:11.779988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'41","last_scrub_stamp":"2024-02-17T13:26:11.779918+0000","last_deep_scrub":"26'41","last_deep_scrub_stamp":"2024-02-17T13:26:11.779918+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.779918+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:22:39.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'14","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.979439+0000","last_change":"2024-02-17T13:26:04.979464+0000","last_active":"2024-02-17T13:26:04.979439+0000","last_peered":"2024-02-17T13:26:04.979439+0000","last_clean":"2024-02-17T13:26:04.979439+0000","last_became_active":"2024-02-17T12:57:56.643180+0000","last_became_peered":"2024-02-17T12:57:56.643180+0000","last_unstale":"2024-02-17T13:26:04.979439+0000","last_undegraded":"2024-02-17T13:26:04.979439+0000","last_fullsized":"2024-02-17T13:26:04.979439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-02-17T13:26:04.979376+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-02-17T13:26:04.979376+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.979376+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:34.498677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'684","reported_seq":730,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.015005+0000","last_change":"2024-02-17T13:26:16.015035+0000","last_active":"2024-02-17T13:26:16.015005+0000","last_peered":"2024-02-17T13:26:16.015005+0000","last_clean":"2024-02-17T13:26:16.015005+0000","last_became_active":"2024-02-17T12:57:56.649326+0000","last_became_peered":"2024-02-17T12:57:56.649326+0000","last_unstale":"2024-02-17T13:26:16.015005+0000","last_undegraded":"2024-02-17T13:26:16.015005+0000","last_fullsized":"2024-02-17T13:26:16.015005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'684","last_scrub_stamp":"2024-02-17T13:26:16.014902+0000","last_deep_scrub":"26'684","last_deep_scrub_stamp":"2024-02-17T13:26:16.014902+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.014902+0000","objects_scrubbed":4,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:50:23.531917+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"26'40","reported_seq":84,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:12.248009+0000","last_change":"2024-02-17T13:26:12.248037+0000","last_active":"2024-02-17T13:26:12.248009+0000","last_peered":"2024-02-17T13:26:12.248009+0000","last_clean":"2024-02-17T13:26:12.248009+0000","last_became_active":"2024-02-17T12:57:57.772973+0000","last_became_peered":"2024-02-17T12:57:57.772973+0000","last_unstale":"2024-02-17T13:26:12.248009+0000","last_undegraded":"2024-02-17T13:26:12.248009+0000","last_fullsized":"2024-02-17T13:26:12.248009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-02-17T13:26:12.247940+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-02-17T13:26:12.247940+0000","last_clean_scrub_stamp":"2024-02-17T13:26:12.247940+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:25.706496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"26'95","reported_seq":133,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:19.337558+0000","last_change":"2024-02-17T13:26:19.337582+0000","last_active":"2024-02-17T13:26:19.337558+0000","last_peered":"2024-02-17T13:26:19.337558+0000","last_clean":"2024-02-17T13:26:19.337558+0000","last_became_active":"2024-02-17T12:58:02.535217+0000","last_became_peered":"2024-02-17T12:58:02.535217+0000","last_unstale":"2024-02-17T13:26:19.337558+0000","last_undegraded":"2024-02-17T13:26:19.337558+0000","last_fullsized":"2024-02-17T13:26:19.337558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'95","last_scrub_stamp":"2024-02-17T13:26:19.337486+0000","last_deep_scrub":"26'95","last_deep_scrub_stamp":"2024-02-17T13:26:19.337486+0000","last_clean_scrub_stamp":"2024-02-17T13:26:19.337486+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:51.251243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'661","reported_seq":707,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.847639+0000","last_change":"2024-02-17T13:26:07.847693+0000","last_active":"2024-02-17T13:26:07.847639+0000","last_peered":"2024-02-17T13:26:07.847639+0000","last_clean":"2024-02-17T13:26:07.847639+0000","last_became_active":"2024-02-17T12:57:56.651222+0000","last_became_peered":"2024-02-17T12:57:56.651222+0000","last_unstale":"2024-02-17T13:26:07.847639+0000","last_undegraded":"2024-02-17T13:26:07.847639+0000","last_fullsized":"2024-02-17T13:26:07.847639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'661","last_scrub_stamp":"2024-02-17T13:26:07.847551+0000","last_deep_scrub":"26'661","last_deep_scrub_stamp":"2024-02-17T13:26:07.847551+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.847551+0000","objects_scrubbed":3,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.590174+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.235369+0000","last_change":"2024-02-17T13:26:06.235392+0000","last_active":"2024-02-17T13:26:06.235369+0000","last_peered":"2024-02-17T13:26:06.235369+0000","last_clean":"2024-02-17T13:26:06.235369+0000","last_became_active":"2024-02-17T12:57:57.803406+0000","last_became_peered":"2024-02-17T12:57:57.803406+0000","last_unstale":"2024-02-17T13:26:06.235369+0000","last_undegraded":"2024-02-17T13:26:06.235369+0000","last_fullsized":"2024-02-17T13:26:06.235369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:06.235300+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:06.235300+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.235300+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:35.754602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"26'162","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:16.611834+0000","last_change":"2024-02-17T13:26:16.611870+0000","last_active":"2024-02-17T13:26:16.611834+0000","last_peered":"2024-02-17T13:26:16.611834+0000","last_clean":"2024-02-17T13:26:16.611834+0000","last_became_active":"2024-02-17T12:58:37.886950+0000","last_became_peered":"2024-02-17T12:58:37.886950+0000","last_unstale":"2024-02-17T13:26:16.611834+0000","last_undegraded":"2024-02-17T13:26:16.611834+0000","last_fullsized":"2024-02-17T13:26:16.611834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'162","last_scrub_stamp":"2024-02-17T13:26:16.611755+0000","last_deep_scrub":"26'162","last_deep_scrub_stamp":"2024-02-17T13:26:16.611755+0000","last_clean_scrub_stamp":"2024-02-17T13:26:16.611755+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:41:19.361216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"26'49","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.760253+0000","last_change":"2024-02-17T13:26:04.760293+0000","last_active":"2024-02-17T13:26:04.760253+0000","last_peered":"2024-02-17T13:26:04.760253+0000","last_clean":"2024-02-17T13:26:04.760253+0000","last_became_active":"2024-02-17T12:57:57.759969+0000","last_became_peered":"2024-02-17T12:57:57.759969+0000","last_unstale":"2024-02-17T13:26:04.760253+0000","last_undegraded":"2024-02-17T13:26:04.760253+0000","last_fullsized":"2024-02-17T13:26:04.760253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'49","last_scrub_stamp":"2024-02-17T13:26:04.760180+0000","last_deep_scrub":"26'49","last_deep_scrub_stamp":"2024-02-17T13:26:04.760180+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.760180+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:48.060329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"26'49","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.397468+0000","last_change":"2024-02-17T13:26:09.397493+0000","last_active":"2024-02-17T13:26:09.397468+0000","last_peered":"2024-02-17T13:26:09.397468+0000","last_clean":"2024-02-17T13:26:09.397468+0000","last_became_active":"2024-02-17T12:57:57.795209+0000","last_became_peered":"2024-02-17T12:57:57.795209+0000","last_unstale":"2024-02-17T13:26:09.397468+0000","last_undegraded":"2024-02-17T13:26:09.397468+0000","last_fullsized":"2024-02-17T13:26:09.397468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'49","last_scrub_stamp":"2024-02-17T13:26:09.397389+0000","last_deep_scrub":"26'49","last_deep_scrub_stamp":"2024-02-17T13:26:09.397389+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.397389+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:58.905524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"26'45","reported_seq":91,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:22.966309+0000","last_change":"2024-02-17T13:26:22.966331+0000","last_active":"2024-02-17T13:26:22.966309+0000","last_peered":"2024-02-17T13:26:22.966309+0000","last_clean":"2024-02-17T13:26:22.966309+0000","last_became_active":"2024-02-17T12:57:57.806004+0000","last_became_peered":"2024-02-17T12:57:57.806004+0000","last_unstale":"2024-02-17T13:26:22.966309+0000","last_undegraded":"2024-02-17T13:26:22.966309+0000","last_fullsized":"2024-02-17T13:26:22.966309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'45","last_scrub_stamp":"2024-02-17T13:26:22.966208+0000","last_deep_scrub":"26'45","last_deep_scrub_stamp":"2024-02-17T13:26:22.966208+0000","last_clean_scrub_stamp":"2024-02-17T13:26:22.966208+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:32:57.795190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"26'35","reported_seq":81,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:06.827967+0000","last_change":"2024-02-17T13:26:06.827991+0000","last_active":"2024-02-17T13:26:06.827967+0000","last_peered":"2024-02-17T13:26:06.827967+0000","last_clean":"2024-02-17T13:26:06.827967+0000","last_became_active":"2024-02-17T12:57:57.803129+0000","last_became_peered":"2024-02-17T12:57:57.803129+0000","last_unstale":"2024-02-17T13:26:06.827967+0000","last_undegraded":"2024-02-17T13:26:06.827967+0000","last_fullsized":"2024-02-17T13:26:06.827967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:06.827894+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:06.827894+0000","last_clean_scrub_stamp":"2024-02-17T13:26:06.827894+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:10.160225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"26'27","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.966999+0000","last_change":"2024-02-17T13:26:09.967022+0000","last_active":"2024-02-17T13:26:09.966999+0000","last_peered":"2024-02-17T13:26:09.966999+0000","last_clean":"2024-02-17T13:26:09.966999+0000","last_became_active":"2024-02-17T12:57:57.774209+0000","last_became_peered":"2024-02-17T12:57:57.774209+0000","last_unstale":"2024-02-17T13:26:09.966999+0000","last_undegraded":"2024-02-17T13:26:09.966999+0000","last_fullsized":"2024-02-17T13:26:09.966999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-02-17T13:26:09.966921+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-02-17T13:26:09.966921+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.966921+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:39:49.632359+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"26'32","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.983842+0000","last_change":"2024-02-17T13:26:10.983886+0000","last_active":"2024-02-17T13:26:10.983842+0000","last_peered":"2024-02-17T13:26:10.983842+0000","last_clean":"2024-02-17T13:26:10.983842+0000","last_became_active":"2024-02-17T12:57:57.795289+0000","last_became_peered":"2024-02-17T12:57:57.795289+0000","last_unstale":"2024-02-17T13:26:10.983842+0000","last_undegraded":"2024-02-17T13:26:10.983842+0000","last_fullsized":"2024-02-17T13:26:10.983842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-02-17T13:26:10.983767+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-02-17T13:26:10.983767+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.983767+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:16.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"26'43","reported_seq":89,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.706322+0000","last_change":"2024-02-17T13:26:08.706345+0000","last_active":"2024-02-17T13:26:08.706322+0000","last_peered":"2024-02-17T13:26:08.706322+0000","last_clean":"2024-02-17T13:26:08.706322+0000","last_became_active":"2024-02-17T12:57:57.796826+0000","last_became_peered":"2024-02-17T12:57:57.796826+0000","last_unstale":"2024-02-17T13:26:08.706322+0000","last_undegraded":"2024-02-17T13:26:08.706322+0000","last_fullsized":"2024-02-17T13:26:08.706322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'43","last_scrub_stamp":"2024-02-17T13:26:08.706246+0000","last_deep_scrub":"26'43","last_deep_scrub_stamp":"2024-02-17T13:26:08.706246+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.706246+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:12.038577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"26'31","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:17.846409+0000","last_change":"2024-02-17T13:26:17.846451+0000","last_active":"2024-02-17T13:26:17.846409+0000","last_peered":"2024-02-17T13:26:17.846409+0000","last_clean":"2024-02-17T13:26:17.846409+0000","last_became_active":"2024-02-17T12:57:57.804406+0000","last_became_peered":"2024-02-17T12:57:57.804406+0000","last_unstale":"2024-02-17T13:26:17.846409+0000","last_undegraded":"2024-02-17T13:26:17.846409+0000","last_fullsized":"2024-02-17T13:26:17.846409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-02-17T13:26:17.846316+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-02-17T13:26:17.846316+0000","last_clean_scrub_stamp":"2024-02-17T13:26:17.846316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:07.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"26'34","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:20.989067+0000","last_change":"2024-02-17T13:26:20.989089+0000","last_active":"2024-02-17T13:26:20.989067+0000","last_peered":"2024-02-17T13:26:20.989067+0000","last_clean":"2024-02-17T13:26:20.989067+0000","last_became_active":"2024-02-17T12:57:57.805530+0000","last_became_peered":"2024-02-17T12:57:57.805530+0000","last_unstale":"2024-02-17T13:26:20.989067+0000","last_undegraded":"2024-02-17T13:26:20.989067+0000","last_fullsized":"2024-02-17T13:26:20.989067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'34","last_scrub_stamp":"2024-02-17T13:26:20.988991+0000","last_deep_scrub":"26'34","last_deep_scrub_stamp":"2024-02-17T13:26:20.988991+0000","last_clean_scrub_stamp":"2024-02-17T13:26:20.988991+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:38:32.074029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"26'45","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.815691+0000","last_change":"2024-02-17T13:26:14.815735+0000","last_active":"2024-02-17T13:26:14.815691+0000","last_peered":"2024-02-17T13:26:14.815691+0000","last_clean":"2024-02-17T13:26:14.815691+0000","last_became_active":"2024-02-17T12:57:57.802601+0000","last_became_peered":"2024-02-17T12:57:57.802601+0000","last_unstale":"2024-02-17T13:26:14.815691+0000","last_undegraded":"2024-02-17T13:26:14.815691+0000","last_fullsized":"2024-02-17T13:26:14.815691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'45","last_scrub_stamp":"2024-02-17T13:26:14.815593+0000","last_deep_scrub":"26'45","last_deep_scrub_stamp":"2024-02-17T13:26:14.815593+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.815593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:41:17.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"26'38","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.225894+0000","last_change":"2024-02-17T13:26:03.225917+0000","last_active":"2024-02-17T13:26:03.225894+0000","last_peered":"2024-02-17T13:26:03.225894+0000","last_clean":"2024-02-17T13:26:03.225894+0000","last_became_active":"2024-02-17T12:57:57.772032+0000","last_became_peered":"2024-02-17T12:57:57.772032+0000","last_unstale":"2024-02-17T13:26:03.225894+0000","last_undegraded":"2024-02-17T13:26:03.225894+0000","last_fullsized":"2024-02-17T13:26:03.225894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2024-02-17T13:26:03.225811+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2024-02-17T13:26:03.225811+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.225811+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:17:20.293106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"26'45","reported_seq":90,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.201711+0000","last_change":"2024-02-17T13:26:10.201733+0000","last_active":"2024-02-17T13:26:10.201711+0000","last_peered":"2024-02-17T13:26:10.201711+0000","last_clean":"2024-02-17T13:26:10.201711+0000","last_became_active":"2024-02-17T12:57:57.723928+0000","last_became_peered":"2024-02-17T12:57:57.723928+0000","last_unstale":"2024-02-17T13:26:10.201711+0000","last_undegraded":"2024-02-17T13:26:10.201711+0000","last_fullsized":"2024-02-17T13:26:10.201711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'45","last_scrub_stamp":"2024-02-17T13:26:10.201639+0000","last_deep_scrub":"26'45","last_deep_scrub_stamp":"2024-02-17T13:26:10.201639+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.201639+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:35:13.533970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'39","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.270771+0000","last_change":"2024-02-17T13:26:14.270795+0000","last_active":"2024-02-17T13:26:14.270771+0000","last_peered":"2024-02-17T13:26:14.270771+0000","last_clean":"2024-02-17T13:26:14.270771+0000","last_became_active":"2024-02-17T12:58:37.741110+0000","last_became_peered":"2024-02-17T12:58:37.741110+0000","last_unstale":"2024-02-17T13:26:14.270771+0000","last_undegraded":"2024-02-17T13:26:14.270771+0000","last_fullsized":"2024-02-17T13:26:14.270771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:14.270710+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:14.270710+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.270710+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:39:53.936148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"26'32","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:21.962225+0000","last_change":"2024-02-17T13:26:21.962246+0000","last_active":"2024-02-17T13:26:21.962225+0000","last_peered":"2024-02-17T13:26:21.962225+0000","last_clean":"2024-02-17T13:26:21.962225+0000","last_became_active":"2024-02-17T12:57:57.805749+0000","last_became_peered":"2024-02-17T12:57:57.805749+0000","last_unstale":"2024-02-17T13:26:21.962225+0000","last_undegraded":"2024-02-17T13:26:21.962225+0000","last_fullsized":"2024-02-17T13:26:21.962225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-02-17T13:26:21.962120+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-02-17T13:26:21.962120+0000","last_clean_scrub_stamp":"2024-02-17T13:26:21.962120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:10.663683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"26'47","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.360669+0000","last_change":"2024-02-17T13:26:08.360692+0000","last_active":"2024-02-17T13:26:08.360669+0000","last_peered":"2024-02-17T13:26:08.360669+0000","last_clean":"2024-02-17T13:26:08.360669+0000","last_became_active":"2024-02-17T12:57:57.795006+0000","last_became_peered":"2024-02-17T12:57:57.795006+0000","last_unstale":"2024-02-17T13:26:08.360669+0000","last_undegraded":"2024-02-17T13:26:08.360669+0000","last_fullsized":"2024-02-17T13:26:08.360669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'47","last_scrub_stamp":"2024-02-17T13:26:08.360595+0000","last_deep_scrub":"26'47","last_deep_scrub_stamp":"2024-02-17T13:26:08.360595+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.360595+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:16.654443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.957345+0000","last_change":"2024-02-17T13:26:08.957367+0000","last_active":"2024-02-17T13:26:08.957345+0000","last_peered":"2024-02-17T13:26:08.957345+0000","last_clean":"2024-02-17T13:26:08.957345+0000","last_became_active":"2024-02-17T12:57:57.800636+0000","last_became_peered":"2024-02-17T12:57:57.800636+0000","last_unstale":"2024-02-17T13:26:08.957345+0000","last_undegraded":"2024-02-17T13:26:08.957345+0000","last_fullsized":"2024-02-17T13:26:08.957345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:08.957274+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:08.957274+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.957274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:41:11.706734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"26'42","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.972150+0000","last_change":"2024-02-17T13:26:09.972171+0000","last_active":"2024-02-17T13:26:09.972150+0000","last_peered":"2024-02-17T13:26:09.972150+0000","last_clean":"2024-02-17T13:26:09.972150+0000","last_became_active":"2024-02-17T12:57:57.795588+0000","last_became_peered":"2024-02-17T12:57:57.795588+0000","last_unstale":"2024-02-17T13:26:09.972150+0000","last_undegraded":"2024-02-17T13:26:09.972150+0000","last_fullsized":"2024-02-17T13:26:09.972150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'42","last_scrub_stamp":"2024-02-17T13:26:09.972074+0000","last_deep_scrub":"26'42","last_deep_scrub_stamp":"2024-02-17T13:26:09.972074+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.972074+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:34:56.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"26'41","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:04.784199+0000","last_change":"2024-02-17T13:26:04.784246+0000","last_active":"2024-02-17T13:26:04.784199+0000","last_peered":"2024-02-17T13:26:04.784199+0000","last_clean":"2024-02-17T13:26:04.784199+0000","last_became_active":"2024-02-17T12:57:57.803376+0000","last_became_peered":"2024-02-17T12:57:57.803376+0000","last_unstale":"2024-02-17T13:26:04.784199+0000","last_undegraded":"2024-02-17T13:26:04.784199+0000","last_fullsized":"2024-02-17T13:26:04.784199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'41","last_scrub_stamp":"2024-02-17T13:26:04.784115+0000","last_deep_scrub":"26'41","last_deep_scrub_stamp":"2024-02-17T13:26:04.784115+0000","last_clean_scrub_stamp":"2024-02-17T13:26:04.784115+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:37:51.982224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'35","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:11.977255+0000","last_change":"2024-02-17T13:26:11.977279+0000","last_active":"2024-02-17T13:26:11.977255+0000","last_peered":"2024-02-17T13:26:11.977255+0000","last_clean":"2024-02-17T13:26:11.977255+0000","last_became_active":"2024-02-17T12:57:57.795332+0000","last_became_peered":"2024-02-17T12:57:57.795332+0000","last_unstale":"2024-02-17T13:26:11.977255+0000","last_undegraded":"2024-02-17T13:26:11.977255+0000","last_fullsized":"2024-02-17T13:26:11.977255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:11.977185+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:11.977185+0000","last_clean_scrub_stamp":"2024-02-17T13:26:11.977185+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:56.446752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"26'39","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:09.015506+0000","last_change":"2024-02-17T13:26:09.015563+0000","last_active":"2024-02-17T13:26:09.015506+0000","last_peered":"2024-02-17T13:26:09.015506+0000","last_clean":"2024-02-17T13:26:09.015506+0000","last_became_active":"2024-02-17T12:57:57.774212+0000","last_became_peered":"2024-02-17T12:57:57.774212+0000","last_unstale":"2024-02-17T13:26:09.015506+0000","last_undegraded":"2024-02-17T13:26:09.015506+0000","last_fullsized":"2024-02-17T13:26:09.015506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'39","last_scrub_stamp":"2024-02-17T13:26:09.015407+0000","last_deep_scrub":"26'39","last_deep_scrub_stamp":"2024-02-17T13:26:09.015407+0000","last_clean_scrub_stamp":"2024-02-17T13:26:09.015407+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:16.282819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"26'28","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:08.755724+0000","last_change":"2024-02-17T13:26:08.755767+0000","last_active":"2024-02-17T13:26:08.755724+0000","last_peered":"2024-02-17T13:26:08.755724+0000","last_clean":"2024-02-17T13:26:08.755724+0000","last_became_active":"2024-02-17T12:57:57.771657+0000","last_became_peered":"2024-02-17T12:57:57.771657+0000","last_unstale":"2024-02-17T13:26:08.755724+0000","last_undegraded":"2024-02-17T13:26:08.755724+0000","last_fullsized":"2024-02-17T13:26:08.755724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:08.755644+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:08.755644+0000","last_clean_scrub_stamp":"2024-02-17T13:26:08.755644+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:17:12.882079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:14.767200+0000","last_change":"2024-02-17T13:26:14.767245+0000","last_active":"2024-02-17T13:26:14.767200+0000","last_peered":"2024-02-17T13:26:14.767200+0000","last_clean":"2024-02-17T13:26:14.767200+0000","last_became_active":"2024-02-17T12:57:57.797535+0000","last_became_peered":"2024-02-17T12:57:57.797535+0000","last_unstale":"2024-02-17T13:26:14.767200+0000","last_undegraded":"2024-02-17T13:26:14.767200+0000","last_fullsized":"2024-02-17T13:26:14.767200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:14.767083+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:14.767083+0000","last_clean_scrub_stamp":"2024-02-17T13:26:14.767083+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:00.894502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"26'48","reported_seq":92,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:10.810743+0000","last_change":"2024-02-17T13:26:10.810764+0000","last_active":"2024-02-17T13:26:10.810743+0000","last_peered":"2024-02-17T13:26:10.810743+0000","last_clean":"2024-02-17T13:26:10.810743+0000","last_became_active":"2024-02-17T12:57:57.772945+0000","last_became_peered":"2024-02-17T12:57:57.772945+0000","last_unstale":"2024-02-17T13:26:10.810743+0000","last_undegraded":"2024-02-17T13:26:10.810743+0000","last_fullsized":"2024-02-17T13:26:10.810743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'48","last_scrub_stamp":"2024-02-17T13:26:10.810670+0000","last_deep_scrub":"26'48","last_deep_scrub_stamp":"2024-02-17T13:26:10.810670+0000","last_clean_scrub_stamp":"2024-02-17T13:26:10.810670+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:39:33.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"26'38","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.281478+0000","last_change":"2024-02-17T13:26:05.281516+0000","last_active":"2024-02-17T13:26:05.281478+0000","last_peered":"2024-02-17T13:26:05.281478+0000","last_clean":"2024-02-17T13:26:05.281478+0000","last_became_active":"2024-02-17T12:57:57.796001+0000","last_became_peered":"2024-02-17T12:57:57.796001+0000","last_unstale":"2024-02-17T13:26:05.281478+0000","last_undegraded":"2024-02-17T13:26:05.281478+0000","last_fullsized":"2024-02-17T13:26:05.281478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2024-02-17T13:26:05.281371+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2024-02-17T13:26:05.281371+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.281371+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:39.684223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"26'28","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:18.886997+0000","last_change":"2024-02-17T13:26:18.887025+0000","last_active":"2024-02-17T13:26:18.886997+0000","last_peered":"2024-02-17T13:26:18.886997+0000","last_clean":"2024-02-17T13:26:18.886997+0000","last_became_active":"2024-02-17T12:57:57.803046+0000","last_became_peered":"2024-02-17T12:57:57.803046+0000","last_unstale":"2024-02-17T13:26:18.886997+0000","last_undegraded":"2024-02-17T13:26:18.886997+0000","last_fullsized":"2024-02-17T13:26:18.886997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-02-17T13:26:18.886905+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-02-17T13:26:18.886905+0000","last_clean_scrub_stamp":"2024-02-17T13:26:18.886905+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:34:57.108979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:07.715543+0000","last_change":"2024-02-17T13:26:07.715568+0000","last_active":"2024-02-17T13:26:07.715543+0000","last_peered":"2024-02-17T13:26:07.715543+0000","last_clean":"2024-02-17T13:26:07.715543+0000","last_became_active":"2024-02-17T12:57:57.771783+0000","last_became_peered":"2024-02-17T12:57:57.771783+0000","last_unstale":"2024-02-17T13:26:07.715543+0000","last_undegraded":"2024-02-17T13:26:07.715543+0000","last_fullsized":"2024-02-17T13:26:07.715543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:07.715472+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:07.715472+0000","last_clean_scrub_stamp":"2024-02-17T13:26:07.715472+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:10:21.174029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"26'35","reported_seq":79,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.764958+0000","last_change":"2024-02-17T13:26:03.764980+0000","last_active":"2024-02-17T13:26:03.764958+0000","last_peered":"2024-02-17T13:26:03.764958+0000","last_clean":"2024-02-17T13:26:03.764958+0000","last_became_active":"2024-02-17T12:57:57.721446+0000","last_became_peered":"2024-02-17T12:57:57.721446+0000","last_unstale":"2024-02-17T13:26:03.764958+0000","last_undegraded":"2024-02-17T13:26:03.764958+0000","last_fullsized":"2024-02-17T13:26:03.764958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-02-17T13:26:03.764892+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-02-17T13:26:03.764892+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.764892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:37.384799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:15.734254+0000","last_change":"2024-02-17T13:26:15.734279+0000","last_active":"2024-02-17T13:26:15.734254+0000","last_peered":"2024-02-17T13:26:15.734254+0000","last_clean":"2024-02-17T13:26:15.734254+0000","last_became_active":"2024-02-17T12:57:57.803504+0000","last_became_peered":"2024-02-17T12:57:57.803504+0000","last_unstale":"2024-02-17T13:26:15.734254+0000","last_undegraded":"2024-02-17T13:26:15.734254+0000","last_fullsized":"2024-02-17T13:26:15.734254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-02-17T13:26:15.734182+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-02-17T13:26:15.734182+0000","last_clean_scrub_stamp":"2024-02-17T13:26:15.734182+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:38:07.360174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"26'26","reported_seq":73,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:02.772827+0000","last_change":"2024-02-17T13:26:02.772857+0000","last_active":"2024-02-17T13:26:02.772827+0000","last_peered":"2024-02-17T13:26:02.772827+0000","last_clean":"2024-02-17T13:26:02.772827+0000","last_became_active":"2024-02-17T12:57:57.721463+0000","last_became_peered":"2024-02-17T12:57:57.721463+0000","last_unstale":"2024-02-17T13:26:02.772827+0000","last_undegraded":"2024-02-17T13:26:02.772827+0000","last_fullsized":"2024-02-17T13:26:02.772827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'26","last_scrub_stamp":"2024-02-17T13:26:02.772764+0000","last_deep_scrub":"26'26","last_deep_scrub_stamp":"2024-02-17T13:26:02.772764+0000","last_clean_scrub_stamp":"2024-02-17T13:26:02.772764+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:21:11.905962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'41","reported_seq":87,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:05.833282+0000","last_change":"2024-02-17T13:26:05.833304+0000","last_active":"2024-02-17T13:26:05.833282+0000","last_peered":"2024-02-17T13:26:05.833282+0000","last_clean":"2024-02-17T13:26:05.833282+0000","last_became_active":"2024-02-17T12:57:57.802789+0000","last_became_peered":"2024-02-17T12:57:57.802789+0000","last_unstale":"2024-02-17T13:26:05.833282+0000","last_undegraded":"2024-02-17T13:26:05.833282+0000","last_fullsized":"2024-02-17T13:26:05.833282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'41","last_scrub_stamp":"2024-02-17T13:26:05.833216+0000","last_deep_scrub":"26'41","last_deep_scrub_stamp":"2024-02-17T13:26:05.833216+0000","last_clean_scrub_stamp":"2024-02-17T13:26:05.833216+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:50.302782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"26'36","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:03.799165+0000","last_change":"2024-02-17T13:26:03.799191+0000","last_active":"2024-02-17T13:26:03.799165+0000","last_peered":"2024-02-17T13:26:03.799165+0000","last_clean":"2024-02-17T13:26:03.799165+0000","last_became_active":"2024-02-17T12:57:57.802093+0000","last_became_peered":"2024-02-17T12:57:57.802093+0000","last_unstale":"2024-02-17T13:26:03.799165+0000","last_undegraded":"2024-02-17T13:26:03.799165+0000","last_fullsized":"2024-02-17T13:26:03.799165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-02-17T13:26:03.799091+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-02-17T13:26:03.799091+0000","last_clean_scrub_stamp":"2024-02-17T13:26:03.799091+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:55:43.620054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"26'26","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-17T13:26:13.776978+0000","last_change":"2024-02-17T13:26:13.777017+0000","last_active":"2024-02-17T13:26:13.776978+0000","last_peered":"2024-02-17T13:26:13.776978+0000","last_clean":"2024-02-17T13:26:13.776978+0000","last_became_active":"2024-02-17T12:57:57.795726+0000","last_became_peered":"2024-02-17T12:57:57.795726+0000","last_unstale":"2024-02-17T13:26:13.776978+0000","last_undegraded":"2024-02-17T13:26:13.776978+0000","last_fullsized":"2024-02-17T13:26:13.776978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'26","last_scrub_stamp":"2024-02-17T13:26:13.776875+0000","last_deep_scrub":"26'26","last_deep_scrub_stamp":"2024-02-17T13:26:13.776875+0000","last_clean_scrub_stamp":"2024-02-17T13:26:13.776875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:16.604144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3911,"num_write_kb":306687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4416,"ondisk_log_size":4416,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39077972,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":904,"num_read_kb":967,"num_write":11090,"num_write_kb":44057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78405632,"data_stored":78155944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9235,"ondisk_log_size":9235,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575201,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63244,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308596,"statfs":{"total":96636764160,"available":96572002304,"internally_reserved":0,"allocated":5836800,"data_stored":5629759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.23200000000000001},"max":{"1min":0.55900000000000005,"5min":0.65000000000000002,"15min":0.71199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":0.59299999999999997,"5min":0.64400000000000002,"15min":0.749},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.30399999999999999},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.72999999999999998},"last":0.505},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32400000000000001},"max":{"1min":0.623,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.624}]},{"osd":3,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.309},"max":{"1min":0.52800000000000002,"5min":0.69599999999999995,"15min":0.73599999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.29999999999999999},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45300000000000001,"15min":0.47099999999999997},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.223},"max":{"1min":0.63600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.79400000000000004},"last":0.38800000000000001}]},{"osd":5,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76300000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.27000000000000002},"max":{"1min":0.70199999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41899999999999998}]},{"osd":6,"last update":"Sat Feb 17 13:25:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53400000000000003,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81599999999999995,"5min":0.90200000000000002,"15min":0.92800000000000005},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575201,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":4388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":4493312,"data_stored":4311853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28799999999999998,"15min":0.217},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.68300000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65500000000000003,"5min":0.67800000000000005,"15min":0.75700000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.46000000000000002},"min":{"1min":0.34599999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61699999999999999,"5min":0.64300000000000002,"15min":0.70899999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.80000000000000004},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.497,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.63200000000000001,"5min":0.71899999999999997,"15min":0.72099999999999997},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.29599999999999999,"15min":0.27500000000000002},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.49299999999999999,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.27400000000000002},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.81299999999999994},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.48199999999999998},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.20999999999999999},"max":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.77300000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.5}]},{"osd":5,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.28799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.86199999999999999,"15min":0.93400000000000005},"last":0.628},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.23599999999999999},"max":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.84199999999999997},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Feb 17 13:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75900000000000001,"5min":0.78800000000000003,"15min":0.878},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.27100000000000002},"max":{"1min":0.68100000000000005,"5min":0.80800000000000005,"15min":0.94899999999999995},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575200,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70916,"kb_used_data":13372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300924,"statfs":{"total":96636764160,"available":96564146176,"internally_reserved":0,"allocated":13692928,"data_stored":13498704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57199999999999995,"5min":0.69899999999999995,"15min":0.75600000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59499999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.78100000000000003},"last":0.628},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.751},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.28799999999999998},"max":{"1min":0.61799999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.40899999999999997,"5min":0.28999999999999998,"15min":0.28199999999999997},"max":{"1min":0.67200000000000004,"5min":0.73299999999999998,"15min":0.75600000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.81499999999999995},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27300000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.79700000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71699999999999997,"5min":0.79600000000000004,"15min":0.79900000000000004},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.872},"last":0.442},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.45900000000000002}]},{"osd":7,"last update":"Sat Feb 17 13:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.50700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575200,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53580,"kb_used_data":8516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318260,"statfs":{"total":96636764160,"available":96581898240,"internally_reserved":0,"allocated":8720384,"data_stored":8505123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.26500000000000001,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.437,"15min":0.45800000000000002},"min":{"1min":0.33200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.70999999999999996}]},{"osd":1,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.30299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.745},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.48199999999999998},"min":{"1min":0.35199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69699999999999995,"5min":0.70799999999999996,"15min":0.71899999999999997},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.77900000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.40799999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69099999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.625,"5min":0.76200000000000001,"15min":0.82199999999999995},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.443,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64400000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.47699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64100000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40699999999999997}]},{"osd":6,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.25900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.66000000000000003,"5min":0.76800000000000002,"15min":0.872},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.505,"15min":0.52800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.67300000000000004,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.55800000000000005}]},{"osd":7,"last update":"Sat Feb 17 13:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48099999999999998,"15min":0.501},"min":{"1min":0.308,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.626,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.52000000000000002,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67400000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.49199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575201,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61764,"kb_used_data":16700,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310076,"statfs":{"total":96636764160,"available":96573517824,"internally_reserved":0,"allocated":17100800,"data_stored":16894525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.30299999999999999},"min":{"1min":0.183,"5min":0.182,"15min":0.182},"max":{"1min":0.434,"5min":0.51600000000000001,"15min":0.53100000000000003},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.314,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.21099999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.19400000000000001},"max":{"1min":0.435,"5min":0.52000000000000002,"15min":0.57499999999999996},"last":0.224},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.52700000000000002,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.46600000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.55000000000000004,"5min":0.626,"15min":0.64600000000000002},"last":0.312}]},{"osd":4,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.34100000000000003,"15min":0.32100000000000001},"max":{"1min":0.60299999999999998,"5min":0.70499999999999996,"15min":0.79100000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":0.751,"15min":0.77000000000000002},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.503,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.42999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66600000000000004,"5min":0.80900000000000005,"15min":0.85599999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.35099999999999998,"15min":0.34499999999999997},"max":{"1min":0.62,"5min":0.754,"15min":0.82499999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35599999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.47699999999999998}]},{"osd":7,"last update":"Sat Feb 17 13:26:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36099999999999999},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.79300000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":0.76300000000000001,"5min":0.88,"15min":0.88},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575201,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8503353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.29999999999999999,"15min":0.307},"min":{"1min":0.193,"5min":0.187,"15min":0.186},"max":{"1min":0.495,"5min":0.59599999999999997,"15min":0.82899999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.19800000000000001},"max":{"1min":0.50900000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34300000000000003,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.45700000000000002,"5min":0.54000000000000004,"15min":0.94299999999999995},"last":0.316},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.34100000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":0.443,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.379}]},{"osd":3,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"min":{"1min":0.26100000000000001,"5min":0.23400000000000001,"15min":0.22},"max":{"1min":0.48099999999999998,"5min":0.48599999999999999,"15min":0.54100000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.254},"max":{"1min":0.53000000000000003,"5min":0.60599999999999998,"15min":1.02},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.29199999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":1.577},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.36699999999999999,"5min":0.307,"15min":0.30099999999999999},"max":{"1min":0.78200000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.86399999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72399999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.53700000000000003},"min":{"1min":0.378,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.80700000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":1.177},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":0.80200000000000005,"15min":0.82399999999999995},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.75700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575200,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48560,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323280,"statfs":{"total":96636764160,"available":96587038720,"internally_reserved":0,"allocated":9281536,"data_stored":9094395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30499999999999999},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.69299999999999995},"last":0.311},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.316,"15min":0.32500000000000001},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.40699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32100000000000001,"15min":0.311},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.504,"5min":0.622,"15min":0.622},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.56599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.378,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.60799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.27500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.50900000000000001,"15min":0.81699999999999995},"last":0.34699999999999998}]},{"osd":4,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.32200000000000001},"max":{"1min":0.73499999999999999,"5min":0.87,"15min":0.87},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.90700000000000003},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35699999999999998},"max":{"1min":0.63600000000000001,"5min":0.80800000000000005,"15min":0.81399999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Feb 17 13:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.496},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66400000000000003,"5min":0.83199999999999996,"15min":0.84799999999999998},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834575200,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71228,"kb_used_data":13684,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300612,"statfs":{"total":96636764160,"available":96563826688,"internally_reserved":0,"allocated":14012416,"data_stored":13811008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.307,"15min":0.29899999999999999},"min":{"1min":0.27700000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.52900000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.33500000000000002,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48699999999999999,"5min":0.55000000000000004,"15min":0.58399999999999996},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.219,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34699999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.624},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.214},"max":{"1min":0.47799999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39200000000000002,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.252},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.67200000000000004},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.77100000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.80000000000000004}]},{"osd":5,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41299999999999998,"5min":0.36299999999999999,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84699999999999998},"last":0.78400000000000003}]},{"osd":6,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.77200000000000002},"last":0.746},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55700000000000005,"15min":0.54600000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Feb 17 13:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54700000000000004,"15min":0.55000000000000004},"min":{"1min":0.45100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82099999999999995},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":13697003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":16780520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12820480,"data_stored":12794331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5558272,"data_stored":5515754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T13:26:47.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-17T13:26:47.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.234+0000 7fbf94fbc640 1 Processor -- start 2024-02-17T13:26:47.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.234+0000 7fbf94fbc640 1 -- start start 2024-02-17T13:26:47.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.235+0000 7fbf94fbc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbf900c77a0 0x7fbf900c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.235+0000 7fbf94fbc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151eb0 0x7fbf9015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.235+0000 7fbf94fbc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf900c7c40 con 0x7fbf90151ad0 2024-02-17T13:26:47.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.235+0000 7fbf94fbc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9006c190 con 0x7fbf900c77a0 2024-02-17T13:26:47.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.235+0000 7fbf94fbc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900668e0 con 0x7fbf90151eb0 2024-02-17T13:26:47.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.236+0000 7fbf8ed9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151eb0 0x7fbf9015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.236+0000 7fbf8e59c640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fbf90151ad0 0x7fbf90071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:53024/0 (socket says 172.21.15.136:53024) 2024-02-17T13:26:47.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.236+0000 7fbf8e59c640 1 -- 172.21.15.136:0/1137464271 learned_addr learned my addr 172.21.15.136:0/1137464271 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:47.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.236+0000 7fbf8dd9b640 1 --2- 172.21.15.136:0/1137464271 >> v2:172.21.15.136:3300/0 conn(0x7fbf900c77a0 0x7fbf900c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.238+0000 7fbf8dd9b640 1 -- 172.21.15.136:0/1137464271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151eb0 msgr2=0x7fbf9015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:47.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.238+0000 7fbf8dd9b640 1 --2- 172.21.15.136:0/1137464271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151eb0 0x7fbf9015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.238+0000 7fbf8dd9b640 1 -- 172.21.15.136:0/1137464271 >> v1:172.21.15.160:6789/0 conn(0x7fbf90151ad0 legacy=0x7fbf90071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.238+0000 7fbf8dd9b640 1 -- 172.21.15.136:0/1137464271 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf90066ba0 con 0x7fbf900c77a0 2024-02-17T13:26:47.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.240+0000 7fbf8dd9b640 1 --2- 172.21.15.136:0/1137464271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf900c7fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097a0 tx=0x7fbf8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1626a62f2e36b09b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:47.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.244+0000 7fbf8d59a640 1 -- 172.21.15.136:0/1137464271 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84031830 con 0x7fbf900c77a0 2024-02-17T13:26:47.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.244+0000 7fbf8d59a640 1 -- 172.21.15.136:0/1137464271 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84031990 con 0x7fbf900c77a0 2024-02-17T13:26:47.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.244+0000 7fbf8d59a640 1 -- 172.21.15.136:0/1137464271 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84031d20 con 0x7fbf900c77a0 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1137464271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 msgr2=0x7fbf900c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1137464271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf900c7fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097a0 tx=0x7fbf8402b8d0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1137464271 shutdown_connections 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1137464271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151eb0 0x7fbf9015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1137464271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf900c7fa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1137464271 >> 172.21.15.136:0/1137464271 conn(0x7fbf900c8680 msgr2=0x7fbf900c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1137464271 shutdown_connections 2024-02-17T13:26:47.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.245+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1137464271 wait complete. 2024-02-17T13:26:47.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.246+0000 7fbf94fbc640 1 Processor -- start 2024-02-17T13:26:47.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.246+0000 7fbf94fbc640 1 -- start start 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf94fbc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf90152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf94fbc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151ad0 0x7fbf90141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf94fbc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf90151eb0 0x7fbf90141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf94fbc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90153120 con 0x7fbf900c77a0 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf94fbc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf901f1b70 con 0x7fbf90151eb0 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf94fbc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf901f0f60 con 0x7fbf90151ad0 2024-02-17T13:26:47.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf8e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf90152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf8e59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf90152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48392/0 (socket says 172.21.15.136:48392) 2024-02-17T13:26:47.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.247+0000 7fbf8e59c640 1 -- 172.21.15.136:0/1422997935 learned_addr learned my addr 172.21.15.136:0/1422997935 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:47.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.248+0000 7fbf8dd9b640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151ad0 0x7fbf90141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.248+0000 7fbf8ed9d640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf90151eb0 0x7fbf90141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.251+0000 7fbf8e59c640 1 -- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151ad0 msgr2=0x7fbf90141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.251+0000 7fbf8e59c640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151ad0 0x7fbf90141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.251+0000 7fbf8e59c640 1 -- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf90151eb0 msgr2=0x7fbf90141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.251+0000 7fbf8e59c640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf90151eb0 0x7fbf90141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.251+0000 7fbf8e59c640 1 -- 172.21.15.136:0/1422997935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009400 con 0x7fbf900c77a0 2024-02-17T13:26:47.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.254+0000 7fbf8e59c640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf90152520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000cb10 tx=0x7fbf8000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.257+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000ac70 con 0x7fbf900c77a0 2024-02-17T13:26:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.257+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000add0 con 0x7fbf900c77a0 2024-02-17T13:26:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.257+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80012620 con 0x7fbf900c77a0 2024-02-17T13:26:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.257+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf901f1240 con 0x7fbf900c77a0 2024-02-17T13:26:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.257+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf901f1800 con 0x7fbf900c77a0 2024-02-17T13:26:47.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.258+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf901553e0 con 0x7fbf900c77a0 2024-02-17T13:26:47.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.506+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbf80007070 con 0x7fbf900c77a0 2024-02-17T13:26:47.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.507+0000 7fbf7effd640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbf7006b840 0x7fbf7006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.506 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.507+0000 7fbf8dd9b640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbf7006b840 0x7fbf7006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.507 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.507+0000 7fbf8dd9b640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbf7006b840 0x7fbf7006dd00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf84036000 tx=0x7fbf8403c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:47.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.521+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fbf80058db0 con 0x7fbf900c77a0 2024-02-17T13:26:47.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.521+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf80055050 con 0x7fbf900c77a0 2024-02-17T13:26:47.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.701+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbf9004efc0 con 0x7fbf900c77a0 2024-02-17T13:26:47.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.800+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbf800170c0 con 0x7fbf900c77a0 2024-02-17T13:26:47.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.800+0000 7fbf7effd640 1 -- 172.21.15.136:0/1422997935 <== mon.0 v2:172.21.15.136:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf80055070 con 0x7fbf900c77a0 2024-02-17T13:26:47.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbf7006b840 msgr2=0x7fbf7006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbf7006b840 0x7fbf7006dd00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf84036000 tx=0x7fbf8403c040 comp rx=0 tx=0).stop 2024-02-17T13:26:47.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 msgr2=0x7fbf90152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf90152520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000cb10 tx=0x7fbf8000a060 comp rx=0 tx=0).stop 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 shutdown_connections 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fbf7006b840 0x7fbf7006dd00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf90151eb0 0x7fbf90141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf90151ad0 0x7fbf90141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 --2- 172.21.15.136:0/1422997935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbf900c77a0 0x7fbf90152520 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 >> 172.21.15.136:0/1422997935 conn(0x7fbf900c8680 msgr2=0x7fbf900cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 shutdown_connections 2024-02-17T13:26:47.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.803+0000 7fbf94fbc640 1 -- 172.21.15.136:0/1422997935 wait complete. 2024-02-17T13:26:47.814 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T13:26:47.814 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T13:26:47.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 Processor -- start 2024-02-17T13:26:47.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 -- start start 2024-02-17T13:26:47.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc578151ad0 0x7fc5780c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc5780c77a0 0x7fc578071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc578151eb0 0x7fc578071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57806c190 con 0x7fc578151ad0 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5780c7c40 con 0x7fc5780c77a0 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.926+0000 7fc57dd9a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780668e0 con 0x7fc578151eb0 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.927+0000 7fc5777fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc578151ad0 0x7fc5780c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.927+0000 7fc577fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc578151eb0 0x7fc578071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.927+0000 7fc5777fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc578151ad0 0x7fc5780c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48404/0 (socket says 172.21.15.136:48404) 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.927+0000 7fc5777fe640 1 -- 172.21.15.136:0/3312332588 learned_addr learned my addr 172.21.15.136:0/3312332588 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:47.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.927+0000 7fc576ffd640 1 --2- 172.21.15.136:0/3312332588 >> v2:172.21.15.160:3300/0 conn(0x7fc5780c77a0 0x7fc578071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.930+0000 7fc5777fe640 1 -- 172.21.15.136:0/3312332588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc578151eb0 msgr2=0x7fc578071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:47.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.930+0000 7fc5777fe640 1 --2- 172.21.15.136:0/3312332588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc578151eb0 0x7fc578071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.930+0000 7fc5777fe640 1 -- 172.21.15.136:0/3312332588 >> v2:172.21.15.160:3300/0 conn(0x7fc5780c77a0 msgr2=0x7fc578071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:47.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.930+0000 7fc5777fe640 1 --2- 172.21.15.136:0/3312332588 >> v2:172.21.15.160:3300/0 conn(0x7fc5780c77a0 0x7fc578071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.930+0000 7fc5777fe640 1 -- 172.21.15.136:0/3312332588 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578066ba0 con 0x7fc578151ad0 2024-02-17T13:26:47.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.931+0000 7fc5777fe640 1 --2- 172.21.15.136:0/3312332588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151ad0 0x7fc5780c7fa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc5780c53b0 tx=0x7fc56c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43ce1eb41389d3d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:47.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.934+0000 7fc5767fc640 1 -- 172.21.15.136:0/3312332588 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c031870 con 0x7fc578151ad0 2024-02-17T13:26:47.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.935+0000 7fc5767fc640 1 -- 172.21.15.136:0/3312332588 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc56c0319d0 con 0x7fc578151ad0 2024-02-17T13:26:47.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.935+0000 7fc5767fc640 1 -- 172.21.15.136:0/3312332588 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c031d80 con 0x7fc578151ad0 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 -- 172.21.15.136:0/3312332588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151ad0 msgr2=0x7fc5780c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/3312332588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151ad0 0x7fc5780c7fa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc5780c53b0 tx=0x7fc56c02b910 comp rx=0 tx=0).stop 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 -- 172.21.15.136:0/3312332588 shutdown_connections 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/3312332588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc578151eb0 0x7fc578071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/3312332588 >> v2:172.21.15.160:3300/0 conn(0x7fc5780c77a0 0x7fc578071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/3312332588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151ad0 0x7fc5780c7fa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 -- 172.21.15.136:0/3312332588 >> 172.21.15.136:0/3312332588 conn(0x7fc5780c8680 msgr2=0x7fc5780c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:47.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 -- 172.21.15.136:0/3312332588 shutdown_connections 2024-02-17T13:26:47.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.936+0000 7fc57dd9a640 1 -- 172.21.15.136:0/3312332588 wait complete. 2024-02-17T13:26:47.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.937+0000 7fc57dd9a640 1 Processor -- start 2024-02-17T13:26:47.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.937+0000 7fc57dd9a640 1 -- start start 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.938+0000 7fc57dd9a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5780c77a0 0x7fc5781f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.938+0000 7fc57dd9a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc578151ad0 0x7fc5780c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.938+0000 7fc57dd9a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 0x7fc5781e2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.938+0000 7fc57dd9a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57814d710 con 0x7fc578151eb0 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.938+0000 7fc57dd9a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57814c1d0 con 0x7fc578151ad0 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.938+0000 7fc57dd9a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781f1b50 con 0x7fc5780c77a0 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.939+0000 7fc577fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 0x7fc5781e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.939+0000 7fc576ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc578151ad0 0x7fc5780c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.939+0000 7fc577fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 0x7fc5781e2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48416/0 (socket says 172.21.15.136:48416) 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.939+0000 7fc577fff640 1 -- 172.21.15.136:0/83254556 learned_addr learned my addr 172.21.15.136:0/83254556 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:47.939 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.939+0000 7fc5777fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5780c77a0 0x7fc5781f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:47.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.942+0000 7fc577fff640 1 -- 172.21.15.136:0/83254556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5780c77a0 msgr2=0x7fc5781f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.942+0000 7fc577fff640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5780c77a0 0x7fc5781f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.942+0000 7fc577fff640 1 -- 172.21.15.136:0/83254556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc578151ad0 msgr2=0x7fc5780c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:47.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.942+0000 7fc577fff640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc578151ad0 0x7fc5780c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:47.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.942+0000 7fc577fff640 1 -- 172.21.15.136:0/83254556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0094d0 con 0x7fc578151eb0 2024-02-17T13:26:47.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.945+0000 7fc577fff640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 0x7fc5781e2060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc570009d30 tx=0x7fc57000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:47.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.948+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570009ba0 con 0x7fc578151eb0 2024-02-17T13:26:47.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.948+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc57000f040 con 0x7fc578151eb0 2024-02-17T13:26:47.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.948+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57814d430 con 0x7fc578151eb0 2024-02-17T13:26:47.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.948+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700146e0 con 0x7fc578151eb0 2024-02-17T13:26:47.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.948+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57814bb80 con 0x7fc578151eb0 2024-02-17T13:26:47.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:47.949+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc578071ff0 con 0x7fc578151eb0 2024-02-17T13:26:48.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.194+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc570014840 con 0x7fc578151eb0 2024-02-17T13:26:48.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.195+0000 7fc55ffff640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc56406b860 0x7fc56406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.195+0000 7fc5777fe640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc56406b860 0x7fc56406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.195+0000 7fc5777fe640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc56406b860 0x7fc56406dd20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc56c036000 tx=0x7fc56c03c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:48.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.209+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fc570059be0 con 0x7fc578151eb0 2024-02-17T13:26:48.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.209+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc570055e80 con 0x7fc578151eb0 2024-02-17T13:26:48.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.434+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc57806bad0 con 0x7fc578151eb0 2024-02-17T13:26:48.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.448+0000 7fc55ffff640 1 -- 172.21.15.136:0/83254556 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6599 (secure 0 0 0) 0x7fc57005ae60 con 0x7fc578151eb0 2024-02-17T13:26:48.448 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:26:48.448 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:37.333637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4288,"mds_2":4248,"mds_3":4245,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4245":{"gid":4245,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4248":{"gid":4248,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T13:26:48.449 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 18 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc56406b860 msgr2=0x7fc56406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc56406b860 0x7fc56406dd20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc56c036000 tx=0x7fc56c03c040 comp rx=0 tx=0).stop 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 msgr2=0x7fc5781e2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 0x7fc5781e2060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc570009d30 tx=0x7fc57000c490 comp rx=0 tx=0).stop 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 shutdown_connections 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fc56406b860 0x7fc56406dd20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc578151eb0 0x7fc5781e2060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc578151ad0 0x7fc5780c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 --2- 172.21.15.136:0/83254556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5780c77a0 0x7fc5781f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 >> 172.21.15.136:0/83254556 conn(0x7fc5780c8680 msgr2=0x7fc578155830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:48.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 shutdown_connections 2024-02-17T13:26:48.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.451+0000 7fc57dd9a640 1 -- 172.21.15.136:0/83254556 wait complete. 2024-02-17T13:26:48.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T13:26:48.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.563+0000 7f130ce1b640 1 Processor -- start 2024-02-17T13:26:48.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.563+0000 7f130ce1b640 1 -- start start 2024-02-17T13:26:48.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.564+0000 7f130ce1b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1308150b50 0x7f13080726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.564+0000 7f130ce1b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13080ca090 0x7f13081573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.564+0000 7f130ce1b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13080c51b0 0x7f13080c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.564+0000 7f130ce1b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1308157920 con 0x7f13080ca090 2024-02-17T13:26:48.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.564+0000 7f130ce1b640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080c3690 con 0x7f13080c51b0 2024-02-17T13:26:48.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.564+0000 7f130ce1b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1308159f50 con 0x7f1308150b50 2024-02-17T13:26:48.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.565+0000 7f1305d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13080ca090 0x7f13081573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.565+0000 7f1305d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13080ca090 0x7f13081573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48428/0 (socket says 172.21.15.136:48428) 2024-02-17T13:26:48.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.565+0000 7f1305d9b640 1 -- 172.21.15.136:0/3187648739 learned_addr learned my addr 172.21.15.136:0/3187648739 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:48.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.565+0000 7f1306d9d640 1 --2- 172.21.15.136:0/3187648739 >> v2:172.21.15.160:3300/0 conn(0x7f13080c51b0 0x7f13080c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.565+0000 7f130659c640 1 --2- 172.21.15.136:0/3187648739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1308150b50 0x7f13080726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.567+0000 7f1305d9b640 1 -- 172.21.15.136:0/3187648739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1308150b50 msgr2=0x7f13080726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:48.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.567+0000 7f1305d9b640 1 --2- 172.21.15.136:0/3187648739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1308150b50 0x7f13080726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.567+0000 7f1305d9b640 1 -- 172.21.15.136:0/3187648739 >> v2:172.21.15.160:3300/0 conn(0x7f13080c51b0 msgr2=0x7f13080c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:48.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.567+0000 7f1305d9b640 1 --2- 172.21.15.136:0/3187648739 >> v2:172.21.15.160:3300/0 conn(0x7f13080c51b0 0x7f13080c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.567+0000 7f1305d9b640 1 -- 172.21.15.136:0/3187648739 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080c38e0 con 0x7f13080ca090 2024-02-17T13:26:48.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.569+0000 7f1305d9b640 1 --2- 172.21.15.136:0/3187648739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13080ca090 0x7f13081573e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1308071b80 tx=0x7f12f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a44a77ab9900ca server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:48.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.573+0000 7f130559a640 1 -- 172.21.15.136:0/3187648739 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0031870 con 0x7f13080ca090 2024-02-17T13:26:48.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.573+0000 7f130559a640 1 -- 172.21.15.136:0/3187648739 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f12f00319d0 con 0x7f13080ca090 2024-02-17T13:26:48.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.573+0000 7f130559a640 1 -- 172.21.15.136:0/3187648739 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0031d80 con 0x7f13080ca090 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 -- 172.21.15.136:0/3187648739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13080ca090 msgr2=0x7f13081573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 --2- 172.21.15.136:0/3187648739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13080ca090 0x7f13081573e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1308071b80 tx=0x7f12f002b910 comp rx=0 tx=0).stop 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 -- 172.21.15.136:0/3187648739 shutdown_connections 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 --2- 172.21.15.136:0/3187648739 >> v2:172.21.15.160:3300/0 conn(0x7f13080c51b0 0x7f13080c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 --2- 172.21.15.136:0/3187648739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13080ca090 0x7f13081573e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 --2- 172.21.15.136:0/3187648739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1308150b50 0x7f13080726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 -- 172.21.15.136:0/3187648739 >> 172.21.15.136:0/3187648739 conn(0x7f130806bbd0 msgr2=0x7f130806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 -- 172.21.15.136:0/3187648739 shutdown_connections 2024-02-17T13:26:48.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.574+0000 7f130ce1b640 1 -- 172.21.15.136:0/3187648739 wait complete. 2024-02-17T13:26:48.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.575+0000 7f130ce1b640 1 Processor -- start 2024-02-17T13:26:48.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 -- start start 2024-02-17T13:26:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13080c51b0 0x7f1308152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13080ca090 0x7f1308145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1308150b50 0x7f13080c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c8420 con 0x7f1308150b50 2024-02-17T13:26:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308146430 con 0x7f13080ca090 2024-02-17T13:26:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.576+0000 7f130ce1b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c95c0 con 0x7f13080c51b0 2024-02-17T13:26:48.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.577+0000 7f1306d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1308150b50 0x7f13080c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.577+0000 7f1305d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13080ca090 0x7f1308145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.577+0000 7f130659c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13080c51b0 0x7f1308152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.577+0000 7f1306d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1308150b50 0x7f13080c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48442/0 (socket says 172.21.15.136:48442) 2024-02-17T13:26:48.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.577+0000 7f1306d9d640 1 -- 172.21.15.136:0/2836420916 learned_addr learned my addr 172.21.15.136:0/2836420916 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:48.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.581+0000 7f1305d9b640 1 -- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13080c51b0 msgr2=0x7f1308152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:48.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.581+0000 7f1305d9b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13080c51b0 0x7f1308152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.581+0000 7f1305d9b640 1 -- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1308150b50 msgr2=0x7f13080c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:48.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.581+0000 7f1305d9b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1308150b50 0x7f13080c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:48.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.581+0000 7f1305d9b640 1 -- 172.21.15.136:0/2836420916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00094d0 con 0x7f13080ca090 2024-02-17T13:26:48.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.581+0000 7f130659c640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13080c51b0 0x7f1308152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T13:26:48.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.583+0000 7f1305d9b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13080ca090 0x7f1308145ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12f0033000 tx=0x7f12f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:48.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.587+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f003ac60 con 0x7f13080ca090 2024-02-17T13:26:48.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.588+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f12f003ade0 con 0x7f13080ca090 2024-02-17T13:26:48.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.588+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0044650 con 0x7f13080ca090 2024-02-17T13:26:48.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.588+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13081538d0 con 0x7f13080ca090 2024-02-17T13:26:48.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.588+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13081f1130 con 0x7f13080ca090 2024-02-17T13:26:48.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.589+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308072d70 con 0x7f13080ca090 2024-02-17T13:26:48.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.840+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f12f004d450 con 0x7f13080ca090 2024-02-17T13:26:48.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.840+0000 7f12feffd640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f12e806b860 0x7f12e806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:48.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.840+0000 7f130659c640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f12e806b860 0x7f12e806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:48.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.841+0000 7f130659c640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f12e806b860 0x7f12e806dd20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e740 tx=0x7f12f800b040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:48.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.843+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f12f002d040 con 0x7f13080ca090 2024-02-17T13:26:48.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:48.854+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f12f0077500 con 0x7f13080ca090 2024-02-17T13:26:49.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.102+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1308067cb0 con 0x7f13080ca090 2024-02-17T13:26:49.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.124+0000 7f12feffd640 1 -- 172.21.15.136:0/2836420916 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6599 (secure 0 0 0) 0x7f12f0035090 con 0x7f13080ca090 2024-02-17T13:26:49.124 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:26:49.124 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1618476544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1618476544},{"type":"v1","addr":"172.21.15.136:6835","nonce":1618476544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:57:57.313077+0000","modified":"2024-02-17T12:58:37.333637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4288,"mds_2":4248,"mds_3":4245,"mds_4":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.160:6837/1130191707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1130191707},{"type":"v1","addr":"172.21.15.160:6837","nonce":1130191707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4245":{"gid":4245,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.160:6835/1618847363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1618847363},{"type":"v1","addr":"172.21.15.160:6835","nonce":1618847363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4248":{"gid":4248,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.136:6837/4146413895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":4146413895},{"type":"v1","addr":"172.21.15.136:6837","nonce":4146413895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6833/2957750090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2957750090},{"type":"v1","addr":"172.21.15.160:6833","nonce":2957750090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6839/2320874090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":2320874090},{"type":"v1","addr":"172.21.15.136:6839","nonce":2320874090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T13:26:49.124 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 18 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f12e806b860 msgr2=0x7f12e806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f12e806b860 0x7f12e806dd20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e740 tx=0x7f12f800b040 comp rx=0 tx=0).stop 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13080ca090 msgr2=0x7f1308145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13080ca090 0x7f1308145ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12f0033000 tx=0x7f12f00046c0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 shutdown_connections 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f12e806b860 0x7f12e806dd20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1308150b50 0x7f13080c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13080ca090 0x7f1308145ef0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 --2- 172.21.15.136:0/2836420916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13080c51b0 0x7f1308152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 >> 172.21.15.136:0/2836420916 conn(0x7f130806bbd0 msgr2=0x7f130814fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 shutdown_connections 2024-02-17T13:26:49.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.126+0000 7f130ce1b640 1 -- 172.21.15.136:0/2836420916 wait complete. 2024-02-17T13:26:49.137 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T13:26:49.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.239+0000 7f7a0fbf4640 1 Processor -- start 2024-02-17T13:26:49.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.239+0000 7f7a0fbf4640 1 -- start start 2024-02-17T13:26:49.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.240+0000 7f7a0fbf4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2640 0x7f7a080668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.240+0000 7f7a0fbf4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7a080c6cf0 0x7f7a080c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.240+0000 7f7a0fbf4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a080c6580 con 0x7f7a080c2a20 2024-02-17T13:26:49.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.240+0000 7f7a0fbf4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080c2e00 con 0x7f7a080c6cf0 2024-02-17T13:26:49.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.240+0000 7f7a0fbf4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080c6860 con 0x7f7a080c2640 2024-02-17T13:26:49.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.240+0000 7f7a0d990640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2640 0x7f7a080668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.241+0000 7f7a0e191640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7a080c6cf0 0x7f7a080c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.241+0000 7f7a0d18f640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f7a080c2a20 0x7f7a0806bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:33796/0 (socket says 172.21.15.136:33796) 2024-02-17T13:26:49.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.241+0000 7f7a0d18f640 1 -- 172.21.15.136:0/3622478536 learned_addr learned my addr 172.21.15.136:0/3622478536 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:49.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.243+0000 7f7a0d990640 1 -- 172.21.15.136:0/3622478536 >> v2:172.21.15.136:3300/0 conn(0x7f7a080c6cf0 msgr2=0x7f7a080c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:49.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.243+0000 7f7a0d990640 1 --2- 172.21.15.136:0/3622478536 >> v2:172.21.15.136:3300/0 conn(0x7f7a080c6cf0 0x7f7a080c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.243+0000 7f7a0d990640 1 -- 172.21.15.136:0/3622478536 >> v1:172.21.15.136:6789/0 conn(0x7f7a080c2a20 legacy=0x7f7a0806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.243+0000 7f7a0d990640 1 -- 172.21.15.136:0/3622478536 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080c76e0 con 0x7f7a080c2640 2024-02-17T13:26:49.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.245+0000 7f7a0d990640 1 --2- 172.21.15.136:0/3622478536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2640 0x7f7a080668e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097a0 tx=0x7f7a0402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47bbc25c50bc92c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:49.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.248+0000 7f7a0c98e640 1 -- 172.21.15.136:0/3622478536 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04031830 con 0x7f7a080c2640 2024-02-17T13:26:49.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.248+0000 7f7a0c98e640 1 -- 172.21.15.136:0/3622478536 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7a04031990 con 0x7f7a080c2640 2024-02-17T13:26:49.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.248+0000 7f7a0c98e640 1 -- 172.21.15.136:0/3622478536 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04031d40 con 0x7f7a080c2640 2024-02-17T13:26:49.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3622478536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2640 msgr2=0x7f7a080668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3622478536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2640 0x7f7a080668e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097a0 tx=0x7f7a0402b8d0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3622478536 shutdown_connections 2024-02-17T13:26:49.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3622478536 >> v2:172.21.15.136:3300/0 conn(0x7f7a080c6cf0 0x7f7a080c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3622478536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2640 0x7f7a080668e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3622478536 >> 172.21.15.136:0/3622478536 conn(0x7f7a080c8680 msgr2=0x7f7a080c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:49.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3622478536 shutdown_connections 2024-02-17T13:26:49.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.249+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3622478536 wait complete. 2024-02-17T13:26:49.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.250+0000 7f7a0fbf4640 1 Processor -- start 2024-02-17T13:26:49.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.250+0000 7f7a0fbf4640 1 -- start start 2024-02-17T13:26:49.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.251+0000 7f7a0fbf4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 0x7f7a081efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.251+0000 7f7a0fbf4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2a20 0x7f7a0814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.251+0000 7f7a0fbf4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a080c6cf0 0x7f7a08155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.251+0000 7f7a0fbf4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081f0360 con 0x7f7a080c2640 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.251+0000 7f7a0fbf4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081547e0 con 0x7f7a080c6cf0 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.251+0000 7f7a0fbf4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0806bf30 con 0x7f7a080c2a20 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.252+0000 7f7a0d990640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 0x7f7a081efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.252+0000 7f7a0d18f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2a20 0x7f7a0814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.252+0000 7f7a0e191640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a080c6cf0 0x7f7a08155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.252+0000 7f7a0d990640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 0x7f7a081efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48450/0 (socket says 172.21.15.136:48450) 2024-02-17T13:26:49.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.252+0000 7f7a0d990640 1 -- 172.21.15.136:0/3924873464 learned_addr learned my addr 172.21.15.136:0/3924873464 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:49.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.255+0000 7f7a0d990640 1 -- 172.21.15.136:0/3924873464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2a20 msgr2=0x7f7a0814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.255+0000 7f7a0d990640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2a20 0x7f7a0814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.255+0000 7f7a0d990640 1 -- 172.21.15.136:0/3924873464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a080c6cf0 msgr2=0x7f7a08155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.255+0000 7f7a0d990640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a080c6cf0 0x7f7a08155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.255+0000 7f7a0d990640 1 -- 172.21.15.136:0/3924873464 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009400 con 0x7f7a080c2640 2024-02-17T13:26:49.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.257+0000 7f7a0d990640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 0x7f7a081efe20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a04034040 tx=0x7f7a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:49.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.261+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0403a9e0 con 0x7f7a080c2640 2024-02-17T13:26:49.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.261+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7a0403ab60 con 0x7f7a080c2640 2024-02-17T13:26:49.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.261+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0806c210 con 0x7f7a080c2640 2024-02-17T13:26:49.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.261+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04044400 con 0x7f7a080c2640 2024-02-17T13:26:49.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.261+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a08154d10 con 0x7f7a080c2640 2024-02-17T13:26:49.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.262+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0804efc0 con 0x7f7a080c2640 2024-02-17T13:26:49.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.508+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7a0404d440 con 0x7f7a080c2640 2024-02-17T13:26:49.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.509+0000 7f79fe7fc640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f79ec06b890 0x7f79ec06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.509+0000 7f7a0d18f640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f79ec06b890 0x7f79ec06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.509+0000 7f7a0d18f640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f79ec06b890 0x7f79ec06dd50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7a080ca3f0 tx=0x7f79f8007e80 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:49.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.522+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7f7a0407b170 con 0x7f7a080c2640 2024-02-17T13:26:49.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.523+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a04077410 con 0x7f7a080c2640 2024-02-17T13:26:49.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.697+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a080c5ae0 con 0x7f7a080c2640 2024-02-17T13:26:49.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.736+0000 7f79fe7fc640 1 -- 172.21.15.136:0/3924873464 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f7a04035020 con 0x7f7a080c2640 2024-02-17T13:26:49.736 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-02-17T13:26:49.736 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"b14cc0e2-9a6d-442e-8d67-bc5380021b88","created":"2024-02-17T12:57:27.101121+0000","modified":"2024-02-17T12:58:36.410818+0000","last_up_change":"2024-02-17T12:57:41.157181+0000","last_in_change":"2024-02-17T12:57:32.352162+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:57:42.236617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:57:54.504936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:57:56.035257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T12:58:00.288619+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8f774ae8-2987-46e0-9b10-c2c14d5442c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6817","nonce":3029567503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6819","nonce":3029567503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6823","nonce":3029567503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3029567503},{"type":"v1","addr":"172.21.15.136:6821","nonce":3029567503}]},"public_addr":"172.21.15.136:6817/3029567503","cluster_addr":"172.21.15.136:6819/3029567503","heartbeat_back_addr":"172.21.15.136:6823/3029567503","heartbeat_front_addr":"172.21.15.136:6821/3029567503","state":["exists","up"]},{"osd":1,"uuid":"c3dbadd8-3f4d-43c1-a5fa-47b120dbd796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6801","nonce":2661143693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6803","nonce":2661143693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6807","nonce":2661143693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":2661143693},{"type":"v1","addr":"172.21.15.136:6805","nonce":2661143693}]},"public_addr":"172.21.15.136:6801/2661143693","cluster_addr":"172.21.15.136:6803/2661143693","heartbeat_back_addr":"172.21.15.136:6807/2661143693","heartbeat_front_addr":"172.21.15.136:6805/2661143693","state":["exists","up"]},{"osd":2,"uuid":"7ea6cb6c-a52f-45c2-ae7a-532098a3a115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6809","nonce":1843608595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6811","nonce":1843608595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6815","nonce":1843608595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1843608595},{"type":"v1","addr":"172.21.15.136:6813","nonce":1843608595}]},"public_addr":"172.21.15.136:6809/1843608595","cluster_addr":"172.21.15.136:6811/1843608595","heartbeat_back_addr":"172.21.15.136:6815/1843608595","heartbeat_front_addr":"172.21.15.136:6813/1843608595","state":["exists","up"]},{"osd":3,"uuid":"92e03913-22f0-4e92-9327-711ad4e7b29e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6825","nonce":918147356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6827","nonce":918147356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6831","nonce":918147356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":918147356},{"type":"v1","addr":"172.21.15.136:6829","nonce":918147356}]},"public_addr":"172.21.15.136:6825/918147356","cluster_addr":"172.21.15.136:6827/918147356","heartbeat_back_addr":"172.21.15.136:6831/918147356","heartbeat_front_addr":"172.21.15.136:6829/918147356","state":["exists","up"]},{"osd":4,"uuid":"602635ff-e07f-4b21-91d9-7cb4deb4393b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6801","nonce":2188049654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6803","nonce":2188049654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6807","nonce":2188049654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2188049654},{"type":"v1","addr":"172.21.15.160:6805","nonce":2188049654}]},"public_addr":"172.21.15.160:6801/2188049654","cluster_addr":"172.21.15.160:6803/2188049654","heartbeat_back_addr":"172.21.15.160:6807/2188049654","heartbeat_front_addr":"172.21.15.160:6805/2188049654","state":["exists","up"]},{"osd":5,"uuid":"efce6b38-3669-432d-ae70-f38d5454e2c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6809","nonce":2660831410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6811","nonce":2660831410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6817","nonce":2660831410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2660831410},{"type":"v1","addr":"172.21.15.160:6813","nonce":2660831410}]},"public_addr":"172.21.15.160:6809/2660831410","cluster_addr":"172.21.15.160:6811/2660831410","heartbeat_back_addr":"172.21.15.160:6817/2660831410","heartbeat_front_addr":"172.21.15.160:6813/2660831410","state":["exists","up"]},{"osd":6,"uuid":"ce087b9b-088a-4074-9d8c-789d3ef5f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6825","nonce":2024415336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6827","nonce":2024415336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6831","nonce":2024415336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2024415336},{"type":"v1","addr":"172.21.15.160:6829","nonce":2024415336}]},"public_addr":"172.21.15.160:6825/2024415336","cluster_addr":"172.21.15.160:6827/2024415336","heartbeat_back_addr":"172.21.15.160:6831/2024415336","heartbeat_front_addr":"172.21.15.160:6829/2024415336","state":["exists","up"]},{"osd":7,"uuid":"253c7272-6780-4f74-bf38-3df340c64b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6816","nonce":2434888201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6819","nonce":2434888201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6823","nonce":2434888201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2434888201},{"type":"v1","addr":"172.21.15.160:6821","nonce":2434888201}]},"public_addr":"172.21.15.160:6816/2434888201","cluster_addr":"172.21.15.160:6819/2434888201","heartbeat_back_addr":"172.21.15.160:6823/2434888201","heartbeat_front_addr":"172.21.15.160:6821/2434888201","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.592467+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.516432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.527652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.619149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.485018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.589938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.632957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:57:37.634389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T13:26:49.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f79ec06b890 msgr2=0x7f79ec06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f79ec06b890 0x7f79ec06dd50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7a080ca3f0 tx=0x7f79f8007e80 comp rx=0 tx=0).stop 2024-02-17T13:26:49.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 msgr2=0x7f7a081efe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 0x7f7a081efe20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a04034040 tx=0x7f7a040046c0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 shutdown_connections 2024-02-17T13:26:49.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f79ec06b890 0x7f79ec06dd50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a080c6cf0 0x7f7a08155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a080c2a20 0x7f7a0814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 --2- 172.21.15.136:0/3924873464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a080c2640 0x7f7a081efe20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 >> 172.21.15.136:0/3924873464 conn(0x7f7a080c8680 msgr2=0x7f7a080ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:49.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 shutdown_connections 2024-02-17T13:26:49.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.738+0000 7f7a0fbf4640 1 -- 172.21.15.136:0/3924873464 wait complete. 2024-02-17T13:26:49.750 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T13:26:49.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 Processor -- start 2024-02-17T13:26:49.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 -- start start 2024-02-17T13:26:49.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde5806bbd0 0x7fde58070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fde58070c60 0x7fde5815d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580c8e60 con 0x7fde58154250 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5806c010 con 0x7fde5806bbd0 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.852+0000 7fde5ef3e640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5806c260 con 0x7fde58070c60 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.853+0000 7fde57fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde5806bbd0 0x7fde58070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.853+0000 7fde57fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde5806bbd0 0x7fde58070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48466/0 (socket says 172.21.15.136:48466) 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.853+0000 7fde57fff640 1 -- 172.21.15.136:0/2104212912 learned_addr learned my addr 172.21.15.136:0/2104212912 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:49.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.853+0000 7fde5d4db640 1 --2- 172.21.15.136:0/2104212912 >> v2:172.21.15.160:3300/0 conn(0x7fde58070c60 0x7fde5815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.856+0000 7fde57fff640 1 -- 172.21.15.136:0/2104212912 >> v2:172.21.15.160:3300/0 conn(0x7fde58070c60 msgr2=0x7fde5815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:49.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.856+0000 7fde57fff640 1 --2- 172.21.15.136:0/2104212912 >> v2:172.21.15.160:3300/0 conn(0x7fde58070c60 0x7fde5815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.856+0000 7fde57fff640 1 -- 172.21.15.136:0/2104212912 >> v1:172.21.15.160:6789/0 conn(0x7fde58154250 legacy=0x7fde580c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.856+0000 7fde57fff640 1 -- 172.21.15.136:0/2104212912 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5806c540 con 0x7fde5806bbd0 2024-02-17T13:26:49.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.858+0000 7fde57fff640 1 --2- 172.21.15.136:0/2104212912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58070720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fde5806db10 tx=0x7fde4402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c36c13eace3101 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:49.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.861+0000 7fde577fe640 1 -- 172.21.15.136:0/2104212912 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4402f850 con 0x7fde5806bbd0 2024-02-17T13:26:49.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.861+0000 7fde577fe640 1 -- 172.21.15.136:0/2104212912 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde4402f9b0 con 0x7fde5806bbd0 2024-02-17T13:26:49.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.861+0000 7fde577fe640 1 -- 172.21.15.136:0/2104212912 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4402fd60 con 0x7fde5806bbd0 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 -- 172.21.15.136:0/2104212912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 msgr2=0x7fde58070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/2104212912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58070720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fde5806db10 tx=0x7fde4402ba30 comp rx=0 tx=0).stop 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 -- 172.21.15.136:0/2104212912 shutdown_connections 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/2104212912 >> v2:172.21.15.160:3300/0 conn(0x7fde58070c60 0x7fde5815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/2104212912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58070720 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 -- 172.21.15.136:0/2104212912 >> 172.21.15.136:0/2104212912 conn(0x7fde5806fe80 msgr2=0x7fde5806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 -- 172.21.15.136:0/2104212912 shutdown_connections 2024-02-17T13:26:49.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.862+0000 7fde5ef3e640 1 -- 172.21.15.136:0/2104212912 wait complete. 2024-02-17T13:26:49.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.863+0000 7fde5ef3e640 1 Processor -- start 2024-02-17T13:26:49.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.863+0000 7fde5ef3e640 1 -- start start 2024-02-17T13:26:49.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ef3e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ef3e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde58070c60 0x7fde58156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ef3e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde58154250 0x7fde58149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ef3e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580cd200 con 0x7fde5806bbd0 2024-02-17T13:26:49.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ef3e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580cbc00 con 0x7fde58070c60 2024-02-17T13:26:49.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ef3e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde581564c0 con 0x7fde58154250 2024-02-17T13:26:49.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.864+0000 7fde5ccda640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.865+0000 7fde5d4db640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde58154250 0x7fde58149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.865+0000 7fde5ccda640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48480/0 (socket says 172.21.15.136:48480) 2024-02-17T13:26:49.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.865+0000 7fde5ccda640 1 -- 172.21.15.136:0/3924523061 learned_addr learned my addr 172.21.15.136:0/3924523061 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:49.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.865+0000 7fde57fff640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde58070c60 0x7fde58156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.868+0000 7fde57fff640 1 -- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde58154250 msgr2=0x7fde58149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.868+0000 7fde57fff640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde58154250 0x7fde58149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.868+0000 7fde57fff640 1 -- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 msgr2=0x7fde58155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.868+0000 7fde57fff640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.868+0000 7fde57fff640 1 -- 172.21.15.136:0/3924523061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440094d0 con 0x7fde58070c60 2024-02-17T13:26:49.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.871+0000 7fde57fff640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde58070c60 0x7fde58156f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde44033000 tx=0x7fde44004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.874+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44037c40 con 0x7fde58070c60 2024-02-17T13:26:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.874+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde44037dc0 con 0x7fde58070c60 2024-02-17T13:26:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.874+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44041660 con 0x7fde58070c60 2024-02-17T13:26:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.874+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde581567a0 con 0x7fde58070c60 2024-02-17T13:26:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.874+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580cb5b0 con 0x7fde58070c60 2024-02-17T13:26:49.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.875+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58067e00 con 0x7fde58070c60 2024-02-17T13:26:49.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.894+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fde440417c0 con 0x7fde58070c60 2024-02-17T13:26:49.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.894+0000 7fde557fa640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fde3c06b810 0x7fde3c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:49.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.894+0000 7fde5ccda640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fde3c06b810 0x7fde3c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:49.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.895+0000 7fde5ccda640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fde3c06b810 0x7fde3c06dcd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0017a0 tx=0x7fde4c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:49.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:49.897+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6619+0+0 (secure 0 0 0) 0x7fde4403c070 con 0x7fde58070c60 2024-02-17T13:26:50.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.142+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde440784d0 con 0x7fde58070c60 2024-02-17T13:26:50.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.360+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fde580cbd40 con 0x7fde58070c60 2024-02-17T13:26:50.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.580+0000 7fde557fa640 1 -- 172.21.15.136:0/3924523061 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fde4407a400 con 0x7fde58070c60 2024-02-17T13:26:50.580 INFO:teuthology.orchestra.run.smithi136.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T13:26:50.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fde3c06b810 msgr2=0x7fde3c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fde3c06b810 0x7fde3c06dcd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0017a0 tx=0x7fde4c009040 comp rx=0 tx=0).stop 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde58070c60 msgr2=0x7fde58156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde58070c60 0x7fde58156f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde44033000 tx=0x7fde44004730 comp rx=0 tx=0).stop 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 shutdown_connections 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fde3c06b810 0x7fde3c06dcd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde58154250 0x7fde58149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde58070c60 0x7fde58156f80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 --2- 172.21.15.136:0/3924523061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde5806bbd0 0x7fde58155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 >> 172.21.15.136:0/3924523061 conn(0x7fde5806fe80 msgr2=0x7fde581595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 shutdown_connections 2024-02-17T13:26:50.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.582+0000 7fde5ef3e640 1 -- 172.21.15.136:0/3924523061 wait complete. 2024-02-17T13:26:50.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T13:26:50.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.701+0000 7f2422943640 1 Processor -- start 2024-02-17T13:26:50.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.701+0000 7f2422943640 1 -- start start 2024-02-17T13:26:50.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.702+0000 7f2422943640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f241c0ca4e0 0x7f241c0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:50.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.702+0000 7f2422943640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c06b3e0 con 0x7f241c0cbc00 2024-02-17T13:26:50.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.702+0000 7f2422943640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0cb470 con 0x7f241c0cc520 2024-02-17T13:26:50.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.702+0000 7f2422943640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0cc940 con 0x7f241c0ca4e0 2024-02-17T13:26:50.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.703+0000 7f2420ee0640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f241c0cc520 0x7f241c1644e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:53052/0 (socket says 172.21.15.136:53052) 2024-02-17T13:26:50.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.703+0000 7f2420ee0640 1 -- 172.21.15.136:0/2041594384 learned_addr learned my addr 172.21.15.136:0/2041594384 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:50.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.703+0000 7f241b7fe640 1 --2- 172.21.15.136:0/2041594384 >> v2:172.21.15.136:3300/0 conn(0x7f241c0ca4e0 0x7f241c0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:50.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.706+0000 7f241b7fe640 1 -- 172.21.15.136:0/2041594384 >> v1:172.21.15.160:6789/0 conn(0x7f241c0cc520 legacy=0x7f241c1644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.706+0000 7f241b7fe640 1 -- 172.21.15.136:0/2041594384 >> v1:172.21.15.136:6789/0 conn(0x7f241c0cbc00 legacy=0x7f241c06acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.706+0000 7f241b7fe640 1 -- 172.21.15.136:0/2041594384 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0cb750 con 0x7f241c0ca4e0 2024-02-17T13:26:50.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.710+0000 7f241b7fe640 1 --2- 172.21.15.136:0/2041594384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0ca4e0 0x7f241c0cbfe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2410009790 tx=0x7f241002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c716ccf8377d8464 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:50.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.713+0000 7f241affd640 1 -- 172.21.15.136:0/2041594384 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410030610 con 0x7f241c0ca4e0 2024-02-17T13:26:50.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.715+0000 7f241affd640 1 -- 172.21.15.136:0/2041594384 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2410030770 con 0x7f241c0ca4e0 2024-02-17T13:26:50.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.715+0000 7f241affd640 1 -- 172.21.15.136:0/2041594384 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410030b20 con 0x7f241c0ca4e0 2024-02-17T13:26:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 -- 172.21.15.136:0/2041594384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0ca4e0 msgr2=0x7f241c0cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 --2- 172.21.15.136:0/2041594384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0ca4e0 0x7f241c0cbfe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2410009790 tx=0x7f241002b960 comp rx=0 tx=0).stop 2024-02-17T13:26:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 -- 172.21.15.136:0/2041594384 shutdown_connections 2024-02-17T13:26:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 --2- 172.21.15.136:0/2041594384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0ca4e0 0x7f241c0cbfe0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 -- 172.21.15.136:0/2041594384 >> 172.21.15.136:0/2041594384 conn(0x7f241c0721f0 msgr2=0x7f241c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:50.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 -- 172.21.15.136:0/2041594384 shutdown_connections 2024-02-17T13:26:50.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.716+0000 7f2422943640 1 -- 172.21.15.136:0/2041594384 wait complete. 2024-02-17T13:26:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.718+0000 7f2422943640 1 Processor -- start 2024-02-17T13:26:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.718+0000 7f2422943640 1 -- start start 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2422943640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f241c0ca4e0 0x7f241c1e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2422943640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 0x7f241c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2422943640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f241c0cc520 0x7f241c0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2422943640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0c5ed0 con 0x7f241c0cbc00 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2422943640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0c35a0 con 0x7f241c0cc520 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2422943640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0c5670 con 0x7f241c0ca4e0 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f241b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 0x7f241c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f2420ee0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f241c0cc520 0x7f241c0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f241b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 0x7f241c0c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:48502/0 (socket says 172.21.15.136:48502) 2024-02-17T13:26:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f241bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f241c0ca4e0 0x7f241c1e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.720+0000 7f241b7fe640 1 -- 172.21.15.136:0/2752167086 learned_addr learned my addr 172.21.15.136:0/2752167086 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:50.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.724+0000 7f241b7fe640 1 -- 172.21.15.136:0/2752167086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f241c0ca4e0 msgr2=0x7f241c1e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.724+0000 7f241b7fe640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f241c0ca4e0 0x7f241c1e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.724+0000 7f241b7fe640 1 -- 172.21.15.136:0/2752167086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f241c0cc520 msgr2=0x7f241c0c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.724+0000 7f241b7fe640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f241c0cc520 0x7f241c0c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.724+0000 7f241b7fe640 1 -- 172.21.15.136:0/2752167086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100093a0 con 0x7f241c0cbc00 2024-02-17T13:26:50.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.726+0000 7f241b7fe640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 0x7f241c0c3fb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24100098b0 tx=0x7f2410004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.730+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241003e040 con 0x7f241c0cbc00 2024-02-17T13:26:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.730+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2410039c90 con 0x7f241c0cbc00 2024-02-17T13:26:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.730+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c0c5910 con 0x7f241c0cbc00 2024-02-17T13:26:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.730+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410005990 con 0x7f241c0cbc00 2024-02-17T13:26:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.730+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c0c37b0 con 0x7f241c0cbc00 2024-02-17T13:26:50.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.731+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c0c2d30 con 0x7f241c0cbc00 2024-02-17T13:26:50.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.751+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f241004d450 con 0x7f241c0cbc00 2024-02-17T13:26:50.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.751+0000 7f2418ff9640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f240806b860 0x7f240806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:50.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.752+0000 7f241bfff640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f240806b860 0x7f240806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:50.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.752+0000 7f241bfff640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f240806b860 0x7f240806dd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f240c001780 tx=0x7f240c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:50.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.754+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7049+0+0 (secure 0 0 0) 0x7f241007b2d0 con 0x7f241c0cbc00 2024-02-17T13:26:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:50.999+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f24100d88c0 con 0x7f241c0cbc00 2024-02-17T13:26:51.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:51.261+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f241c04efc0 con 0x7f241c0cbc00 2024-02-17T13:26:51.602 INFO:tasks.ceph.mds.f.smithi160.stderr:==00:00:29:09.754 43723== 2024-02-17T13:26:51.603 INFO:tasks.ceph.mds.f.smithi160.stderr:==00:00:29:09.754 43723== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:26:51.611 INFO:tasks.ceph.mds.c.smithi136.stderr:==00:00:29:09.772 43242== 2024-02-17T13:26:51.611 INFO:tasks.ceph.mds.c.smithi136.stderr:==00:00:29:09.772 43242== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:26:51.654 INFO:tasks.ceph.mds.d.smithi160.stderr:==00:00:29:09.810 43722== 2024-02-17T13:26:51.655 INFO:tasks.ceph.mds.d.smithi160.stderr:==00:00:29:09.810 43722== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:26:51.655 INFO:tasks.ceph.mds.f.smithi160.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:26:51.680 INFO:tasks.ceph.mds.b.smithi160.stderr:==00:00:29:09.836 43721== 2024-02-17T13:26:51.681 INFO:tasks.ceph.mds.b.smithi160.stderr:==00:00:29:09.836 43721== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:26:51.715 INFO:tasks.ceph.mds.a.smithi136.stderr:==00:00:29:09.876 43241== 2024-02-17T13:26:51.715 INFO:tasks.ceph.mds.a.smithi136.stderr:==00:00:29:09.876 43241== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:26:51.757 INFO:tasks.ceph.mds.a.smithi136.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:26:51.757 INFO:tasks.ceph.mds.c.smithi136.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:26:51.855 INFO:tasks.ceph.mds.b.smithi160.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:26:51.856 INFO:tasks.ceph.mds.d.smithi160.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:26:52.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.403+0000 7f2418ff9640 1 -- 172.21.15.136:0/2752167086 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2410034020 con 0x7f241c0cbc00 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.405+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f240806b860 msgr2=0x7f240806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.405+0000 7f2422943640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f240806b860 0x7f240806dd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f240c001780 tx=0x7f240c009040 comp rx=0 tx=0).stop 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 msgr2=0x7f241c0c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 0x7f241c0c3fb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24100098b0 tx=0x7f2410004730 comp rx=0 tx=0).stop 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 shutdown_connections 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7f240806b860 0x7f240806dd20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f241c0cc520 0x7f241c0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f241c0cbc00 0x7f241c0c3fb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 --2- 172.21.15.136:0/2752167086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f241c0ca4e0 0x7f241c1e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 >> 172.21.15.136:0/2752167086 conn(0x7f241c0721f0 msgr2=0x7f241c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:52.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 shutdown_connections 2024-02-17T13:26:52.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.406+0000 7f2422943640 1 -- 172.21.15.136:0/2752167086 wait complete. 2024-02-17T13:26:52.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T13:26:52.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.522+0000 7fe2e45d0640 1 Processor -- start 2024-02-17T13:26:52.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.522+0000 7fe2e45d0640 1 -- start start 2024-02-17T13:26:52.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.523+0000 7fe2e45d0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe2dc0c7ce0 0x7fe2dc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:52.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.523+0000 7fe2e45d0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc15d090 con 0x7fe2dc15a730 2024-02-17T13:26:52.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.523+0000 7fe2e45d0640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc159d60 con 0x7fe2dc153df0 2024-02-17T13:26:52.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.523+0000 7fe2e45d0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc159ac0 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.524+0000 7fe2e236c640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe2dc153df0 0x7fe2dc06bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:44864/0 (socket says 172.21.15.136:44864) 2024-02-17T13:26:52.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.524+0000 7fe2e236c640 1 -- 172.21.15.136:0/2129555919 learned_addr learned my addr 172.21.15.136:0/2129555919 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:52.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.524+0000 7fe2e1b6b640 1 --2- 172.21.15.136:0/2129555919 >> v2:172.21.15.136:3300/0 conn(0x7fe2dc0c7ce0 0x7fe2dc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:52.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.526+0000 7fe2e136a640 1 -- 172.21.15.136:0/2129555919 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161547849 0 0) 0x7fe2dc159d60 con 0x7fe2dc153df0 2024-02-17T13:26:52.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.526+0000 7fe2e136a640 1 -- 172.21.15.136:0/2129555919 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c8003520 con 0x7fe2dc153df0 2024-02-17T13:26:52.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.527+0000 7fe2e1b6b640 1 -- 172.21.15.136:0/2129555919 >> v1:172.21.15.160:6789/0 conn(0x7fe2dc153df0 legacy=0x7fe2dc06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.527+0000 7fe2e1b6b640 1 -- 172.21.15.136:0/2129555919 >> v1:172.21.15.136:6789/0 conn(0x7fe2dc15a730 legacy=0x7fe2dc06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.527+0000 7fe2e1b6b640 1 -- 172.21.15.136:0/2129555919 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0c9130 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.532+0000 7fe2e1b6b640 1 --2- 172.21.15.136:0/2129555919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc15a1f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a5f8f04e5ecb05 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:52.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.535+0000 7fe2e136a640 1 -- 172.21.15.136:0/2129555919 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02f810 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.535+0000 7fe2e136a640 1 -- 172.21.15.136:0/2129555919 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe2cc02f970 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.535+0000 7fe2e136a640 1 -- 172.21.15.136:0/2129555919 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02fd20 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 -- 172.21.15.136:0/2129555919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 msgr2=0x7fe2dc15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/2129555919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc15a1f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc02b9f0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 -- 172.21.15.136:0/2129555919 shutdown_connections 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/2129555919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc15a1f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 -- 172.21.15.136:0/2129555919 >> 172.21.15.136:0/2129555919 conn(0x7fe2dc06e900 msgr2=0x7fe2dc06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 -- 172.21.15.136:0/2129555919 shutdown_connections 2024-02-17T13:26:52.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.536+0000 7fe2e45d0640 1 -- 172.21.15.136:0/2129555919 wait complete. 2024-02-17T13:26:52.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.537+0000 7fe2e45d0640 1 Processor -- start 2024-02-17T13:26:52.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.537+0000 7fe2e45d0640 1 -- start start 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e45d0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e45d0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2dc153df0 0x7fe2dc1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e45d0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2dc15a730 0x7fe2dc1e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e45d0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc14cf10 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e45d0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc14c8c0 con 0x7fe2dc153df0 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e45d0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c7780 con 0x7fe2dc15a730 2024-02-17T13:26:52.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.538+0000 7fe2e236c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:52.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.539+0000 7fe2e1b6b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2dc153df0 0x7fe2dc1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:52.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.539+0000 7fe2e236c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc14a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54464/0 (socket says 172.21.15.136:54464) 2024-02-17T13:26:52.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.539+0000 7fe2e236c640 1 -- 172.21.15.136:0/1567363645 learned_addr learned my addr 172.21.15.136:0/1567363645 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:52.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.539+0000 7fe2e2b6d640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2dc15a730 0x7fe2dc1e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:52.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.542+0000 7fe2e236c640 1 -- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2dc15a730 msgr2=0x7fe2dc1e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.542+0000 7fe2e236c640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2dc15a730 0x7fe2dc1e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.542+0000 7fe2e236c640 1 -- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2dc153df0 msgr2=0x7fe2dc1f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:52.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.542+0000 7fe2e236c640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2dc153df0 0x7fe2dc1f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:52.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.542+0000 7fe2e236c640 1 -- 172.21.15.136:0/1567363645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009400 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.544+0000 7fe2e236c640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc14a910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800cbc0 tx=0x7fe2d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:52.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.548+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800ad40 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.548+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe2d8012400 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.548+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800aea0 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.548+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc0cb600 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.548+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc14c300 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.549+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc067bf0 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.795+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe2d8007070 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.795+0000 7fe2d2ffd640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe2c006b890 0x7fe2c006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:52.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.795+0000 7fe2e1b6b640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe2c006b890 0x7fe2c006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:52.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.796+0000 7fe2e1b6b640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe2c006b890 0x7fe2c006dd50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc036000 tx=0x7fe2cc008030 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.809+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 7049+0+0 (secure 0 0 0) 0x7fe2d8058ec0 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.809+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2d8055160 con 0x7fe2dc0c7ce0 2024-02-17T13:26:52.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:52.979+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2dc0caa10 con 0x7fe2dc0c7ce0 2024-02-17T13:26:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.450+0000 7fe2d2ffd640 1 -- 172.21.15.136:0/1567363645 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe2d80170d0 con 0x7fe2dc0c7ce0 2024-02-17T13:26:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' removed 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.452+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe2c006b890 msgr2=0x7fe2c006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.452+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe2c006b890 0x7fe2c006dd50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc036000 tx=0x7fe2cc008030 comp rx=0 tx=0).stop 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 msgr2=0x7fe2dc14a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc14a910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800cbc0 tx=0x7fe2d800a430 comp rx=0 tx=0).stop 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 shutdown_connections 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fe2c006b890 0x7fe2c006dd50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2dc15a730 0x7fe2dc1e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2dc153df0 0x7fe2dc1f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 --2- 172.21.15.136:0/1567363645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2dc0c7ce0 0x7fe2dc14a910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 >> 172.21.15.136:0/1567363645 conn(0x7fe2dc06e900 msgr2=0x7fe2dc158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 shutdown_connections 2024-02-17T13:26:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.453+0000 7fe2e45d0640 1 -- 172.21.15.136:0/1567363645 wait complete. 2024-02-17T13:26:53.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T13:26:53.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.573+0000 7fd32f2d4640 1 Processor -- start 2024-02-17T13:26:53.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.573+0000 7fd32f2d4640 1 -- start start 2024-02-17T13:26:53.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32f2d4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd328155190 0x7fd3280aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:53.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32f2d4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3280af9c0 0x7fd3280c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:53.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32f2d4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3280c2d90 con 0x7fd3280c8410 2024-02-17T13:26:53.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32f2d4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3280c3460 con 0x7fd328155190 2024-02-17T13:26:53.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32f2d4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3280c4630 con 0x7fd3280af9c0 2024-02-17T13:26:53.574 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32d070640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd328155190 0x7fd3280aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:53.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.574+0000 7fd32c86f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3280af9c0 0x7fd3280c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:53.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.575+0000 7fd32c86f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3280af9c0 0x7fd3280c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:47326/0 (socket says 172.21.15.136:47326) 2024-02-17T13:26:53.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.575+0000 7fd32c86f640 1 -- 172.21.15.136:0/225656503 learned_addr learned my addr 172.21.15.136:0/225656503 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:53.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.577+0000 7fd32c86f640 1 -- 172.21.15.136:0/225656503 >> v2:172.21.15.136:3300/0 conn(0x7fd328155190 msgr2=0x7fd3280aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:53.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.577+0000 7fd32c86f640 1 --2- 172.21.15.136:0/225656503 >> v2:172.21.15.136:3300/0 conn(0x7fd328155190 0x7fd3280aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.577+0000 7fd32c86f640 1 -- 172.21.15.136:0/225656503 >> v1:172.21.15.136:6789/0 conn(0x7fd3280c8410 legacy=0x7fd32806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:53.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.577+0000 7fd32c86f640 1 -- 172.21.15.136:0/225656503 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280c9650 con 0x7fd3280af9c0 2024-02-17T13:26:53.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.578+0000 7fd32c86f640 1 --2- 172.21.15.136:0/225656503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3280c7ed0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd3280c48a0 tx=0x7fd31802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8582fc199ee0405d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:53.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.582+0000 7fd31ffff640 1 -- 172.21.15.136:0/225656503 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318030860 con 0x7fd3280af9c0 2024-02-17T13:26:53.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.582+0000 7fd31ffff640 1 -- 172.21.15.136:0/225656503 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd3180309c0 con 0x7fd3280af9c0 2024-02-17T13:26:53.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.582+0000 7fd31ffff640 1 -- 172.21.15.136:0/225656503 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318030d70 con 0x7fd3280af9c0 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 -- 172.21.15.136:0/225656503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 msgr2=0x7fd3280c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/225656503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3280c7ed0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd3280c48a0 tx=0x7fd31802b9a0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 -- 172.21.15.136:0/225656503 shutdown_connections 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/225656503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3280c7ed0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/225656503 >> v2:172.21.15.136:3300/0 conn(0x7fd328155190 0x7fd3280aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 -- 172.21.15.136:0/225656503 >> 172.21.15.136:0/225656503 conn(0x7fd32806aee0 msgr2=0x7fd3280668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 -- 172.21.15.136:0/225656503 shutdown_connections 2024-02-17T13:26:53.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.583+0000 7fd32f2d4640 1 -- 172.21.15.136:0/225656503 wait complete. 2024-02-17T13:26:53.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.584+0000 7fd32f2d4640 1 Processor -- start 2024-02-17T13:26:53.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.584+0000 7fd32f2d4640 1 -- start start 2024-02-17T13:26:53.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.585+0000 7fd32f2d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3281f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:53.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.585+0000 7fd32f2d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3280c8410 0x7fd3281f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:53.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.585+0000 7fd32f2d4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd328155190 0x7fd3280cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:53.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.585+0000 7fd32f2d4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281f3510 con 0x7fd328155190 2024-02-17T13:26:53.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.585+0000 7fd32f2d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280cb790 con 0x7fd3280af9c0 2024-02-17T13:26:53.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.585+0000 7fd32f2d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b2070 con 0x7fd3280c8410 2024-02-17T13:26:53.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.586+0000 7fd32d070640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3281f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:53.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.586+0000 7fd32d871640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd328155190 0x7fd3280cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:53.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.586+0000 7fd32c86f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3280c8410 0x7fd3281f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:53.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.586+0000 7fd32d070640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3281f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.136:47340/0 (socket says 172.21.15.136:47340) 2024-02-17T13:26:53.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.586+0000 7fd32d070640 1 -- 172.21.15.136:0/235132020 learned_addr learned my addr 172.21.15.136:0/235132020 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.590+0000 7fd32c86f640 1 -- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 msgr2=0x7fd3281f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.590+0000 7fd32c86f640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3281f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.590+0000 7fd32c86f640 1 -- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd328155190 msgr2=0x7fd3280cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.590+0000 7fd32c86f640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd328155190 0x7fd3280cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.590+0000 7fd32c86f640 1 -- 172.21.15.136:0/235132020 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180094d0 con 0x7fd3280c8410 2024-02-17T13:26:53.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.590+0000 7fd32d070640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3281f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T13:26:53.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.593+0000 7fd32c86f640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3280c8410 0x7fd3281f2ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd3280c4770 tx=0x7fd318004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:53.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.596+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318039b50 con 0x7fd3280c8410 2024-02-17T13:26:53.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.596+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd318039cf0 con 0x7fd3280c8410 2024-02-17T13:26:53.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.596+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318043670 con 0x7fd3280c8410 2024-02-17T13:26:53.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.596+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280b2310 con 0x7fd3280c8410 2024-02-17T13:26:53.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.597+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3280cb420 con 0x7fd3280c8410 2024-02-17T13:26:53.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.598+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd328069970 con 0x7fd3280c8410 2024-02-17T13:26:53.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.616+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd3180437d0 con 0x7fd3280c8410 2024-02-17T13:26:53.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.616+0000 7fd31dffb640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd30c06b840 0x7fd30c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:53.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.616+0000 7fd32d070640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd30c06b840 0x7fd30c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:53.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.617+0000 7fd32d070640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd30c06b840 0x7fd30c06dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd3240112c0 tx=0x7fd324009190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:53.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.619+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6611+0+0 (secure 0 0 0) 0x7fd31807aef0 con 0x7fd3280c8410 2024-02-17T13:26:53.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:53.865+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd318077190 con 0x7fd3280c8410 2024-02-17T13:26:54.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.036+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3280701f0 con 0x7fd3280c8410 2024-02-17T13:26:54.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.639+0000 7fd31dffb640 1 -- 172.21.15.136:0/235132020 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd3180340d0 con 0x7fd3280c8410 2024-02-17T13:26:54.639 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' removed 2024-02-17T13:26:54.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd30c06b840 msgr2=0x7fd30c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd30c06b840 0x7fd30c06dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd3240112c0 tx=0x7fd324009190 comp rx=0 tx=0).stop 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3280c8410 msgr2=0x7fd3281f2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3280c8410 0x7fd3281f2ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd3280c4770 tx=0x7fd318004730 comp rx=0 tx=0).stop 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 shutdown_connections 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd30c06b840 0x7fd30c06dd00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd328155190 0x7fd3280cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3280c8410 0x7fd3281f2ea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 --2- 172.21.15.136:0/235132020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280af9c0 0x7fd3281f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 >> 172.21.15.136:0/235132020 conn(0x7fd32806aee0 msgr2=0x7fd3280668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 shutdown_connections 2024-02-17T13:26:54.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.641+0000 7fd32f2d4640 1 -- 172.21.15.136:0/235132020 wait complete. 2024-02-17T13:26:54.653 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-02-17T13:26:54.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.757+0000 7fd39f6ff640 1 Processor -- start 2024-02-17T13:26:54.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.758+0000 7fd39f6ff640 1 -- start start 2024-02-17T13:26:54.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.758+0000 7fd39f6ff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd3980ca340 0x7fd3980ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:54.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.758+0000 7fd39f6ff640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980c71e0 con 0x7fd398154120 2024-02-17T13:26:54.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.758+0000 7fd39f6ff640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39815dbd0 con 0x7fd3980c6850 2024-02-17T13:26:54.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.758+0000 7fd39f6ff640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980c7ba0 con 0x7fd3980ca340 2024-02-17T13:26:54.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.759+0000 7fd39dc9c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd3980ca340 0x7fd3980ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:54.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.759+0000 7fd39cc9a640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd3980c6850 0x7fd3980cb010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.136:44868/0 (socket says 172.21.15.136:44868) 2024-02-17T13:26:54.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.759+0000 7fd39cc9a640 1 -- 172.21.15.136:0/1786463460 learned_addr learned my addr 172.21.15.136:0/1786463460 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-02-17T13:26:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.762+0000 7fd38ffff640 1 -- 172.21.15.136:0/1786463460 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712198678 0 0) 0x7fd39815dbd0 con 0x7fd3980c6850 2024-02-17T13:26:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.762+0000 7fd38ffff640 1 -- 172.21.15.136:0/1786463460 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd384003520 con 0x7fd3980c6850 2024-02-17T13:26:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.762+0000 7fd39dc9c640 1 -- 172.21.15.136:0/1786463460 >> v1:172.21.15.160:6789/0 conn(0x7fd3980c6850 legacy=0x7fd3980cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.762+0000 7fd39dc9c640 1 -- 172.21.15.136:0/1786463460 >> v1:172.21.15.136:6789/0 conn(0x7fd398154120 legacy=0x7fd3980c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T13:26:54.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.762+0000 7fd39dc9c640 1 -- 172.21.15.136:0/1786463460 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980c6c70 con 0x7fd3980ca340 2024-02-17T13:26:54.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.765+0000 7fd39dc9c640 1 --2- 172.21.15.136:0/1786463460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980ca790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd390009d90 tx=0x7fd39002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344add636ceea233 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:54.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.769+0000 7fd38ffff640 1 -- 172.21.15.136:0/1786463460 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002cc60 con 0x7fd3980ca340 2024-02-17T13:26:54.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.769+0000 7fd38ffff640 1 -- 172.21.15.136:0/1786463460 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd39002cdc0 con 0x7fd3980ca340 2024-02-17T13:26:54.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.769+0000 7fd38ffff640 1 -- 172.21.15.136:0/1786463460 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390034680 con 0x7fd3980ca340 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 -- 172.21.15.136:0/1786463460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 msgr2=0x7fd3980ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/1786463460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980ca790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd390009d90 tx=0x7fd39002beb0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 -- 172.21.15.136:0/1786463460 shutdown_connections 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/1786463460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980ca790 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 -- 172.21.15.136:0/1786463460 >> 172.21.15.136:0/1786463460 conn(0x7fd39806d450 msgr2=0x7fd39806b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 -- 172.21.15.136:0/1786463460 shutdown_connections 2024-02-17T13:26:54.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.770+0000 7fd39f6ff640 1 -- 172.21.15.136:0/1786463460 wait complete. 2024-02-17T13:26:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.771+0000 7fd39f6ff640 1 Processor -- start 2024-02-17T13:26:54.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.771+0000 7fd39f6ff640 1 -- start start 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39f6ff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3980c6850 0x7fd3980cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39f6ff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39f6ff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd398154120 0x7fd3980c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39f6ff640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c5cc0 con 0x7fd3980ca340 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39f6ff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39815a9d0 con 0x7fd3980c6850 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39f6ff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c5ef0 con 0x7fd398154120 2024-02-17T13:26:54.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39cc9a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:54.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.772+0000 7fd39d49b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3980c6850 0x7fd3980cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:54.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.773+0000 7fd39cc9a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54494/0 (socket says 172.21.15.136:54494) 2024-02-17T13:26:54.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.773+0000 7fd39cc9a640 1 -- 172.21.15.136:0/2037691453 learned_addr learned my addr 172.21.15.136:0/2037691453 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-02-17T13:26:54.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.773+0000 7fd39dc9c640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd398154120 0x7fd3980c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:54.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.776+0000 7fd39d49b640 1 -- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd398154120 msgr2=0x7fd3980c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.776+0000 7fd39d49b640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd398154120 0x7fd3980c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.776+0000 7fd39d49b640 1 -- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 msgr2=0x7fd3980c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.776+0000 7fd39d49b640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:54.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.776+0000 7fd39d49b640 1 -- 172.21.15.136:0/2037691453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd390009a70 con 0x7fd3980c6850 2024-02-17T13:26:54.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.778+0000 7fd39d49b640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3980c6850 0x7fd3980cf290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b3e0 tx=0x7fd39400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:54.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.782+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394004020 con 0x7fd3980c6850 2024-02-17T13:26:54.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.782+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd394004180 con 0x7fd3980c6850 2024-02-17T13:26:54.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.782+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011630 con 0x7fd3980c6850 2024-02-17T13:26:54.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.782+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3981f02c0 con 0x7fd3980c6850 2024-02-17T13:26:54.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.782+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980c44a0 con 0x7fd3980c6850 2024-02-17T13:26:54.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:54.783+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3981f0500 con 0x7fd3980c6850 2024-02-17T13:26:55.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.029+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd394011790 con 0x7fd3980c6850 2024-02-17T13:26:55.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.029+0000 7fd38dffb640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd37c06b810 0x7fd37c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T13:26:55.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.030+0000 7fd39cc9a640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd37c06b810 0x7fd37c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T13:26:55.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.030+0000 7fd39cc9a640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd37c06b810 0x7fd37c06dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd39815b160 tx=0x7fd388009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T13:26:55.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.034+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6168+0+0 (secure 0 0 0) 0x7fd394058e50 con 0x7fd3980c6850 2024-02-17T13:26:55.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.044+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3940550f0 con 0x7fd3980c6850 2024-02-17T13:26:55.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.221+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd398067bf0 con 0x7fd3980c6850 2024-02-17T13:26:55.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.679+0000 7fd38dffb640 1 -- 172.21.15.136:0/2037691453 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fd394015070 con 0x7fd3980c6850 2024-02-17T13:26:55.679 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data_ec' removed 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd37c06b810 msgr2=0x7fd37c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd37c06b810 0x7fd37c06dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd39815b160 tx=0x7fd388009040 comp rx=0 tx=0).stop 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3980c6850 msgr2=0x7fd3980cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3980c6850 0x7fd3980cf290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b3e0 tx=0x7fd39400b8a0 comp rx=0 tx=0).stop 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 shutdown_connections 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:6832/451441740,v1:172.21.15.136:6833/451441740] conn(0x7fd37c06b810 0x7fd37c06dcd0 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd39815b160 tx=0x7fd388009040 comp rx=0 tx=0).stop 2024-02-17T13:26:55.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd398154120 0x7fd3980c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:55.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd3980ca340 0x7fd3980c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:55.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 --2- 172.21.15.136:0/2037691453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3980c6850 0x7fd3980cf290 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T13:26:55.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 >> 172.21.15.136:0/2037691453 conn(0x7fd39806d450 msgr2=0x7fd3980cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T13:26:55.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 shutdown_connections 2024-02-17T13:26:55.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-02-17T13:26:55.682+0000 7fd39f6ff640 1 -- 172.21.15.136:0/2037691453 wait complete. 2024-02-17T13:26:55.695 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-17T13:26:55.695 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T13:26:55.695 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:26:55.695 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:26:55.695 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi136 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2024-02-17T13:26:55.696 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T13:26:55.696 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-17T13:26:55.696 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:26:55.697 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:26:55.697 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi136 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2024-02-17T13:26:55.697 INFO:tasks.ceph.mds.c:Stopped 2024-02-17T13:26:55.697 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-02-17T13:26:55.697 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:26:55.710 INFO:tasks.ceph.mds.e.smithi136.stderr:2024-02-17T13:26:55.702+0000 b5db640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 43235) UID: 0 2024-02-17T13:26:55.711 INFO:tasks.ceph.mds.e.smithi136.stderr:2024-02-17T13:26:55.703+0000 b5db640 -1 mds.e *** got signal Terminated *** 2024-02-17T13:26:55.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-02-17T13:26:55.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-02-17T13:26:55.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-02-17T13:26:55.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-02-17T13:26:55.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-02-17T13:27:01.799 INFO:tasks.ceph.mds.e:Stopped 2024-02-17T13:27:01.799 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T13:27:01.799 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:01.800 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:27:01.800 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2024-02-17T13:27:01.803 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T13:27:01.803 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-17T13:27:01.803 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:01.803 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:27:01.803 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-02-17T13:27:01.804 INFO:tasks.ceph.mds.d:Stopped 2024-02-17T13:27:01.804 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-02-17T13:27:01.804 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:01.804 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:27:01.804 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2024-02-17T13:27:01.804 INFO:tasks.ceph.mds.f:Stopped 2024-02-17T13:27:01.804 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-17T13:27:01.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-17T13:27:01.805 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:01.805 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-02-17T13:27:01.806+0000 7ff9b6644640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37695) UID: 0 2024-02-17T13:27:01.806 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-02-17T13:27:01.806+0000 7ff9b6644640 -1 osd.0 31 *** Got signal Terminated *** 2024-02-17T13:27:02.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-02-17T13:27:02.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-02-17T13:27:02.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-02-17T13:27:02.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-02-17T13:27:02.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-02-17T13:27:07.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:27:07.681 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:27:07.907 INFO:tasks.ceph.osd.0:Stopped 2024-02-17T13:27:07.907 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-17T13:27:07.907 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:07.908 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-02-17T13:27:07.908+0000 7f5c366aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37703) UID: 0 2024-02-17T13:27:07.908 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-02-17T13:27:07.908+0000 7f5c366aa640 -1 osd.1 32 *** Got signal Terminated *** 2024-02-17T13:27:08.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-02-17T13:27:14.009 INFO:tasks.ceph.osd.1:Stopped 2024-02-17T13:27:14.009 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-17T13:27:14.009 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:14.011 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-02-17T13:27:14.010+0000 7f2f994e3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37708) UID: 0 2024-02-17T13:27:14.011 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-02-17T13:27:14.010+0000 7f2f994e3640 -1 osd.2 34 *** Got signal Terminated *** 2024-02-17T13:27:14.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-02-17T13:27:14.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-02-17T13:27:20.111 INFO:tasks.ceph.osd.2:Stopped 2024-02-17T13:27:20.112 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-17T13:27:20.112 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:20.113 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-02-17T13:27:20.113+0000 7f3c91ccc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37710) UID: 0 2024-02-17T13:27:20.113 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-02-17T13:27:20.113+0000 7f3c91ccc640 -1 osd.3 35 *** Got signal Terminated *** 2024-02-17T13:27:20.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-02-17T13:27:20.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-02-17T13:27:26.214 INFO:tasks.ceph.osd.3:Stopped 2024-02-17T13:27:26.214 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-17T13:27:26.214 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:26.215 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-02-17T13:27:26.216+0000 7f68350a4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 38092) UID: 0 2024-02-17T13:27:26.215 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-02-17T13:27:26.216+0000 7f68350a4640 -1 osd.4 36 *** Got signal Terminated *** 2024-02-17T13:27:26.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-17T13:27:26.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-02-17T13:27:32.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-02-17T13:27:32.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-02-17T13:27:32.316 INFO:tasks.ceph.osd.4:Stopped 2024-02-17T13:27:32.316 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-17T13:27:32.316 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:32.317 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-02-17T13:27:32.318+0000 7f59a4051640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 38093) UID: 0 2024-02-17T13:27:32.317 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-02-17T13:27:32.318+0000 7f59a4051640 -1 osd.5 37 *** Got signal Terminated *** 2024-02-17T13:27:37.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-02-17T13:27:37.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-02-17T13:27:37.783 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:27:37.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:27:38.419 INFO:tasks.ceph.osd.5:Stopped 2024-02-17T13:27:38.420 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-17T13:27:38.420 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:38.420 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-02-17T13:27:38.420+0000 7f9ff19a8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 38096) UID: 0 2024-02-17T13:27:38.421 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-02-17T13:27:38.420+0000 7f9ff19a8640 -1 osd.6 38 *** Got signal Terminated *** 2024-02-17T13:27:43.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-02-17T13:27:43.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-02-17T13:27:44.521 INFO:tasks.ceph.osd.6:Stopped 2024-02-17T13:27:44.521 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-17T13:27:44.521 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:44.522 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-02-17T13:27:44.522+0000 7fc2c6636640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 38097) UID: 0 2024-02-17T13:27:44.522 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-02-17T13:27:44.522+0000 7fc2c6636640 -1 osd.7 38 *** Got signal Terminated *** 2024-02-17T13:27:48.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-02-17T13:27:48.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-02-17T13:27:50.623 INFO:tasks.ceph.osd.7:Stopped 2024-02-17T13:27:50.623 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-17T13:27:50.624 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-17T13:27:50.624 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:50.625 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T13:27:50.625+0000 7f936ce9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 37441) UID: 0 2024-02-17T13:27:50.625 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-02-17T13:27:50.625+0000 7f936ce9b640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-17T13:27:50.651 INFO:tasks.ceph.mgr.y:Stopped 2024-02-17T13:27:50.651 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-17T13:27:50.651 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:50.677 INFO:tasks.ceph.mgr.x:Stopped 2024-02-17T13:27:50.677 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-17T13:27:50.677 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-17T13:27:50.677 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:50.707 INFO:tasks.ceph.mon.a.smithi136.stderr:2024-02-17T13:27:50.695+0000 9f86640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 37404) UID: 0 2024-02-17T13:27:50.708 INFO:tasks.ceph.mon.a.smithi136.stderr:2024-02-17T13:27:50.697+0000 9f86640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-17T13:27:51.446 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:30:46.309 37426== 2024-02-17T13:27:51.446 INFO:tasks.ceph.mon.a.smithi136.stderr:==00:00:30:46.309 37426== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:27:51.459 INFO:tasks.ceph.mon.a.smithi136.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:27:54.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-02-17T13:27:54.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-02-17T13:27:56.778 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:27:56.778 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi136 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-02-17T13:27:56.779 INFO:tasks.ceph.mon.a:Stopped 2024-02-17T13:27:56.779 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-17T13:27:56.779 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:27:56.795 INFO:tasks.ceph.mon.b.smithi160.stderr:2024-02-17T13:27:56.784+0000 9f86640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 37504) UID: 0 2024-02-17T13:27:56.797 INFO:tasks.ceph.mon.b.smithi160.stderr:2024-02-17T13:27:56.786+0000 9f86640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-02-17T13:27:57.375 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:30:52.167 37511== 2024-02-17T13:27:57.375 INFO:tasks.ceph.mon.b.smithi160.stderr:==00:00:30:52.167 37511== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:27:57.385 INFO:tasks.ceph.mon.b.smithi160.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:27:59.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-02-17T13:27:59.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-02-17T13:28:02.881 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:28:02.882 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-02-17T13:28:02.882 INFO:tasks.ceph.mon.b:Stopped 2024-02-17T13:28:02.882 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-17T13:28:02.882 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T13:28:02.898 INFO:tasks.ceph.mon.c.smithi160.stderr:2024-02-17T13:28:02.887+0000 9f86640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 37507) UID: 0 2024-02-17T13:28:02.898 INFO:tasks.ceph.mon.c.smithi160.stderr:2024-02-17T13:28:02.889+0000 9f86640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-02-17T13:28:03.527 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:30:58.319 37512== 2024-02-17T13:28:03.527 INFO:tasks.ceph.mon.c.smithi160.stderr:==00:00:30:58.319 37512== Exit program on first error (--exit-on-first-error=yes) 2024-02-17T13:28:03.538 INFO:tasks.ceph.mon.c.smithi160.stderr:daemon-helper: command failed with exit status 42 2024-02-17T13:28:04.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-02-17T13:28:04.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-02-17T13:28:08.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:28:08.117 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:28:08.984 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-17T13:28:08.984 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-02-17T13:28:08.985 INFO:tasks.ceph.mon.c:Stopped 2024-02-17T13:28:08.985 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-17T13:28:08.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-02-17T13:28:09.027 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T13:28:09.028 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-17T13:28:09.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-02-17T13:28:09.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T13:28:09.210 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-17T13:28:09.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T13:28:09.275 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-17T13:28:09.342 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T13:28:09.342 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-17T13:28:09.417 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T13:28:09.417 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-17T13:28:09.540 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T13:28:09.540 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-17T13:28:09.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T13:28:09.604 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-17T13:28:09.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T13:28:09.668 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-17T13:28:09.727 INFO:tasks.ceph:Archiving mon data... 2024-02-17T13:28:09.732 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/data/mon.a.tgz 2024-02-17T13:28:09.732 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-02-17T13:28:09.748 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.mCgtzYa8xI 2024-02-17T13:28:09.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.mCgtzYa8xI 2024-02-17T13:28:09.897 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.mCgtzYa8xI 2024-02-17T13:28:09.982 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.mCgtzYa8xI is 318KB 2024-02-17T13:28:10.050 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.mCgtzYa8xI 2024-02-17T13:28:10.064 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/data/mon.b.tgz 2024-02-17T13:28:10.065 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-02-17T13:28:10.081 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.noMMaB6EA8 2024-02-17T13:28:10.081 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.noMMaB6EA8 2024-02-17T13:28:10.225 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.noMMaB6EA8 2024-02-17T13:28:10.310 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.noMMaB6EA8 is 338KB 2024-02-17T13:28:10.405 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.noMMaB6EA8 2024-02-17T13:28:10.420 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/data/mon.c.tgz 2024-02-17T13:28:10.420 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-02-17T13:28:10.474 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.Cpkb6rndbA 2024-02-17T13:28:10.474 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Cpkb6rndbA 2024-02-17T13:28:10.605 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.Cpkb6rndbA 2024-02-17T13:28:10.690 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.Cpkb6rndbA is 338KB 2024-02-17T13:28:10.785 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.Cpkb6rndbA 2024-02-17T13:28:10.799 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-17T13:28:10.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-17T13:28:10.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-17T13:28:11.143 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-02-17T13:28:11.415 INFO:tasks.ceph:Archiving crash dumps... 2024-02-17T13:28:11.416 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/remote/smithi136/crash 2024-02-17T13:28:11.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-17T13:28:11.445 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/remote/smithi160/crash 2024-02-17T13:28:11.446 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-17T13:28:11.472 INFO:tasks.ceph:Shutting down logrotate 2024-02-17T13:28:11.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:28:11.489 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T13:28:11.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-17T13:28:11.581 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-17T13:28:11.620 INFO:tasks.ceph:Compressing logs... 2024-02-17T13:28:11.620 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T13:28:11.624 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T13:28:11.648 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-02-17T13:28:11.649 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45625.log 2024-02-17T13:28:11.649 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46001.log 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-02-17T13:28:11.700 INFO:teuthology.orchestra.run.smithi160.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38001.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37801.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz/var/log/ceph/ceph-client.admin.38001.log: 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37761.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38001.log.gz 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37801.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37761.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37801.log.gz 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.audit.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37761.log.gz 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-17T13:28:11.701 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-02-17T13:28:11.702 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-17T13:28:11.702 INFO:teuthology.orchestra.run.smithi160.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-02-17T13:28:11.702 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-02-17T13:28:11.713 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37961.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47177.log: /var/log/ceph/ceph-client.admin.45625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51562.log 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45625.log.gz 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46001.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51562.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46001.log.gz 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43860.log 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51562.log.gz 2024-02-17T13:28:11.714 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43860.log.gz 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51352.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43922.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50916.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51352.log.gz 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.48089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46807.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46937.log 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46807.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50916.log.gz 2024-02-17T13:28:11.715 INFO:teuthology.orchestra.run.smithi136.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46467.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46807.log.gz 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46220.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46937.log: /var/log/ceph/ceph-client.admin.46467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50522.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46937.log.gz 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46220.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46467.log.gz -5 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46223.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46220.log.gz 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52408.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46223.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50522.log.gz 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52408.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46223.log.gz 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/valgrind/mds.c.log: gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.52408.log.gz -- 2024-02-17T13:28:11.716 INFO:teuthology.orchestra.run.smithi136.stderr: /var/log/ceph/valgrind/client.0.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44216.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52450.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-02-17T13:28:11.717 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52450.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.44216.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51142.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43767.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52450.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46211.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50958.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46211.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51142.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45832.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50958.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46211.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51100.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45832.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50958.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45832.log.gz 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51646.log 2024-02-17T13:28:11.718 INFO:teuthology.orchestra.run.smithi136.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51100.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51646.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47009.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48023.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37833.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.48023.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr: /var/log/ceph/ceph-client.admin.43515.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37833.log.gz 2024-02-17T13:28:11.719 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43515.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48023.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43370.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51520.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52366.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45109.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51520.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52072.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50480.log 2024-02-17T13:28:11.720 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50606.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52366.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50480.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52072.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44983.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50480.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44983.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31429.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50606.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44983.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50874.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.tmp-client.admin.31429.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31429.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44090.log 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.audit.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50874.log.gz 2024-02-17T13:28:11.721 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51898.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44090.log.gz 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45151.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43683.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52324.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51898.log.gz 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43683.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43683.log.gz 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2024-02-17T13:28:11.722 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52282.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52282.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46934.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52282.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51310.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51436.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46934.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-02-17T13:28:11.723 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51310.log.gz 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46513.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44006.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46513.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45916.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gz 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45916.log.gz 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45209.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47723.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47513.log: /var/log/ceph/ceph-client.admin.45209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51394.log 2024-02-17T13:28:11.724 INFO:teuthology.orchestra.run.smithi136.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45209.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43641.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47723.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51394.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43557.log: 92.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52000.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43641.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz --verbose 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: -- /var/log/ceph/ceph-client.admin.50748.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43641.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52240.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50748.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52000.log.gz 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44048.log 2024-02-17T13:28:11.725 INFO:teuthology.orchestra.run.smithi136.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50748.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47471.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52240.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45067.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.44048.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48155.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52196.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45067.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.48155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46492.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.52196.log: /var/log/ceph/ceph-client.admin.46492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52196.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48155.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46492.log.gz 2024-02-17T13:28:11.726 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip/var/log/ceph/ceph-client.admin.46500.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45251.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47135.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46516.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5/var/log/ceph/ceph-client.admin.45251.log: --verbose -- /var/log/ceph/ceph-client.admin.51814.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46516.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45251.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51814.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46516.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51814.log.gz 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr: /var/log/ceph/ceph-client.admin.45874.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43725.log 2024-02-17T13:28:11.727 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45728.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz/var/log/ceph/ceph-client.admin.43725.log: 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43725.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51268.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46777.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46777.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51268.log.gz 2024-02-17T13:28:11.728 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46224.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46777.log.gz 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mgr.y.log: gzip 88.3% -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46224.log.gz 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51940.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43964.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5%/var/log/ceph/ceph-client.admin.51940.log: -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52154.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51940.log.gz 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz/var/log/ceph/ceph-client.admin.52154.log: 2024-02-17T13:28:11.729 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52154.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51730.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45583.log: /var/log/ceph/ceph-client.admin.50832.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1%/var/log/ceph/ceph-client.admin.51730.log: -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51730.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51226.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47597.log: /var/log/ceph/ceph-client.admin.51226.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51226.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43466.log 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47681.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz 2024-02-17T13:28:11.730 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43240.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43240.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43466.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51604.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43125.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50564.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48670.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50564.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51604.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50564.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45959.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.0.48670.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51856.log 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45959.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45959.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-17T13:28:11.731 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51856.log.gz 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43285.log 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43812.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43285.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43285.log.gz 2024-02-17T13:28:11.732 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2024-02-17T13:28:11.734 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-02-17T13:28:11.734 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45780.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37841.log 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37841.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37841.log.gz 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.b.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-17T13:28:11.737 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37717.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-02-17T13:28:11.738 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45025.log 2024-02-17T13:28:11.739 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46213.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-02-17T13:28:11.744 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50690.log 2024-02-17T13:28:11.744 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37921.log 2024-02-17T13:28:11.757 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45025.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45025.log.gz 2024-02-17T13:28:11.757 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-17T13:28:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47765.log 2024-02-17T13:28:11.758 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50690.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50690.log.gz 2024-02-17T13:28:11.759 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37921.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37921.log.gz 2024-02-17T13:28:11.764 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37881.log 2024-02-17T13:28:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-02-17T13:28:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47765.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47765.log.gz 2024-02-17T13:28:11.776 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.c.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-17T13:28:11.777 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.37881.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37881.log.gz 2024-02-17T13:28:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2024-02-17T13:28:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43599.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-02-17T13:28:11.787 INFO:teuthology.orchestra.run.smithi160.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-02-17T13:28:11.789 INFO:teuthology.orchestra.run.smithi136.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-17T13:28:11.789 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44282.log 2024-02-17T13:28:11.792 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50790.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2024-02-17T13:28:11.792 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-02-17T13:28:11.792 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44282.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44282.log.gz 2024-02-17T13:28:11.792 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2024-02-17T13:28:11.792 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47429.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46877.log 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47387.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48283.log 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46877.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46877.log.gz 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.48283.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48283.log.gz 2024-02-17T13:28:11.797 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-02-17T13:28:11.798 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46222.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2024-02-17T13:28:11.800 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45541.log 2024-02-17T13:28:11.800 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.46594.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-02-17T13:28:11.800 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37443.log 2024-02-17T13:28:11.800 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45541.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45541.log.gz 2024-02-17T13:28:11.800 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50648.log 2024-02-17T13:28:11.801 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37443.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.37443.log.gz 2024-02-17T13:28:11.802 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45293.log 2024-02-17T13:28:11.803 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.50648.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50648.log.gz 2024-02-17T13:28:11.804 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51184.log 2024-02-17T13:28:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45293.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45293.log.gz 2024-02-17T13:28:11.805 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-17T13:28:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51184.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51184.log.gz 2024-02-17T13:28:11.806 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2024-02-17T13:28:11.819 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51688.log 2024-02-17T13:28:11.820 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47891.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2024-02-17T13:28:11.827 INFO:teuthology.orchestra.run.smithi160.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-17T13:28:11.832 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2024-02-17T13:28:11.833 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.51688.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51688.log.gz 2024-02-17T13:28:11.846 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2024-02-17T13:28:11.847 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.47639.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2024-02-17T13:28:11.866 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45377.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2024-02-17T13:28:11.956 INFO:teuthology.orchestra.run.smithi136.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-17T13:28:12.208 INFO:teuthology.orchestra.run.smithi160.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-17T13:28:12.276 INFO:teuthology.orchestra.run.smithi160.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-17T13:28:12.943 INFO:teuthology.orchestra.run.smithi136.stderr: 89.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-17T13:28:14.460 INFO:teuthology.orchestra.run.smithi160.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-17T13:28:15.099 INFO:teuthology.orchestra.run.smithi160.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-17T13:28:15.103 INFO:teuthology.orchestra.run.smithi136.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-17T13:28:15.117 INFO:teuthology.orchestra.run.smithi160.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-17T13:28:15.259 INFO:teuthology.orchestra.run.smithi160.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-17T13:28:15.261 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-02-17T13:28:15.261 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m3.585s 2024-02-17T13:28:15.261 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m13.959s 2024-02-17T13:28:15.261 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.492s 2024-02-17T13:28:15.416 INFO:teuthology.orchestra.run.smithi136.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-17T13:28:15.564 INFO:teuthology.orchestra.run.smithi136.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-17T13:28:15.953 INFO:teuthology.orchestra.run.smithi136.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-17T13:28:24.135 INFO:teuthology.orchestra.run.smithi136.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.48670.log.gz 2024-02-17T13:28:31.738 INFO:teuthology.orchestra.run.smithi136.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-17T13:28:31.739 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-02-17T13:28:31.740 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m20.104s 2024-02-17T13:28:31.740 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m47.878s 2024-02-17T13:28:31.740 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m1.541s 2024-02-17T13:28:31.740 INFO:tasks.ceph:Archiving logs... 2024-02-17T13:28:31.740 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/remote/smithi136/log 2024-02-17T13:28:31.741 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T13:28:39.530 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/remote/smithi160/log 2024-02-17T13:28:39.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T13:28:41.859 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-02-17T13:28:41.861 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-17T13:28:41.870 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-02-17T13:28:41.870 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-17T13:28:41.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-17T13:28:41.873 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-17T13:28:41.966 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-17T13:28:41.975 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-17T13:28:41.975 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T13:28:41.978 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T13:28:41.991 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-02-17T13:28:41.993 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-02-17T13:28:41.997 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T13:28:41.997 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-02-17T13:28:41.997 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 99 +4744us[+4642us] +/- 126ms 2024-02-17T13:28:41.997 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -1460us[-1562us] +/- 79ms 2024-02-17T13:28:41.997 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -1332us[-1332us] +/- 69ms 2024-02-17T13:28:41.997 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T13:28:41.998 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T13:28:41.998 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-02-17T13:28:41.998 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 +4819us[+4819us] +/- 127ms 2024-02-17T13:28:41.998 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv02.front.sepia.ceph.com 3 7 377 102 -1307us[-1338us] +/- 78ms 2024-02-17T13:28:41.998 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -1231us[-1231us] +/- 69ms 2024-02-17T13:28:41.998 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T13:28:41.999 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-17T13:28:42.009 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-17T13:28:42.010 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-17T13:28:42.018 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-17T13:28:42.112 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-17T13:28:42.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T13:28:42.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T13:28:42.216 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T13:28:42.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T13:28:42.247 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-17T13:28:42.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-17T13:28:42.268 INFO:teuthology.task.internal:Duration was 2690.180880 seconds 2024-02-17T13:28:42.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-17T13:28:42.278 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-17T13:28:42.278 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T13:28:42.280 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T13:28:42.321 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T13:28:42.332 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T13:28:42.738 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-17T13:28:42.738 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-02-17T13:28:42.739 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T13:28:42.799 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-02-17T13:28:42.799 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T13:28:42.837 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-17T13:28:42.837 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T13:28:42.842 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T13:28:42.905 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-17T13:28:42.906 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T13:28:42.911 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T13:28:43.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-17T13:28:43.067 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-17T13:28:43.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T13:28:43.095 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T13:28:43.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-17T13:28:43.161 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T13:28:43.164 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T13:28:43.186 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-02-17T13:28:43.208 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-02-17T13:28:43.244 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T13:28:43.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T13:28:43.260 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T13:28:43.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T13:28:43.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-17T13:28:43.317 INFO:teuthology.task.internal:Transferring archived files... 2024-02-17T13:28:43.318 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/remote/smithi136 2024-02-17T13:28:43.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T13:28:43.362 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199/remote/smithi160 2024-02-17T13:28:43.363 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T13:28:43.406 INFO:teuthology.task.internal:Removing archive directory... 2024-02-17T13:28:43.406 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T13:28:43.410 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T13:28:43.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-17T13:28:43.472 INFO:teuthology.task.internal:Not uploading archives. 2024-02-17T13:28:43.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-17T13:28:43.490 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-17T13:28:43.490 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T13:28:43.493 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T13:28:43.505 INFO:teuthology.orchestra.run.smithi136.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 13:28 /home/ubuntu/cephtest 2024-02-17T13:28:43.509 INFO:teuthology.orchestra.run.smithi160.stdout: 265320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 13:28 /home/ubuntu/cephtest 2024-02-17T13:28:43.510 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-17T13:28:43.520 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-17T13:28:43.533 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-02-17T13:28:43.533 INFO:teuthology.nuke:Checking targets against current locks 2024-02-17T13:28:43.558 DEBUG:teuthology.nuke:shortname: smithi136 2024-02-17T13:28:43.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T13:28:43.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 12:35:30.693880', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUay0Fl6ckYKzkq7St8dBQgq70YS6bOUPrVl0axY9dlSf846o+iwqaGnFJD3lbjPt4mxa/ZlOgGceAhV/gSmdg='} 2024-02-17T13:28:43.586 DEBUG:teuthology.nuke:shortname: smithi160 2024-02-17T13:28:43.586 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T13:28:43.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 12:35:30.692546', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuhoUvgQ0QEgojHhkoCq2JwlRavsmEO0z4/tkX0qVF0pu884VU725wmEEfJjqLbcVNw0OW8H8+nq4CJblNcmok='} 2024-02-17T13:28:43.634 INFO:teuthology.orchestra.console.smithi136:Power off 2024-02-17T13:28:43.635 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T13:28:43.657 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-02-17T13:28:43.658 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:43.675 INFO:teuthology.orchestra.console.smithi160:Power off 2024-02-17T13:28:43.675 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T13:28:43.684 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T13:28:43.697 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-02-17T13:28:43.697 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:43.721 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-17T13:28:47.684 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:47.722 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:47.796 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T13:28:47.832 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-17T13:28:51.800 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:51.833 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:51.911 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T13:28:51.943 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-02-17T13:28:55.912 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:55.944 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T13:28:56.022 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-17T13:28:56.053 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-02-17T13:28:56.123 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-02-17T13:28:56.154 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-02-17T13:28:56.259 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 2690.180879831314 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-02-17T13:28:56.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:28:56.339 INFO:teuthology.run:FAIL